-- Logs begin at Sun 2022-09-11 00:10:19 UTC, end at Sun 2022-09-11 01:58:14 UTC. -- Sep 11 00:39:04.626461 dv-neutron-master-2-hyperv systemd[1]: Starting Devstack devstack@keystone.service... Sep 11 00:39:04.633642 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 00:39:04 2022] *** Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: nodename: dv-neutron-master-2-hyperv Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: machine: x86_64 Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: clock source: unix Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: pcre jit disabled Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: detected number of CPU cores: 4 Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: current working directory: / Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: detected binary path: /usr/bin/uwsgi-core Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: your processes number limit is 47680 Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: your memory page size is 4096 bytes Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: detected max file descriptor number: 2048 Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: lock engine: pthread robust mutexes Sep 11 00:39:04.636961 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: thunder lock: enabled Sep 11 00:39:04.637736 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 11 00:39:04.637736 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 00:39:04.676690 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: Python main interpreter initialized at 0x5628ce5199c0 Sep 11 00:39:04.676690 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: python threads support enabled Sep 11 00:39:04.676690 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: your server socket listen backlog is limited to 100 connections Sep 11 00:39:04.676690 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: your mercy for graceful operations on workers is 90 seconds Sep 11 00:39:04.677050 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 00:39:04.677050 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: *** Operational MODE: preforking *** Sep 11 00:39:04.677324 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: *** uWSGI is running in multiple interpreter mode *** Sep 11 00:39:04.677324 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: spawned uWSGI master process (pid: 81692) Sep 11 00:39:04.677523 dv-neutron-master-2-hyperv systemd[1]: Started Devstack devstack@keystone.service. Sep 11 00:39:04.678359 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: spawned uWSGI worker 1 (pid: 81701, cores: 1) Sep 11 00:39:04.678455 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: spawned uWSGI worker 2 (pid: 81702, cores: 1) Sep 11 00:39:04.678572 dv-neutron-master-2-hyperv devstack@keystone.service[81692]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 00:39:08.969123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:39:08.969123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: from cryptography.utils import int_from_bytes Sep 11 00:39:08.970511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:39:08.970511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: from cryptography.utils import int_from_bytes Sep 11 00:39:08.976416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:39:08.976416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: from cryptography.utils import int_from_bytes Sep 11 00:39:08.976864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:39:08.976864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: from cryptography.utils import int_from_bytes Sep 11 00:39:09.019154 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 00:39:09.019337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 00:39:09.019529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] command line args: [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 00:39:09.019792 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 00:39:09.019965 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ================================================================================ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 00:39:09.020212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] admin_token = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.020453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] config_dir = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.020636 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.020811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] config_source = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.020983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] debug = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.021175 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.021539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.021709 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.021954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.022193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.022416 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.022589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] log_config_append = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.022786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.022962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] log_dir = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.023134 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] log_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.023362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.023501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 00:39:09.023621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.023737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 00:39:09.023829 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.023950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] command line args: [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 00:39:09.024051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.024136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 00:39:09.024206 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.024287 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ================================================================================ {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 00:39:09.024381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.024505 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] admin_token = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.024616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.024749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] config_dir = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.024853 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.024980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.025082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.025157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] config_source = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.025275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] debug = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.025348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.025469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.025568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.025687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.025766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.025883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.025967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.026066 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.026177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.026308 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.026443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.026519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.026697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] log_config_append = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.026892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.027019 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.027096 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] log_dir = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.027216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] publish_errors = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.027291 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] log_file = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.027410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.027484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.027595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.027674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.027753 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.027901 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.027980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.028128 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.028212 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.028306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.028389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] standard_threads = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.028480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.028556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.028718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.028794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.028948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.029084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.029234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] use_journal = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.029360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.029484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] use_json = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.029621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.029739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] use_stderr = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.029739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] use_syslog = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.029979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.030128 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.030253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.030387 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.030512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.030634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.030774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.030906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.031026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.031158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.031158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.031397 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.031523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.031694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] publish_errors = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.031694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.031935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.032065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.032314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.032928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.033062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.033198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.033322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.033452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.033598 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.033724 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] standard_threads = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.033853 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.033983 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.034112 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.034237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.034367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.034491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.034626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.034772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] use_journal = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.034772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] use_json = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.035064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.035186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] use_stderr = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.035306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.035438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] use_syslog = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.035564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.035686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:39:09.035816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.035939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.036057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.036197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.036319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.036442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.036561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.036694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.036817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.036950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.037075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.037197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.037321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.037440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.037562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.037694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.037825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.037948 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.038078 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.038207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.038331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.038540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.038667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.038842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.038920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.038996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.039074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.039146 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.039220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.039293 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.039368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.039438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.039514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.039586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.039654 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.039723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.039791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.039859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.039934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040154 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040293 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.040936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041072 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041361 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041578 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041901 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.041978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.042126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.042278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.042352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.042422 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.042572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.042649 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.042823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.042916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.043054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.043161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.043283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.043389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.043490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.043592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.043733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.043833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.043961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.044069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.044187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.044308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.044403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.044495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.044632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.044739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.044866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.044976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.045091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.045203 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.045326 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.045435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.045539 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.045641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.045748 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.045842 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.045976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.046085 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.046219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.046331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.046446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.046547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.046675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.046807 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.046918 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.047014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.047146 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.047256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.047377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.047485 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.047606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.047712 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.047873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.047972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.048087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.048195 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.048318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.048425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.048550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.048951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.048951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.049136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.049259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.049357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.049469 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.049609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.049689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.049813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.049888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.049964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.050046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.050124 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.050240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.050315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.050428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.050509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.050630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.050706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.050834 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.051014 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.051090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.051244 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.051452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.051531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.051686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.051882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.051958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.052120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.052300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.052379 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.052560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.052738 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.052815 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.052993 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.053087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.053221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.053321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.053461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.053692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.053767 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.053939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.054180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.054258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.054414 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.054640 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.054792 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.external = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.054884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.055084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.055165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.055387 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.055530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.055607 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.password = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.055822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.055907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.token = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.056052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.056131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.056283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.056364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.056523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.056616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.056732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.056807 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.056975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.057124 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.057201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.057425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.057551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.057653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.057890 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.057966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.058130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.058369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.058456 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.058606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.058685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.058864 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.058944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.059093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.059181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.059330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.059410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.059580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.059658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.059809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.059887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.060052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.060137 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.060281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.060359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.060522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.060600 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.060758 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.060838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.061004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.061081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.061238 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.061317 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.061468 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.061554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.061698 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.061777 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.061936 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.062013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.062174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.062259 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.external = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.062397 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.062474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.062632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.062708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.062883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.063129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.063215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.password = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.063358 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.063468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.token = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.063620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.063701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.063855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.063932 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.064092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.064168 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.064318 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.064397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.064555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.064631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.064793 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.064870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.065020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.065106 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.065249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.065327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.065486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.065572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.065710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.065788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.065939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.066018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.066178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.066264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.066419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.066496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.066642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.066719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.066897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.066987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.067120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.067199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.067355 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.067433 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.067593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.067678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.067830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.067908 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.068076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.068159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.068314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.068467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.068575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.068736 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.068830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.068900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.069028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.069165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.069251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.069327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.069477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.069558 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.069701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.069791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.069930 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.070019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.070164 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.070251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.070394 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.070481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.070636 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.070812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.070937 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.071059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.071181 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.071328 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.071456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.071582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.071707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.071832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.071962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.072097 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.072224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.072349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.072474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.072599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.072724 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.072857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.072989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.073125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.073252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.073377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.073502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.073636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.073763 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.073888 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.074012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.074137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.074137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.074378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.074505 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.074631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.074782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.074905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.075030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.075165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.075291 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.075418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.075542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.075669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.075793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.075927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.076056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.076182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.076307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.076438 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.076585 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.076713 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.076839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.077209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.077332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.077454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.077589 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.077715 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.077840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.077966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.078091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.078216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.078350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.078486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.078612 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.078770 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.078906 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.079578 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.079712 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.079841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.079967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.080087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.080213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.080338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.080471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.080599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.080725 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.080860 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.080985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.081110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.081243 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.081369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.081494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.081621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.081747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.081871 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.082004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.082130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.082255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.082380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.082504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.082639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.082794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.082918 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.083043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.083174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.083300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.083431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.083564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.083692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.083818 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.083943 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.084068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.084193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.084336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.084462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.084586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.084731 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.084810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.084929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085088 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085654 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085725 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.085946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.086017 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.086087 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.086156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.086226 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.086304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.086377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.086446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.086520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.086590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.086666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.086787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.086863 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.086934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087447 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] role.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] role.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087885 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.087955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.088026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.088104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.088202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.088281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.088445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.088529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.088680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.088759 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.088913 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.088991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.089146 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.089223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.089378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.089457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.089619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.089696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.089861 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.089937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.090093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.090171 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.090335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.090411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.090562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.090638 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.090827 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.090910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.091061 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.091227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.091305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.091462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.091548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.091709 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.091787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.091955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.092032 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.092182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.092267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.092415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.092493 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.092645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.092721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.092887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.092973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.093132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.093210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.093364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.093440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.093590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.093676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.093817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.093896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.094042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.094120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.094281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.094366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.094514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.094593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.095348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.095433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.095578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] role.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.095674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.095824 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] role.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.095903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.096048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.096125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.096282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] token.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.096369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.096514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.096593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.096754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.096831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.096984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.097070 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.097229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.097308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.097467 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.097543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.097699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.097779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.097937 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.098015 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.098166 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.098243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.098407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.098486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.098638 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.098716 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.098894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.098973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.099124 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.099204 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.099364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.099521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.099634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.099753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.099859 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.099997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.100089 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.100245 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.100350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.100491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.100605 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.100736 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.100860 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.100964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.101071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.101213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.101290 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.101458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.101554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.101692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.101770 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.101919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.101996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.102146 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.102226 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.102374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.102451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.102609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.102685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.102862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.102945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.103101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.103179 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.103332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.103409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.103563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.103642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.103791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.103867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.104020 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] token.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.104096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.104242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.104321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.104476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.104554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.104705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.104783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.104862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 00:39:09.104956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.105199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.105431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.105669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.105909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.106151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.106382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.106616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.106869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.107112 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.107397 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.107624 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.107863 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.108125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.108379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.connection = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.108618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.108861 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.109095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.109330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.109562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.109794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.110026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.110263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.110527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.110780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.111024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.111503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.111736 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.111977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.112205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.112441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.112672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:39:09.112838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 00:39:09.133646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.133874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.134097 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.137500 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.137732 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.137956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.142826 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.146658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.170622 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.170870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.172593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.172842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.223835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.224138 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.271301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.271533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.272014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.272248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.425677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.425908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.426088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.426176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.426320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.426408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.426526 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.426609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.426756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.426856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.426971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.427182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.450004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.450236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.450455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.450565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.450674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.450789 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.450914 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.450999 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.451122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.451209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.451329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.451413 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.451578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.451791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.463237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.463503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.475798 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.475978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.476161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.476261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.476396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.476479 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.476601 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.476681 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.476807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.476890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.477013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.477095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.477228 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.477444 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:39:09.493497 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.493703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 00:39:09.493906 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.494038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.494123 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 00:39:09.494236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 00:39:09.494435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.494526 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.494631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 00:39:09.494767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.494924 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.495010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.495183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.495266 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.495441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.495697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.505377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.505651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.505874 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.505957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.506152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.506248 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.506419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.506699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.513191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.513747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.516138 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.516416 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.517229 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.517316 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.517514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.517598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.517791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.517874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.518044 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.518127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.518307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.518400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.518572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.518656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.518857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.518942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.519126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.519209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.519386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.519466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.519653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.519919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.542380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.543007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.543900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.544182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.544513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.544798 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.548990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.549268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.549542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.549624 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.549899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.550178 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.556039 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.556322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.556740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.557025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.561903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.562192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.562475 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.562690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.562796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.563002 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.563087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.563285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.563369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.564075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.564179 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.564340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.564425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.564610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.564877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.565143 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.580708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.580976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.581596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.581871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.584826 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.585753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.588058 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.588349 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.588977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.589273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.592552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.593494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.596237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.597201 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.599486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.599782 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.600061 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.600339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.600474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.600613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.600774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.600898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.601056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.601339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.601617 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.601904 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.617483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.617766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.618030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.618285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.618527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.618842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.619108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.619367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.625198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.626313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.626802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.627889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.628339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.628609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.629433 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.629706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.631362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.631642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.631920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.632200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.632495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.632590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.632778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.633058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.633351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.633740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.643998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.644277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.644568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.644825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.645116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.645213 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.645400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.645484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.645678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.645761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.645957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.646333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.646620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.646926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.661869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.663191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.664839 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.666149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.667965 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.669109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.669463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.670620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.670955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.671233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.671615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.672145 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.672426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.672825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.678581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.679841 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.680077 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.681304 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.683000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.683389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.683669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.683947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.684248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.684638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.684921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.685198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.691881 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.692166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.692442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.693166 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.693449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.693724 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.699376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.699657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.699943 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.700216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.700483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.700740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:39:09.700823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.701005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.701089 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.701275 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.701359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.701546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.701635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.701817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.701913 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.702339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.702441 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.702610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.702692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.702914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.702997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.703185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.703314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.703464 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.703753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.704018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.704801 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.705149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:39:09.738372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5628ce5199c0 pid: 81702 (default app) Sep 11 00:39:09.739979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5628ce5199c0 pid: 81701 (default app) Sep 11 00:39:09.741647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb8f0c-3eeb-41ad-943e-2e122a62cea7 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:09.741929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb8f0c-3eeb-41ad-943e-2e122a62cea7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:09.742196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb8f0c-3eeb-41ad-943e-2e122a62cea7 None None] PATH_INFO: `/v3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:09.746302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Sun Sep 11 00:39:09 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:16.499592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef2020-8ef2-4351-b60f-004af71f26ba None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:16.500073 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef2020-8ef2-4351-b60f-004af71f26ba None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:16.500178 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef2020-8ef2-4351-b60f-004af71f26ba None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:16.504907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:39:16.510217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e1095-11d3-43b4-93b5-d4163cf19474 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:16.510704 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e1095-11d3-43b4-93b5-d4163cf19474 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:16.510883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e1095-11d3-43b4-93b5-d4163cf19474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:16.581594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: INFO dbcounter [None req-e98e1095-11d3-43b4-93b5-d4163cf19474 None None] Registered counter for database keystone Sep 11 00:39:16.600286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG oslo_db.sqlalchemy.engines [None req-e98e1095-11d3-43b4-93b5-d4163cf19474 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81702) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:39:16.606396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writer thread running {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:39:16.784484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG passlib.handlers.bcrypt [None req-e98e1095-11d3-43b4-93b5-d4163cf19474 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81702) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 00:39:16.784874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG passlib.handlers.bcrypt [None req-e98e1095-11d3-43b4-93b5-d4163cf19474 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81702) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 00:39:16.842680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e98e1095-11d3-43b4-93b5-d4163cf19474 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:16.844311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e98e1095-11d3-43b4-93b5-d4163cf19474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:16.970873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 11 00:39:17.420997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef2020-8ef2-4351-b60f-004af71f26ba None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:17.490190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: INFO dbcounter [None req-45ef2020-8ef2-4351-b60f-004af71f26ba None None] Registered counter for database keystone Sep 11 00:39:17.511082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG oslo_db.sqlalchemy.engines [None req-45ef2020-8ef2-4351-b60f-004af71f26ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81701) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:39:17.517290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writer thread running {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:39:17.637278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef2020-8ef2-4351-b60f-004af71f26ba None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:17.641511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f054449-6822-4cca-802c-680213fcca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:17.642129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f054449-6822-4cca-802c-680213fcca24 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:17.642410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f054449-6822-4cca-802c-680213fcca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:17.642705 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f054449-6822-4cca-802c-680213fcca24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:17.650752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f054449-6822-4cca-802c-680213fcca24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:17.703201 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2f054449-6822-4cca-802c-680213fcca24 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 00:39:17.703750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f054449-6822-4cca-802c-680213fcca24 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:17.714235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Sun Sep 11 00:39:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 00:39:17.720147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e1095-11d3-43b4-93b5-d4163cf19474 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:17.736738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e1095-11d3-43b4-93b5-d4163cf19474 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:17.741135 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a2594-5e6a-4de7-aee3-4ae797353795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:17.742237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a2594-5e6a-4de7-aee3-4ae797353795 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:17.742517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a2594-5e6a-4de7-aee3-4ae797353795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:17.742824 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a2594-5e6a-4de7-aee3-4ae797353795 admin admin] PATH_INFO: `/v3/projects/a604dda8f82546e29f08510ef905d15b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:17.744409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a2594-5e6a-4de7-aee3-4ae797353795 admin admin] RBAC: Authorizing `identity:get_project(project_id=a604dda8f82546e29f08510ef905d15b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:17.796968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f44a2594-5e6a-4de7-aee3-4ae797353795 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 00:39:17.797306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a2594-5e6a-4de7-aee3-4ae797353795 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:17.802212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Sun Sep 11 00:39:17 2022] GET /identity/v3/projects/a604dda8f82546e29f08510ef905d15b => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:19.941834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cecac-3658-4734-adf0-85fe4619de40 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:19.942369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cecac-3658-4734-adf0-85fe4619de40 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:19.942369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cecac-3658-4734-adf0-85fe4619de40 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:19.946418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:39:19.952020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44a4e-106b-487f-a469-93e0b2f4e74e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:19.952397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44a4e-106b-487f-a469-93e0b2f4e74e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:19.952558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44a4e-106b-487f-a469-93e0b2f4e74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:19.972968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f9a44a4e-106b-487f-a469-93e0b2f4e74e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:19.974476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f9a44a4e-106b-487f-a469-93e0b2f4e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:19.982289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 11 00:39:20.247057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cecac-3658-4734-adf0-85fe4619de40 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:20.258997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cecac-3658-4734-adf0-85fe4619de40 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:20.263371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b0f5d-6898-49ef-8eb0-1dd8117b337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:20.263970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b0f5d-6898-49ef-8eb0-1dd8117b337d admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:20.264244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b0f5d-6898-49ef-8eb0-1dd8117b337d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:20.264511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b0f5d-6898-49ef-8eb0-1dd8117b337d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:20.272664 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b0f5d-6898-49ef-8eb0-1dd8117b337d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:20.274422 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b0f5d-6898-49ef-8eb0-1dd8117b337d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:20.282870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Sun Sep 11 00:39:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 00:39:20.288745 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a44a4e-106b-487f-a469-93e0b2f4e74e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:20.297621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a44a4e-106b-487f-a469-93e0b2f4e74e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:20.301955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329ccd4-f290-41a5-bf6d-1f8344814db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:20.302569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329ccd4-f290-41a5-bf6d-1f8344814db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:20.302885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329ccd4-f290-41a5-bf6d-1f8344814db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:20.303156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329ccd4-f290-41a5-bf6d-1f8344814db2 admin admin] PATH_INFO: `/v3/users/c252561ac77c437ba347f9d9a260e990` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:20.304465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329ccd4-f290-41a5-bf6d-1f8344814db2 admin admin] RBAC: Authorizing `identity:get_user(user_id=c252561ac77c437ba347f9d9a260e990)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:20.306264 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329ccd4-f290-41a5-bf6d-1f8344814db2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:20.307789 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Sun Sep 11 00:39:20 2022] GET /identity/v3/users/c252561ac77c437ba347f9d9a260e990 => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:22.502562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24b0db-6d68-418f-94ca-d8f9ea8a3a30 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:22.503147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24b0db-6d68-418f-94ca-d8f9ea8a3a30 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:22.503283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24b0db-6d68-418f-94ca-d8f9ea8a3a30 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:22.504517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:22.509600 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e87bd-69a2-4b84-9160-f81586af7a9f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:22.510021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e87bd-69a2-4b84-9160-f81586af7a9f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:22.510241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e87bd-69a2-4b84-9160-f81586af7a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:22.528388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-927e87bd-69a2-4b84-9160-f81586af7a9f None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:22.529548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-927e87bd-69a2-4b84-9160-f81586af7a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:22.566076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83177beb-dae4-4e87-8a8e-95433aa7a803 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:22.566353 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83177beb-dae4-4e87-8a8e-95433aa7a803 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:22.566631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83177beb-dae4-4e87-8a8e-95433aa7a803 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:22.567980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:39:22.573026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a40d18-a6b3-4f16-b84d-cbd8dfbcf3a4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:22.573305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a40d18-a6b3-4f16-b84d-cbd8dfbcf3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:22.573571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a40d18-a6b3-4f16-b84d-cbd8dfbcf3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:22.611824 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:22.615627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG passlib.handlers.bcrypt [None req-77a40d18-a6b3-4f16-b84d-cbd8dfbcf3a4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81701) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 00:39:22.616013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG passlib.handlers.bcrypt [None req-77a40d18-a6b3-4f16-b84d-cbd8dfbcf3a4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81701) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 00:39:22.665250 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-77a40d18-a6b3-4f16-b84d-cbd8dfbcf3a4 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:22.666847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-77a40d18-a6b3-4f16-b84d-cbd8dfbcf3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:22.763934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:39:22.877164 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e87bd-69a2-4b84-9160-f81586af7a9f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:22.901603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:22.984417 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e87bd-69a2-4b84-9160-f81586af7a9f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:23.017003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0fc1a-e0eb-4747-b296-5965140fe55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:23.017569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0fc1a-e0eb-4747-b296-5965140fe55e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:23.017847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0fc1a-e0eb-4747-b296-5965140fe55e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:23.018116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0fc1a-e0eb-4747-b296-5965140fe55e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:23.029545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0fc1a-e0eb-4747-b296-5965140fe55e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:23.033142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a40d18-a6b3-4f16-b84d-cbd8dfbcf3a4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b2f0fc1a-e0eb-4747-b296-5965140fe55e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:23.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:23.040188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:23.041075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:23.041075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:23.041075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:23.041075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:23.041075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:23.041075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:23.041075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:23.041075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:23.041075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:23.041075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:23.041075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:23.041075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:23.041075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:39:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:23.045942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0fc1a-e0eb-4747-b296-5965140fe55e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:23.135458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:23.137481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a40d18-a6b3-4f16-b84d-cbd8dfbcf3a4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:23.139835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:23.155920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0fc1a-e0eb-4747-b296-5965140fe55e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:23.175187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11bf16-1d58-4894-903f-96781dc9b4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:23.176055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11bf16-1d58-4894-903f-96781dc9b4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:23.176333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11bf16-1d58-4894-903f-96781dc9b4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:23.176602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11bf16-1d58-4894-903f-96781dc9b4c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:23.189089 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83468680-61e1-4e04-878b-de47c32e948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:23.189695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83468680-61e1-4e04-878b-de47c32e948f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:23.189966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83468680-61e1-4e04-878b-de47c32e948f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:23.190245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83468680-61e1-4e04-878b-de47c32e948f None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:23.191485 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83468680-61e1-4e04-878b-de47c32e948f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:23.191784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83468680-61e1-4e04-878b-de47c32e948f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:23.193162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83468680-61e1-4e04-878b-de47c32e948f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:23.204983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:23.211221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83468680-61e1-4e04-878b-de47c32e948f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:23.243878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11bf16-1d58-4894-903f-96781dc9b4c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:23.245376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11bf16-1d58-4894-903f-96781dc9b4c8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:23.308334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83468680-61e1-4e04-878b-de47c32e948f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:23.341679 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7ed07-4b28-4063-9446-c7a9789d81fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:23.342299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7ed07-4b28-4063-9446-c7a9789d81fc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:23.342401 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:39:23.342592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7ed07-4b28-4063-9446-c7a9789d81fc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:23.342896 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7ed07-4b28-4063-9446-c7a9789d81fc None admin] PATH_INFO: `/v3/users/c252561ac77c437ba347f9d9a260e990` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:23.344049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7ed07-4b28-4063-9446-c7a9789d81fc None admin] RBAC: Authorizing `identity:get_user(user_id=c252561ac77c437ba347f9d9a260e990)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:23.345509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7ed07-4b28-4063-9446-c7a9789d81fc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:23.347423 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:23 2022] GET /identity/v3/users/c252561ac77c437ba347f9d9a260e990 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:23.348121 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11bf16-1d58-4894-903f-96781dc9b4c8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:23.351521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:23.352833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7ed07-4b28-4063-9446-c7a9789d81fc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:23.367427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:23.448792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11bf16-1d58-4894-903f-96781dc9b4c8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:23.453818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7ed07-4b28-4063-9446-c7a9789d81fc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:23.482509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b5f1b-2ead-48e6-b2c5-c9d8386cce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:23.483398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5f1b-2ead-48e6-b2c5-c9d8386cce69 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:23.483680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5f1b-2ead-48e6-b2c5-c9d8386cce69 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:23.483948 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5f1b-2ead-48e6-b2c5-c9d8386cce69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:23.489225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5990878-4f97-4e6f-acb8-30fdb6276b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:23.489843 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5990878-4f97-4e6f-acb8-30fdb6276b12 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:23.490116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5990878-4f97-4e6f-acb8-30fdb6276b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:23.490381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5990878-4f97-4e6f-acb8-30fdb6276b12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:23.491503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5990878-4f97-4e6f-acb8-30fdb6276b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:23.492939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5990878-4f97-4e6f-acb8-30fdb6276b12 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:23.494644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 10/18] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:39:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:23.500290 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5990878-4f97-4e6f-acb8-30fdb6276b12 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:23.503917 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b5f1b-2ead-48e6-b2c5-c9d8386cce69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:23.505374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b5f1b-2ead-48e6-b2c5-c9d8386cce69 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-268b5f1b-2ead-48e6-b2c5-c9d8386cce69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:39:23.523473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:23.524348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:39:23.525202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:39:23.525202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:39:23.525202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:39:23.525202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 9/19] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:39:23.530235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b5f1b-2ead-48e6-b2c5-c9d8386cce69 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:23.580039 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:23.588753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:23.600174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5990878-4f97-4e6f-acb8-30fdb6276b12 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:23.634740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97a5cf-651a-4a23-aea5-a2fec2fc9f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:23.635371 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97a5cf-651a-4a23-aea5-a2fec2fc9f2b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:23.635650 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97a5cf-651a-4a23-aea5-a2fec2fc9f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:23.635923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97a5cf-651a-4a23-aea5-a2fec2fc9f2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:23.637605 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97a5cf-651a-4a23-aea5-a2fec2fc9f2b None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.domain.id=default, user.id=c252561ac77c437ba347f9d9a260e990) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:23.637605 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97a5cf-651a-4a23-aea5-a2fec2fc9f2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:23.638381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97a5cf-651a-4a23-aea5-a2fec2fc9f2b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:23.641050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b5f1b-2ead-48e6-b2c5-c9d8386cce69 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:23.645206 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 11/20] 10.222.0.33 () {56 vars in 1322 bytes} [Sun Sep 11 00:39:23 2022] GET /identity/v3/role_assignments?user.id=c252561ac77c437ba347f9d9a260e990&scope.domain.id=default&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:23.676905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a745ead-3357-4571-b63a-9251deab804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:23.677529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a745ead-3357-4571-b63a-9251deab804f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:23.677808 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a745ead-3357-4571-b63a-9251deab804f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:23.678078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a745ead-3357-4571-b63a-9251deab804f None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:23.678779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a745ead-3357-4571-b63a-9251deab804f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:23.679070 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a745ead-3357-4571-b63a-9251deab804f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:23.680489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a745ead-3357-4571-b63a-9251deab804f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:23.700266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 10/21] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:25.928138 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bc57e-e38a-4453-ac12-d994c4225968 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:25.928670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bc57e-e38a-4453-ac12-d994c4225968 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:25.928670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bc57e-e38a-4453-ac12-d994c4225968 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:25.930012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 12/22] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:25.935530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40adf0-0808-4bd0-a1b1-1f6bef2b202e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:25.935949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40adf0-0808-4bd0-a1b1-1f6bef2b202e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:25.936144 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40adf0-0808-4bd0-a1b1-1f6bef2b202e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:25.960702 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5b40adf0-0808-4bd0-a1b1-1f6bef2b202e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:25.961941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5b40adf0-0808-4bd0-a1b1-1f6bef2b202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:26.064399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 11/23] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:39:26.582680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c046f5-dba8-46d5-80bc-96b3baf4ca21 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:26.583015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c046f5-dba8-46d5-80bc-96b3baf4ca21 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:26.583265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c046f5-dba8-46d5-80bc-96b3baf4ca21 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:26.584623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:26.592223 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd18af-828c-4147-8e71-de372c33a652 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:26.592511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd18af-828c-4147-8e71-de372c33a652 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:26.592790 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd18af-828c-4147-8e71-de372c33a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:26.616431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-febd18af-828c-4147-8e71-de372c33a652 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:26.617613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-febd18af-828c-4147-8e71-de372c33a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:26.635912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c046f5-dba8-46d5-80bc-96b3baf4ca21 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:26.699302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:26.776382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 12/25] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:26.802179 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a05704-e508-414e-9d16-d9e141da1d2a None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:26.802834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a05704-e508-414e-9d16-d9e141da1d2a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:26.803299 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a05704-e508-414e-9d16-d9e141da1d2a None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:26.804859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 13/26] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:26.811071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989033a-4445-45e5-af1a-a5de57375221 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:26.811640 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989033a-4445-45e5-af1a-a5de57375221 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:26.812127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989033a-4445-45e5-af1a-a5de57375221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:26.852245 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0989033a-4445-45e5-af1a-a5de57375221 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:26.858950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0989033a-4445-45e5-af1a-a5de57375221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:26.860770 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c046f5-dba8-46d5-80bc-96b3baf4ca21 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:26.947868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2d496-8907-4ebf-953e-744ed4092186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:26.950301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2d496-8907-4ebf-953e-744ed4092186 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:26.955872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2d496-8907-4ebf-953e-744ed4092186 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:26.955872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2d496-8907-4ebf-953e-744ed4092186 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:26.974649 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2d496-8907-4ebf-953e-744ed4092186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-efe2d496-8907-4ebf-953e-744ed4092186 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:26.983397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:26.984220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:26.984963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:26.984963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:26.984963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:26.984963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:26.984963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:26.984963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:26.984963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:26.984963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:26.984963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:26.984963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:26.984963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:26.984963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:26.986100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 14/27] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:39:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:39:26.996031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e078c84-ae32-4fd0-b335-56364c02517d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:26.996305 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e078c84-ae32-4fd0-b335-56364c02517d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:26.996576 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e078c84-ae32-4fd0-b335-56364c02517d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:26.997872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 15/28] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:26.998563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e078c84-ae32-4fd0-b335-56364c02517d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:27.008597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:27.023162 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 14/29] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:39:27.024407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066a0c3-199b-4eac-8c6d-f358ffaf06d5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:27.024691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066a0c3-199b-4eac-8c6d-f358ffaf06d5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:27.024963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066a0c3-199b-4eac-8c6d-f358ffaf06d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:27.069510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8066a0c3-199b-4eac-8c6d-f358ffaf06d5 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:27.070699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8066a0c3-199b-4eac-8c6d-f358ffaf06d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:27.205505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e078c84-ae32-4fd0-b335-56364c02517d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:27.207436 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 15/30] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:27.235551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066a0c3-199b-4eac-8c6d-f358ffaf06d5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:27.261603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd5319-f832-49cb-897d-1f2d94253e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:27.262490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd5319-f832-49cb-897d-1f2d94253e2d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:27.262912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd5319-f832-49cb-897d-1f2d94253e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:27.263272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd5319-f832-49cb-897d-1f2d94253e2d None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:27.264038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd5319-f832-49cb-897d-1f2d94253e2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:27.264466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd5319-f832-49cb-897d-1f2d94253e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:27.266427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd5319-f832-49cb-897d-1f2d94253e2d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:27.283291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 16/31] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:27.288310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd5319-f832-49cb-897d-1f2d94253e2d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:27.319135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:27.427797 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:27.466245 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066a0c3-199b-4eac-8c6d-f358ffaf06d5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:27.480606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd5319-f832-49cb-897d-1f2d94253e2d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:27.528675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ca8c0-756b-43d5-9aa9-2d429621600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:27.529523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ca8c0-756b-43d5-9aa9-2d429621600c None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:27.529717 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ca8c0-756b-43d5-9aa9-2d429621600c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:27.529958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ca8c0-756b-43d5-9aa9-2d429621600c None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:27.530651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ca8c0-756b-43d5-9aa9-2d429621600c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:27.532108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ca8c0-756b-43d5-9aa9-2d429621600c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:27.536210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c29775-e9c2-4782-997a-67c56fccb023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:27.537145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c29775-e9c2-4782-997a-67c56fccb023 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:27.537610 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c29775-e9c2-4782-997a-67c56fccb023 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:27.538063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c29775-e9c2-4782-997a-67c56fccb023 None admin] PATH_INFO: `/v3/users/c252561ac77c437ba347f9d9a260e990` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:27.539457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c29775-e9c2-4782-997a-67c56fccb023 None admin] RBAC: Authorizing `identity:get_user(user_id=c252561ac77c437ba347f9d9a260e990)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:27.541196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c29775-e9c2-4782-997a-67c56fccb023 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:27.543598 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 17/32] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:27 2022] GET /identity/v3/users/c252561ac77c437ba347f9d9a260e990 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:27.544525 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c29775-e9c2-4782-997a-67c56fccb023 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:27.654066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c29775-e9c2-4782-997a-67c56fccb023 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:27.686757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 16/33] 10.222.0.33 () {60 vars in 1131 bytes} [Sun Sep 11 00:39:27 2022] POST /identity/v3/roles => generated 219 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:39:27.686757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ca8c0-756b-43d5-9aa9-2d429621600c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:27.707866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0881161-0a45-4f49-a2e2-341bb0a1f4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:27.709220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0881161-0a45-4f49-a2e2-341bb0a1f4c7 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:27.709499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0881161-0a45-4f49-a2e2-341bb0a1f4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:27.710162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0881161-0a45-4f49-a2e2-341bb0a1f4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:27.710897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0881161-0a45-4f49-a2e2-341bb0a1f4c7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:27.713037 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0881161-0a45-4f49-a2e2-341bb0a1f4c7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:27.718521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:27.798592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:27.807524 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ca8c0-756b-43d5-9aa9-2d429621600c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:27.852531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52360822-2599-430a-b819-13c37e939a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:27.853211 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52360822-2599-430a-b819-13c37e939a22 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:27.853496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52360822-2599-430a-b819-13c37e939a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:27.853775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52360822-2599-430a-b819-13c37e939a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:27.867553 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52360822-2599-430a-b819-13c37e939a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:27.869363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52360822-2599-430a-b819-13c37e939a22 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:27.876888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 18/34] 10.222.0.33 () {60 vars in 1131 bytes} [Sun Sep 11 00:39:27 2022] POST /identity/v3/roles => generated 225 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:39:27.877746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0881161-0a45-4f49-a2e2-341bb0a1f4c7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-52360822-2599-430a-b819-13c37e939a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:39:27.891851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:27.892778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:39:27.893563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:39:27.893563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:39:27.893563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:39:27.896176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 17/35] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:27.897935 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c05ea2-bb4e-43ad-bee1-08cd53a3b072 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:27.898491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c05ea2-bb4e-43ad-bee1-08cd53a3b072 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:27.899026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c05ea2-bb4e-43ad-bee1-08cd53a3b072 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:27.900600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:27.906811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c05ea2-bb4e-43ad-bee1-08cd53a3b072 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:28.047496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0881161-0a45-4f49-a2e2-341bb0a1f4c7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:28.051488 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c05ea2-bb4e-43ad-bee1-08cd53a3b072 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:28.088069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a95b3-0f1d-4118-bdd5-0e7884153da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:28.089005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a95b3-0f1d-4118-bdd5-0e7884153da2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:28.089281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a95b3-0f1d-4118-bdd5-0e7884153da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:28.089545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a95b3-0f1d-4118-bdd5-0e7884153da2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:28.091432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a95b3-0f1d-4118-bdd5-0e7884153da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:28.093037 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a95b3-0f1d-4118-bdd5-0e7884153da2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:28.094685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 19/37] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:39:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:28.095928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f10df-e8bf-4fec-bc7e-406b7af0aa33 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:28.096208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f10df-e8bf-4fec-bc7e-406b7af0aa33 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:28.096479 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f10df-e8bf-4fec-bc7e-406b7af0aa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:28.100427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082045e0-71f4-48ba-a9e4-4c186afdd1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:28.101061 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082045e0-71f4-48ba-a9e4-4c186afdd1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:28.101345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082045e0-71f4-48ba-a9e4-4c186afdd1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:28.101732 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082045e0-71f4-48ba-a9e4-4c186afdd1a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:28.102349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082045e0-71f4-48ba-a9e4-4c186afdd1a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:28.102719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082045e0-71f4-48ba-a9e4-4c186afdd1a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:28.104210 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082045e0-71f4-48ba-a9e4-4c186afdd1a7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:28.116165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bd9f10df-e8bf-4fec-bc7e-406b7af0aa33 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:28.117756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bd9f10df-e8bf-4fec-bc7e-406b7af0aa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:28.123030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:28.123030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad2fb0-cf83-4e61-acd6-51ad647e6dc3 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:28.123030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad2fb0-cf83-4e61-acd6-51ad647e6dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:28.123030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad2fb0-cf83-4e61-acd6-51ad647e6dc3 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:28.123030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 20/39] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:28.123030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad2fb0-cf83-4e61-acd6-51ad647e6dc3 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:28.138319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:28.183809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:28.194880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 20/40] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:28.195676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f10df-e8bf-4fec-bc7e-406b7af0aa33 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:28.234810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad2fb0-cf83-4e61-acd6-51ad647e6dc3 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:28.271729 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3464716-0d1e-44d2-b756-018fd5dcf406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:28.272870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3464716-0d1e-44d2-b756-018fd5dcf406 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:28.273159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3464716-0d1e-44d2-b756-018fd5dcf406 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:28.273443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3464716-0d1e-44d2-b756-018fd5dcf406 None admin] PATH_INFO: `/v3/domains/default/users/c252561ac77c437ba347f9d9a260e990/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:28.276033 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3464716-0d1e-44d2-b756-018fd5dcf406 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c252561ac77c437ba347f9d9a260e990, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:28.277482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3464716-0d1e-44d2-b756-018fd5dcf406 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:28.295960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 21/41] 10.222.0.33 () {58 vars in 1361 bytes} [Sun Sep 11 00:39:28 2022] PUT /identity/v3/domains/default/users/c252561ac77c437ba347f9d9a260e990/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:39:28.297406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073b760-30d1-4d37-95ef-6e0be10955bc None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:28.297889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073b760-30d1-4d37-95ef-6e0be10955bc None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:28.298285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073b760-30d1-4d37-95ef-6e0be10955bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:28.319901 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8073b760-30d1-4d37-95ef-6e0be10955bc None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:28.322322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8073b760-30d1-4d37-95ef-6e0be10955bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:28.323817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f10df-e8bf-4fec-bc7e-406b7af0aa33 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:28.376257 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d7195-7eb1-47f2-97dc-96d7f23e18a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:28.377217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d7195-7eb1-47f2-97dc-96d7f23e18a0 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:28.378325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d7195-7eb1-47f2-97dc-96d7f23e18a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:28.379671 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d7195-7eb1-47f2-97dc-96d7f23e18a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:28.380683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d7195-7eb1-47f2-97dc-96d7f23e18a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:28.383454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d7195-7eb1-47f2-97dc-96d7f23e18a0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:28.410838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:28.427324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 22/42] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:28.430797 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 21/43] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:39:28 2022] POST /identity/v3/projects => generated 301 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:39:28.473418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073b760-30d1-4d37-95ef-6e0be10955bc None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:28.594210 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073b760-30d1-4d37-95ef-6e0be10955bc None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:28.631403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a680d23-cf8b-4477-a95b-47cd85461e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:28.632245 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a680d23-cf8b-4477-a95b-47cd85461e1e None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:28.632668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a680d23-cf8b-4477-a95b-47cd85461e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:28.633080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a680d23-cf8b-4477-a95b-47cd85461e1e None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:28.633907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a680d23-cf8b-4477-a95b-47cd85461e1e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:28.635461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a680d23-cf8b-4477-a95b-47cd85461e1e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:28.652070 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1131 bytes} [Sun Sep 11 00:39:28 2022] POST /identity/v3/roles => generated 223 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:39:28.702458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d7195-7eb1-47f2-97dc-96d7f23e18a0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:28.755898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:28.818605 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d7195-7eb1-47f2-97dc-96d7f23e18a0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:28.861984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87743db-9f9a-4826-8976-0e90d3185673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:28.862543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87743db-9f9a-4826-8976-0e90d3185673 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:28.862898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87743db-9f9a-4826-8976-0e90d3185673 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:28.863748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87743db-9f9a-4826-8976-0e90d3185673 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:28.864879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87743db-9f9a-4826-8976-0e90d3185673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:28.866333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87743db-9f9a-4826-8976-0e90d3185673 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:28.868096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 22/45] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:39:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:28.873439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a680d23-cf8b-4477-a95b-47cd85461e1e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:28.935456 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:28.976929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a680d23-cf8b-4477-a95b-47cd85461e1e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:29.008587 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470aee-6893-4a8e-9f1c-4020a9d3b5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:29.009182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470aee-6893-4a8e-9f1c-4020a9d3b5d6 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:29.009463 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470aee-6893-4a8e-9f1c-4020a9d3b5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:29.009733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470aee-6893-4a8e-9f1c-4020a9d3b5d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:29.010380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470aee-6893-4a8e-9f1c-4020a9d3b5d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:29.011847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470aee-6893-4a8e-9f1c-4020a9d3b5d6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:29.039738 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:39:28 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:39:30.517125 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f4822-539d-4894-8217-77ccf99cbc3a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:30.517647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f4822-539d-4894-8217-77ccf99cbc3a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:30.517647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f4822-539d-4894-8217-77ccf99cbc3a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:30.519087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 23/47] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:30.524350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88918f-c612-45ff-93fc-6697e8ad05f6 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:30.524738 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88918f-c612-45ff-93fc-6697e8ad05f6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:30.525019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88918f-c612-45ff-93fc-6697e8ad05f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:30.543451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0c88918f-c612-45ff-93fc-6697e8ad05f6 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:30.544618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0c88918f-c612-45ff-93fc-6697e8ad05f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:30.609304 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 25/48] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:30.874563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f4822-539d-4894-8217-77ccf99cbc3a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:31.098690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f4822-539d-4894-8217-77ccf99cbc3a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:31.112243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:31.133864 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae00ad-306a-4b8d-b887-76acf956c003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:31.134418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae00ad-306a-4b8d-b887-76acf956c003 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:31.134696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae00ad-306a-4b8d-b887-76acf956c003 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:31.134998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae00ad-306a-4b8d-b887-76acf956c003 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:31.145429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae00ad-306a-4b8d-b887-76acf956c003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-29ae00ad-306a-4b8d-b887-76acf956c003 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:31.150325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:31.151185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:31.151921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:31.151921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:31.151921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:31.151921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:31.151921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:31.151921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:31.151921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:31.151921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:31.151921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:31.151921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:31.151921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:31.151921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:31.151921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 24/49] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:39:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:31.158569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88918f-c612-45ff-93fc-6697e8ad05f6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:31.190336 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591082b4-2968-409f-902b-3cf5dcecc3cd None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:31.190624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591082b4-2968-409f-902b-3cf5dcecc3cd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:31.190932 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591082b4-2968-409f-902b-3cf5dcecc3cd None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:31.192802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 25/50] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:39:31.197686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89e92a-810a-4155-a3bb-719db4314f08 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:31.197964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89e92a-810a-4155-a3bb-719db4314f08 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:31.198234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89e92a-810a-4155-a3bb-719db4314f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:31.199421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:31.216654 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1f89e92a-810a-4155-a3bb-719db4314f08 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:31.217841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1f89e92a-810a-4155-a3bb-719db4314f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:31.259587 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88918f-c612-45ff-93fc-6697e8ad05f6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:31.283991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 26/51] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:39:31.293337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe174d-22c2-4349-81f7-0d93edcd90f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:31.293942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe174d-22c2-4349-81f7-0d93edcd90f1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:31.294221 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe174d-22c2-4349-81f7-0d93edcd90f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:31.294495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe174d-22c2-4349-81f7-0d93edcd90f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:31.295182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe174d-22c2-4349-81f7-0d93edcd90f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:31.295486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe174d-22c2-4349-81f7-0d93edcd90f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:31.296862 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe174d-22c2-4349-81f7-0d93edcd90f1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:31.308352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 26/52] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:31.313954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89e92a-810a-4155-a3bb-719db4314f08 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:31.409974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89e92a-810a-4155-a3bb-719db4314f08 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:31.411929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:31.446016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f7576-b8a3-4c4e-9d32-3b15670c20bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:31.446649 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f7576-b8a3-4c4e-9d32-3b15670c20bb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:31.446975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f7576-b8a3-4c4e-9d32-3b15670c20bb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:31.447250 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f7576-b8a3-4c4e-9d32-3b15670c20bb None admin] PATH_INFO: `/v3/users/c252561ac77c437ba347f9d9a260e990` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:31.448403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f7576-b8a3-4c4e-9d32-3b15670c20bb None admin] RBAC: Authorizing `identity:get_user(user_id=c252561ac77c437ba347f9d9a260e990)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:31.449856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f7576-b8a3-4c4e-9d32-3b15670c20bb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:31.451462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:31 2022] GET /identity/v3/users/c252561ac77c437ba347f9d9a260e990 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:31.457818 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe174d-22c2-4349-81f7-0d93edcd90f1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:31.556338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f7576-b8a3-4c4e-9d32-3b15670c20bb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:31.654810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f7576-b8a3-4c4e-9d32-3b15670c20bb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:31.660639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe174d-22c2-4349-81f7-0d93edcd90f1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:31.662079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:31.689654 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bb101-3928-425f-a050-9f51b11bb056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:31.690276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bb101-3928-425f-a050-9f51b11bb056 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:31.690556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bb101-3928-425f-a050-9f51b11bb056 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:31.690853 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bb101-3928-425f-a050-9f51b11bb056 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:31.692038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bb101-3928-425f-a050-9f51b11bb056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:31.693484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bb101-3928-425f-a050-9f51b11bb056 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:31.694220 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41f36c-ea93-4519-8b1d-e5133a874c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:31.694881 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41f36c-ea93-4519-8b1d-e5133a874c7b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:31.695056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 28/54] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:39:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:31.695449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41f36c-ea93-4519-8b1d-e5133a874c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:31.695724 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41f36c-ea93-4519-8b1d-e5133a874c7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:31.696822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41f36c-ea93-4519-8b1d-e5133a874c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:31.698246 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41f36c-ea93-4519-8b1d-e5133a874c7b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:31.700068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:39:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:31.700483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bb101-3928-425f-a050-9f51b11bb056 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:31.705283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41f36c-ea93-4519-8b1d-e5133a874c7b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:31.740704 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:31.799719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bb101-3928-425f-a050-9f51b11bb056 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:31.803699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41f36c-ea93-4519-8b1d-e5133a874c7b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:31.833783 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc380b-b4c0-47fb-bada-aefaac715093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:31.834385 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc380b-b4c0-47fb-bada-aefaac715093 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:31.834659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc380b-b4c0-47fb-bada-aefaac715093 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:31.834950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc380b-b4c0-47fb-bada-aefaac715093 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:31.835592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc380b-b4c0-47fb-bada-aefaac715093 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:31.837029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc380b-b4c0-47fb-bada-aefaac715093 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:31.839734 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec73d64-7ba3-487d-b450-1237fc42dbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:31.840342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec73d64-7ba3-487d-b450-1237fc42dbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:31.840624 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec73d64-7ba3-487d-b450-1237fc42dbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:31.840953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec73d64-7ba3-487d-b450-1237fc42dbd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:31.841688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec73d64-7ba3-487d-b450-1237fc42dbd9 None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.domain.id=default, user.id=c252561ac77c437ba347f9d9a260e990) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:31.841999 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec73d64-7ba3-487d-b450-1237fc42dbd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:31.843452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec73d64-7ba3-487d-b450-1237fc42dbd9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:31.852277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 28/56] 10.222.0.33 () {56 vars in 1322 bytes} [Sun Sep 11 00:39:31 2022] GET /identity/v3/role_assignments?user.id=c252561ac77c437ba347f9d9a260e990&scope.domain.id=default&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:31.863160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 29/57] 10.222.0.33 () {60 vars in 1140 bytes} [Sun Sep 11 00:39:31 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:39:34.034240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0d6b8-e73f-4cb8-a629-8b57102d3bee None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:34.034788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0d6b8-e73f-4cb8-a629-8b57102d3bee None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:34.034788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0d6b8-e73f-4cb8-a629-8b57102d3bee None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:34.036189 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 29/58] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:34.041612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76b45-421e-4a31-93d4-fd4da3acdfbb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:34.042039 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76b45-421e-4a31-93d4-fd4da3acdfbb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:34.042128 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76b45-421e-4a31-93d4-fd4da3acdfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:34.061049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-dee76b45-421e-4a31-93d4-fd4da3acdfbb None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:34.062225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dee76b45-421e-4a31-93d4-fd4da3acdfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:34.126592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 30/59] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:34.392775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0d6b8-e73f-4cb8-a629-8b57102d3bee None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:34.427980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:34.493632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0d6b8-e73f-4cb8-a629-8b57102d3bee None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:34.526362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf4e90-0c49-49bc-8e23-ef6ef9dfc14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:34.527010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4e90-0c49-49bc-8e23-ef6ef9dfc14d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:34.527294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4e90-0c49-49bc-8e23-ef6ef9dfc14d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:34.527568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4e90-0c49-49bc-8e23-ef6ef9dfc14d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:34.528676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf4e90-0c49-49bc-8e23-ef6ef9dfc14d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:34.530120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf4e90-0c49-49bc-8e23-ef6ef9dfc14d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:34.531704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 30/60] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:39:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:34.537867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee76b45-421e-4a31-93d4-fd4da3acdfbb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:34.558179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:34.638151 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee76b45-421e-4a31-93d4-fd4da3acdfbb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:34.671121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2693a6-34ac-472b-b843-128f44124964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:34.671664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2693a6-34ac-472b-b843-128f44124964 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:34.671944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2693a6-34ac-472b-b843-128f44124964 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:34.672218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2693a6-34ac-472b-b843-128f44124964 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:34.672905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2693a6-34ac-472b-b843-128f44124964 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:34.674356 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2693a6-34ac-472b-b843-128f44124964 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:34.700214 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 31/61] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:39:34 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:39:38.063441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db69b6f-03fc-4938-b5dc-9c5fa370f493 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:38.063441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db69b6f-03fc-4938-b5dc-9c5fa370f493 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:38.063441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db69b6f-03fc-4938-b5dc-9c5fa370f493 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:38.063441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 31/62] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:38.069373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545318e-a6be-472c-ad98-c1067017d03d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:38.070099 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545318e-a6be-472c-ad98-c1067017d03d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:38.070511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545318e-a6be-472c-ad98-c1067017d03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:38.095569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9545318e-a6be-472c-ad98-c1067017d03d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:38.097015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9545318e-a6be-472c-ad98-c1067017d03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:38.105020 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398f8d-5da1-4dcf-b14b-edbbcc6fac5e None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:38.105512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398f8d-5da1-4dcf-b14b-edbbcc6fac5e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:38.105962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398f8d-5da1-4dcf-b14b-edbbcc6fac5e None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:38.107435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 32/63] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:39:38.113024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebc160-010f-4c82-a0cf-38cb12c6d6e3 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:38.113489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebc160-010f-4c82-a0cf-38cb12c6d6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:38.113899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebc160-010f-4c82-a0cf-38cb12c6d6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:38.140625 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a4ebc160-010f-4c82-a0cf-38cb12c6d6e3 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:38.147277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a4ebc160-010f-4c82-a0cf-38cb12c6d6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:38.225480 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 32/64] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:38.296847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 33/65] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:39:38.307901 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18da7a-d2bd-470a-b716-5d7b6feb2236 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:38.308416 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18da7a-d2bd-470a-b716-5d7b6feb2236 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:38.308853 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18da7a-d2bd-470a-b716-5d7b6feb2236 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:38.310580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 33/66] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:38.315438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa4910-7f2a-4383-9047-82ec2517db69 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:38.315925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa4910-7f2a-4383-9047-82ec2517db69 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:38.316380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa4910-7f2a-4383-9047-82ec2517db69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:38.335716 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-16fa4910-7f2a-4383-9047-82ec2517db69 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:38.337246 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-16fa4910-7f2a-4383-9047-82ec2517db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:38.368983 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:38.448483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 34/67] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:38.514220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c23a5-ac2a-4b1e-b0f5-1b98d09ab006 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:38.514857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c23a5-ac2a-4b1e-b0f5-1b98d09ab006 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:38.515460 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c23a5-ac2a-4b1e-b0f5-1b98d09ab006 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:38.516974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 34/68] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:38.522920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4511a-e227-4ca3-b628-d11cfed247f0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:38.523419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4511a-e227-4ca3-b628-d11cfed247f0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:38.523881 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4511a-e227-4ca3-b628-d11cfed247f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:38.525722 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c23a5-ac2a-4b1e-b0f5-1b98d09ab006 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:38.537790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:38.553386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0de4511a-e227-4ca3-b628-d11cfed247f0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:38.554580 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0de4511a-e227-4ca3-b628-d11cfed247f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:38.678787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 35/69] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:38.683941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4511a-e227-4ca3-b628-d11cfed247f0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:38.700738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c23a5-ac2a-4b1e-b0f5-1b98d09ab006 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:38.738970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93cf64-22dd-4cbf-86c4-5a6f81b4a2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:38.739662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93cf64-22dd-4cbf-86c4-5a6f81b4a2ce None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:38.739967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93cf64-22dd-4cbf-86c4-5a6f81b4a2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:38.740303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93cf64-22dd-4cbf-86c4-5a6f81b4a2ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:38.751478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93cf64-22dd-4cbf-86c4-5a6f81b4a2ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-cb93cf64-22dd-4cbf-86c4-5a6f81b4a2ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:38.757442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:38.758284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:38.759091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:38.759091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:38.759091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:38.759091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:38.759091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:38.759091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:38.759091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:38.759091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:38.759091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:38.759091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:38.759091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:38.759091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:38.759091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 35/70] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:39:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:38.764621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780efd2-ef88-4616-9e88-7a7672eb5a59 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:38.764906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780efd2-ef88-4616-9e88-7a7672eb5a59 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:38.765281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780efd2-ef88-4616-9e88-7a7672eb5a59 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:38.766938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 36/71] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:38.767631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780efd2-ef88-4616-9e88-7a7672eb5a59 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:38.795052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:38.803679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4511a-e227-4ca3-b628-d11cfed247f0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:38.837420 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a790f28-3e8e-4d7b-939b-f437b6371976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:38.838051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a790f28-3e8e-4d7b-939b-f437b6371976 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:38.838332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a790f28-3e8e-4d7b-939b-f437b6371976 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:38.838611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a790f28-3e8e-4d7b-939b-f437b6371976 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:38.845703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:38.850540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a790f28-3e8e-4d7b-939b-f437b6371976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-3a790f28-3e8e-4d7b-939b-f437b6371976 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:38.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:38.857784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:38.858543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:38.858543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:38.858543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:38.858543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:38.858543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:38.858543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:38.858543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:38.858543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:38.858543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:38.858543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:38.858543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:38.858543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:39:38.858543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 36/72] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:38.860076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7391d56-40f8-49fb-8815-d906449337b4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:38.860076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7391d56-40f8-49fb-8815-d906449337b4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:38.860076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7391d56-40f8-49fb-8815-d906449337b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:38.878046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f7391d56-40f8-49fb-8815-d906449337b4 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:38.879237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f7391d56-40f8-49fb-8815-d906449337b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:38.888412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780efd2-ef88-4616-9e88-7a7672eb5a59 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:38.923858 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2f091-855b-4a0d-b11c-9474fd458f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:38.924475 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2f091-855b-4a0d-b11c-9474fd458f55 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:38.924755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2f091-855b-4a0d-b11c-9474fd458f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:38.925364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2f091-855b-4a0d-b11c-9474fd458f55 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:38.925726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2f091-855b-4a0d-b11c-9474fd458f55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:38.926029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2f091-855b-4a0d-b11c-9474fd458f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:38.927481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2f091-855b-4a0d-b11c-9474fd458f55 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:38.943733 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 37/73] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:38.943733 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2f091-855b-4a0d-b11c-9474fd458f55 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:38.953658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 37/74] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:38.954359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7391d56-40f8-49fb-8815-d906449337b4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:39.041253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:39.061342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7391d56-40f8-49fb-8815-d906449337b4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:39.063685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2f091-855b-4a0d-b11c-9474fd458f55 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:39.091289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:39.099651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62466b-de8a-4eea-bbce-9e493fc3be50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:39.100286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62466b-de8a-4eea-bbce-9e493fc3be50 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:39.100567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62466b-de8a-4eea-bbce-9e493fc3be50 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:39.100753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f409ce-3a50-41eb-a507-ac5b528d19ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:39.101135 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62466b-de8a-4eea-bbce-9e493fc3be50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:39.101422 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f409ce-3a50-41eb-a507-ac5b528d19ff None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:39.101781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f409ce-3a50-41eb-a507-ac5b528d19ff None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:39.102052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f409ce-3a50-41eb-a507-ac5b528d19ff None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:39.102904 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f409ce-3a50-41eb-a507-ac5b528d19ff None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:39.103208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f409ce-3a50-41eb-a507-ac5b528d19ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:39.104866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f409ce-3a50-41eb-a507-ac5b528d19ff None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:39.113459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 38/75] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:39:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:39.113459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f409ce-3a50-41eb-a507-ac5b528d19ff None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:39.119380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62466b-de8a-4eea-bbce-9e493fc3be50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0a62466b-de8a-4eea-bbce-9e493fc3be50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:39.124240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:39.125059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:39.126180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:39.126180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:39.126180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:39.126180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:39.126180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:39.126180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:39.126180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:39.126180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:39.126180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:39.126180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:39.126180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:39:39.126180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:39.126180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 38/76] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:39:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:39.131488 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62466b-de8a-4eea-bbce-9e493fc3be50 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:39.228637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f409ce-3a50-41eb-a507-ac5b528d19ff None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:39.242558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62466b-de8a-4eea-bbce-9e493fc3be50 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:39.262872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb74363-07cb-412c-9fb6-03e12ef4d681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:39.263502 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb74363-07cb-412c-9fb6-03e12ef4d681 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:39.263775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb74363-07cb-412c-9fb6-03e12ef4d681 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:39.264041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb74363-07cb-412c-9fb6-03e12ef4d681 None admin] PATH_INFO: `/v3/users/c252561ac77c437ba347f9d9a260e990` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:39.265164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb74363-07cb-412c-9fb6-03e12ef4d681 None admin] RBAC: Authorizing `identity:get_user(user_id=c252561ac77c437ba347f9d9a260e990)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:39.266602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb74363-07cb-412c-9fb6-03e12ef4d681 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:39.268177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 39/77] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:39 2022] GET /identity/v3/users/c252561ac77c437ba347f9d9a260e990 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:39.268933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb74363-07cb-412c-9fb6-03e12ef4d681 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:39.284081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6631e17-b51f-447a-a2b1-f1cf98f57dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:39.284577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:39.284765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6631e17-b51f-447a-a2b1-f1cf98f57dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:39.284993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6631e17-b51f-447a-a2b1-f1cf98f57dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:39.285263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6631e17-b51f-447a-a2b1-f1cf98f57dc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:39.296338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6631e17-b51f-447a-a2b1-f1cf98f57dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f6631e17-b51f-447a-a2b1-f1cf98f57dc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:39.301283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:39.302964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 39/78] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:39.303982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6631e17-b51f-447a-a2b1-f1cf98f57dc8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:39.352237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:39.376714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb74363-07cb-412c-9fb6-03e12ef4d681 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:39.409918 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3ffaa-0853-46bb-a840-2e4183cefb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:39.410550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3ffaa-0853-46bb-a840-2e4183cefb6b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:39.410752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6631e17-b51f-447a-a2b1-f1cf98f57dc8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:39.410848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3ffaa-0853-46bb-a840-2e4183cefb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:39.411120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3ffaa-0853-46bb-a840-2e4183cefb6b None admin] PATH_INFO: `/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:39.429611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3ffaa-0853-46bb-a840-2e4183cefb6b None admin] RBAC: Authorizing `identity:get_user(user_id=ad45b1b3038c4a20809d31f56bf8ddf8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:39.431249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3ffaa-0853-46bb-a840-2e4183cefb6b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:39.437381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 40/79] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:39 2022] GET /identity/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:39.437381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3ffaa-0853-46bb-a840-2e4183cefb6b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:39.451022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c579a3f-15a0-41e9-ad2a-0cd9d9ab0999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:39.451641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c579a3f-15a0-41e9-ad2a-0cd9d9ab0999 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:39.451925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c579a3f-15a0-41e9-ad2a-0cd9d9ab0999 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:39.452200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c579a3f-15a0-41e9-ad2a-0cd9d9ab0999 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:39.452862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c579a3f-15a0-41e9-ad2a-0cd9d9ab0999 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:39.453174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c579a3f-15a0-41e9-ad2a-0cd9d9ab0999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:39.454566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c579a3f-15a0-41e9-ad2a-0cd9d9ab0999 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:39.463191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 40/80] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:39:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:39.463984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c579a3f-15a0-41e9-ad2a-0cd9d9ab0999 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:39.507355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:39.538500 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3ffaa-0853-46bb-a840-2e4183cefb6b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:39.562113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c579a3f-15a0-41e9-ad2a-0cd9d9ab0999 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:39.572386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:39.573035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592035af-f131-4256-8095-cbd8031b3615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:39.573586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592035af-f131-4256-8095-cbd8031b3615 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:39.573832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592035af-f131-4256-8095-cbd8031b3615 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:39.574174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592035af-f131-4256-8095-cbd8031b3615 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:39.575337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592035af-f131-4256-8095-cbd8031b3615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:39.576775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592035af-f131-4256-8095-cbd8031b3615 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:39.578322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 41/81] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:39:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:39.579113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592035af-f131-4256-8095-cbd8031b3615 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:39.601100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f70abf-ce4b-4d9e-bf50-ac9b452a72a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:39.601711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f70abf-ce4b-4d9e-bf50-ac9b452a72a1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:39.601996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f70abf-ce4b-4d9e-bf50-ac9b452a72a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:39.602266 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f70abf-ce4b-4d9e-bf50-ac9b452a72a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:39.669235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f70abf-ce4b-4d9e-bf50-ac9b452a72a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:39.670718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f70abf-ce4b-4d9e-bf50-ac9b452a72a1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:39.676253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592035af-f131-4256-8095-cbd8031b3615 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:39.710635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615a981-6e2e-4ac1-bb4f-6e31b2789ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:39.711263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615a981-6e2e-4ac1-bb4f-6e31b2789ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:39.711540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615a981-6e2e-4ac1-bb4f-6e31b2789ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:39.711810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615a981-6e2e-4ac1-bb4f-6e31b2789ff3 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:39.712471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615a981-6e2e-4ac1-bb4f-6e31b2789ff3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:39.712772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615a981-6e2e-4ac1-bb4f-6e31b2789ff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:39.714119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615a981-6e2e-4ac1-bb4f-6e31b2789ff3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:39.718994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:39.722980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 42/82] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:39:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:39.724343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615a981-6e2e-4ac1-bb4f-6e31b2789ff3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:39.769339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 41/83] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:39:39.770101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f70abf-ce4b-4d9e-bf50-ac9b452a72a1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:39.782928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:39.822889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615a981-6e2e-4ac1-bb4f-6e31b2789ff3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:39.856619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d7797-fa97-4d39-881b-96e4725e13d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:39.857481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7797-fa97-4d39-881b-96e4725e13d8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:39.857765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7797-fa97-4d39-881b-96e4725e13d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:39.858044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7797-fa97-4d39-881b-96e4725e13d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:39.868656 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f70abf-ce4b-4d9e-bf50-ac9b452a72a1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:39.902286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9645d-f439-4fb0-ba62-76cd9277d4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:39.902939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9645d-f439-4fb0-ba62-76cd9277d4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:39.903221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9645d-f439-4fb0-ba62-76cd9277d4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:39.903492 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9645d-f439-4fb0-ba62-76cd9277d4b1 None admin] PATH_INFO: `/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:39.904613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9645d-f439-4fb0-ba62-76cd9277d4b1 None admin] RBAC: Authorizing `identity:get_user(user_id=ad45b1b3038c4a20809d31f56bf8ddf8)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:39.906069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9645d-f439-4fb0-ba62-76cd9277d4b1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:39.907666 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 42/84] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:39 2022] GET /identity/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:39.908403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9645d-f439-4fb0-ba62-76cd9277d4b1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:39.923870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:39.926666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d7797-fa97-4d39-881b-96e4725e13d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:39.928658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d7797-fa97-4d39-881b-96e4725e13d8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:39.988996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:40.011358 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9645d-f439-4fb0-ba62-76cd9277d4b1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:40.026459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 43/85] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:39:40.027260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d7797-fa97-4d39-881b-96e4725e13d8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:40.044243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa410b-9466-4889-8e68-9c5b71623a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:40.044846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa410b-9466-4889-8e68-9c5b71623a90 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:40.045122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa410b-9466-4889-8e68-9c5b71623a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:40.045392 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa410b-9466-4889-8e68-9c5b71623a90 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:40.046065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa410b-9466-4889-8e68-9c5b71623a90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:40.047528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa410b-9466-4889-8e68-9c5b71623a90 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:40.068196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 43/86] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:39:39 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:39:40.069009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa410b-9466-4889-8e68-9c5b71623a90 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:40.138328 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:40.143179 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d7797-fa97-4d39-881b-96e4725e13d8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:40.182949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2afc8e-41d4-4792-aa32-bc08285b541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:40.183610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2afc8e-41d4-4792-aa32-bc08285b541c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:40.183894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2afc8e-41d4-4792-aa32-bc08285b541c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:40.184176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2afc8e-41d4-4792-aa32-bc08285b541c None admin] PATH_INFO: `/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:40.185370 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2afc8e-41d4-4792-aa32-bc08285b541c None admin] RBAC: Authorizing `identity:get_user(user_id=ad45b1b3038c4a20809d31f56bf8ddf8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:40.185543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa410b-9466-4889-8e68-9c5b71623a90 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:40.186900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2afc8e-41d4-4792-aa32-bc08285b541c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:40.188599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 44/87] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:40 2022] GET /identity/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:40.189409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2afc8e-41d4-4792-aa32-bc08285b541c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:40.228813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba57a9-5102-4f72-818d-77b07b474b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:40.229532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba57a9-5102-4f72-818d-77b07b474b74 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:40.229805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba57a9-5102-4f72-818d-77b07b474b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:40.230074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba57a9-5102-4f72-818d-77b07b474b74 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:40.231246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba57a9-5102-4f72-818d-77b07b474b74 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:40.232775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba57a9-5102-4f72-818d-77b07b474b74 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:40.234748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 44/88] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:40 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:40.235395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba57a9-5102-4f72-818d-77b07b474b74 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:40.238228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:40.322395 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2afc8e-41d4-4792-aa32-bc08285b541c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:40.362220 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9214af0-c444-4ab9-945c-d84c7d85823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:40.363198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9214af0-c444-4ab9-945c-d84c7d85823a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:40.363791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9214af0-c444-4ab9-945c-d84c7d85823a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:40.363994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba57a9-5102-4f72-818d-77b07b474b74 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:40.364481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9214af0-c444-4ab9-945c-d84c7d85823a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:40.405480 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68bc36-803b-448a-9051-884c4fc7d893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:40.406124 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68bc36-803b-448a-9051-884c4fc7d893 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:40.406406 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68bc36-803b-448a-9051-884c4fc7d893 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:40.406836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68bc36-803b-448a-9051-884c4fc7d893 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:40.407975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68bc36-803b-448a-9051-884c4fc7d893 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:40.409424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68bc36-803b-448a-9051-884c4fc7d893 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:40.411087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 45/89] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:40 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:40.412408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68bc36-803b-448a-9051-884c4fc7d893 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:40.416546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:40.462766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9214af0-c444-4ab9-945c-d84c7d85823a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:40.464224 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9214af0-c444-4ab9-945c-d84c7d85823a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:40.489301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:40.522856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68bc36-803b-448a-9051-884c4fc7d893 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:40.559395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88278da-018d-422c-b895-bcf582aae2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:40.560016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88278da-018d-422c-b895-bcf582aae2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:40.560294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88278da-018d-422c-b895-bcf582aae2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:40.560565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88278da-018d-422c-b895-bcf582aae2f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:40.586765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 45/90] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:39:40.588033 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9214af0-c444-4ab9-945c-d84c7d85823a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:40.645154 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88278da-018d-422c-b895-bcf582aae2f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:40.648010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88278da-018d-422c-b895-bcf582aae2f6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:40.664695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:40.711995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9214af0-c444-4ab9-945c-d84c7d85823a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:40.730746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:40.756019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fdd3c-176c-44b9-b22f-72577fb4d95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:40.757211 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fdd3c-176c-44b9-b22f-72577fb4d95d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:40.757793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fdd3c-176c-44b9-b22f-72577fb4d95d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:40.758302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fdd3c-176c-44b9-b22f-72577fb4d95d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:40.759372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fdd3c-176c-44b9-b22f-72577fb4d95d None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=97e41b93d02a4c21aed2b712c418d461, user.id=c252561ac77c437ba347f9d9a260e990) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:40.759871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fdd3c-176c-44b9-b22f-72577fb4d95d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:40.762150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fdd3c-176c-44b9-b22f-72577fb4d95d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:40.765329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 46/91] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:39:40.766534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88278da-018d-422c-b895-bcf582aae2f6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:40.768981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 46/92] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:39:40 2022] GET /identity/v3/role_assignments?user.id=c252561ac77c437ba347f9d9a260e990&scope.project.id=97e41b93d02a4c21aed2b712c418d461&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:40.770259 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fdd3c-176c-44b9-b22f-72577fb4d95d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:40.953506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fdd3c-176c-44b9-b22f-72577fb4d95d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:40.976780 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88278da-018d-422c-b895-bcf582aae2f6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:40.996406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:41.003435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c16220-93c6-47b6-9966-1d8a42f542b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:41.004075 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16220-93c6-47b6-9966-1d8a42f542b6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:41.004354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16220-93c6-47b6-9966-1d8a42f542b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:41.004929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16220-93c6-47b6-9966-1d8a42f542b6 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:41.006088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c16220-93c6-47b6-9966-1d8a42f542b6 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:41.007647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c16220-93c6-47b6-9966-1d8a42f542b6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:41.010354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 47/93] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:40 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:41.011182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c16220-93c6-47b6-9966-1d8a42f542b6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:41.031159 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec03bb-9363-46be-aef7-a16df0458f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:41.031860 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec03bb-9363-46be-aef7-a16df0458f4c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:41.032137 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec03bb-9363-46be-aef7-a16df0458f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:41.032411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec03bb-9363-46be-aef7-a16df0458f4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:41.033190 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec03bb-9363-46be-aef7-a16df0458f4c None admin] RBAC: Adding query filter params (role.id=f5585030f686473c89e1de214b25b6ff, scope.project.id=97e41b93d02a4c21aed2b712c418d461, user.id=ad45b1b3038c4a20809d31f56bf8ddf8) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:41.033436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec03bb-9363-46be-aef7-a16df0458f4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:41.034903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec03bb-9363-46be-aef7-a16df0458f4c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:41.054667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 47/94] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:39:40 2022] GET /identity/v3/role_assignments?user.id=ad45b1b3038c4a20809d31f56bf8ddf8&scope.project.id=97e41b93d02a4c21aed2b712c418d461&role.id=f5585030f686473c89e1de214b25b6ff => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:41.055608 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec03bb-9363-46be-aef7-a16df0458f4c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:41.130037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c16220-93c6-47b6-9966-1d8a42f542b6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:41.155842 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:41.205833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287bb6f-5323-4470-b71c-f989489a4256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:41.206652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287bb6f-5323-4470-b71c-f989489a4256 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:41.206961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287bb6f-5323-4470-b71c-f989489a4256 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:41.207497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287bb6f-5323-4470-b71c-f989489a4256 None admin] PATH_INFO: `/v3/projects/b248d95f957545bf93dbe6d1bca7e819` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:41.211544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287bb6f-5323-4470-b71c-f989489a4256 None admin] RBAC: Authorizing `identity:get_project(project_id=b248d95f957545bf93dbe6d1bca7e819)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:41.213789 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287bb6f-5323-4470-b71c-f989489a4256 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:41.215994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 48/95] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:41 2022] GET /identity/v3/projects/b248d95f957545bf93dbe6d1bca7e819 => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:41.228482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287bb6f-5323-4470-b71c-f989489a4256 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:41.285197 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec03bb-9363-46be-aef7-a16df0458f4c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:41.332795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49833729-14e9-4212-bddb-42965a502837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:41.334377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833729-14e9-4212-bddb-42965a502837 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:41.334878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833729-14e9-4212-bddb-42965a502837 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:41.335806 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833729-14e9-4212-bddb-42965a502837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:41.336736 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49833729-14e9-4212-bddb-42965a502837 None admin] RBAC: Adding query filter params (role.id=5e35afebe51a448a9ee3ed338209d739, scope.project.id=97e41b93d02a4c21aed2b712c418d461, user.id=ad45b1b3038c4a20809d31f56bf8ddf8) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:41.337263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49833729-14e9-4212-bddb-42965a502837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:41.338982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49833729-14e9-4212-bddb-42965a502837 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:41.345508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 48/96] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:39:41 2022] GET /identity/v3/role_assignments?user.id=ad45b1b3038c4a20809d31f56bf8ddf8&scope.project.id=97e41b93d02a4c21aed2b712c418d461&role.id=5e35afebe51a448a9ee3ed338209d739 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:41.385075 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:41.436163 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287bb6f-5323-4470-b71c-f989489a4256 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:41.473395 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159a051-420c-47cc-b97d-254ad1746a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:41.474095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159a051-420c-47cc-b97d-254ad1746a91 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:41.474379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159a051-420c-47cc-b97d-254ad1746a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:41.474650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159a051-420c-47cc-b97d-254ad1746a91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:41.475683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159a051-420c-47cc-b97d-254ad1746a91 None admin] RBAC: Adding query filter params (role.id=f5585030f686473c89e1de214b25b6ff, scope.project.id=b248d95f957545bf93dbe6d1bca7e819, user.id=ad45b1b3038c4a20809d31f56bf8ddf8) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:41.475987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159a051-420c-47cc-b97d-254ad1746a91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:41.477440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159a051-420c-47cc-b97d-254ad1746a91 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:41.484016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 49/97] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:39:41 2022] GET /identity/v3/role_assignments?user.id=ad45b1b3038c4a20809d31f56bf8ddf8&scope.project.id=b248d95f957545bf93dbe6d1bca7e819&role.id=f5585030f686473c89e1de214b25b6ff => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:42.810934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8168959-a8c4-41e2-9813-fe359fd4f3ae None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:42.811949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8168959-a8c4-41e2-9813-fe359fd4f3ae None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:42.812477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8168959-a8c4-41e2-9813-fe359fd4f3ae None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:42.814078 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 49/98] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:42.819629 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19794d80-ec41-4bf9-9473-562f04a4ec07 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:42.820430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19794d80-ec41-4bf9-9473-562f04a4ec07 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:42.820897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19794d80-ec41-4bf9-9473-562f04a4ec07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:42.844506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-19794d80-ec41-4bf9-9473-562f04a4ec07 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:42.845688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-19794d80-ec41-4bf9-9473-562f04a4ec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:42.932625 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 50/99] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:39:43.227605 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ab6fa-4686-45ce-ace7-d559751adbb8 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:43.228381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ab6fa-4686-45ce-ace7-d559751adbb8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:43.228910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ab6fa-4686-45ce-ace7-d559751adbb8 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:43.230466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 50/100] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:43.235989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54888c5-d6f7-40be-9e7c-fbb6db8f62c8 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:43.236498 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54888c5-d6f7-40be-9e7c-fbb6db8f62c8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:43.236957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54888c5-d6f7-40be-9e7c-fbb6db8f62c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:43.259323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e54888c5-d6f7-40be-9e7c-fbb6db8f62c8 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:43.260811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e54888c5-d6f7-40be-9e7c-fbb6db8f62c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:43.339548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:43.354633 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 51/101] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:43.460093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ab6fa-4686-45ce-ace7-d559751adbb8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:43.590350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:43.595569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ab6fa-4686-45ce-ace7-d559751adbb8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:43.633351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7c1e1-6dd2-4bfb-8953-384a0f5a2d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:43.633996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7c1e1-6dd2-4bfb-8953-384a0f5a2d2d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:43.634276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7c1e1-6dd2-4bfb-8953-384a0f5a2d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:43.634547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7c1e1-6dd2-4bfb-8953-384a0f5a2d2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:43.635703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7c1e1-6dd2-4bfb-8953-384a0f5a2d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:43.637157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7c1e1-6dd2-4bfb-8953-384a0f5a2d2d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:43.638755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 51/102] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:39:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:43.644242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54888c5-d6f7-40be-9e7c-fbb6db8f62c8 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:43.755950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54888c5-d6f7-40be-9e7c-fbb6db8f62c8 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:43.761924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7c1e1-6dd2-4bfb-8953-384a0f5a2d2d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:43.826887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f7c7d-1bdb-445e-9575-70fe2fc57d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:43.827717 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f7c7d-1bdb-445e-9575-70fe2fc57d93 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:43.828006 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f7c7d-1bdb-445e-9575-70fe2fc57d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:43.828284 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f7c7d-1bdb-445e-9575-70fe2fc57d93 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:43.828956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f7c7d-1bdb-445e-9575-70fe2fc57d93 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:43.830393 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f7c7d-1bdb-445e-9575-70fe2fc57d93 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:43.886654 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 52/103] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:39:43 2022] POST /identity/v3/projects => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:39:43.888647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31888462-d847-465f-8c8e-d7c2b989f64c None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:43.889349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31888462-d847-465f-8c8e-d7c2b989f64c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:43.889630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31888462-d847-465f-8c8e-d7c2b989f64c None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:43.891728 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 53/104] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:43.898559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b39547-6a08-46ed-9e06-1695bad99235 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:43.899147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b39547-6a08-46ed-9e06-1695bad99235 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:43.899423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b39547-6a08-46ed-9e06-1695bad99235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:43.936613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-07b39547-6a08-46ed-9e06-1695bad99235 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:43.938060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-07b39547-6a08-46ed-9e06-1695bad99235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:43.958155 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7c1e1-6dd2-4bfb-8953-384a0f5a2d2d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:44.047017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:44.055605 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d2d7-36a3-4ed2-84f2-cce9fa9ecb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:44.056287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d2d7-36a3-4ed2-84f2-cce9fa9ecb5d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:44.056569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d2d7-36a3-4ed2-84f2-cce9fa9ecb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:44.056839 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d2d7-36a3-4ed2-84f2-cce9fa9ecb5d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:44.086824 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168d2d7-36a3-4ed2-84f2-cce9fa9ecb5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3168d2d7-36a3-4ed2-84f2-cce9fa9ecb5d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:44.093429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:44.094339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:44.095439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:44.095439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:44.095439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:44.095439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:44.095439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:44.095439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:44.095439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:44.095439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:44.095439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:44.095439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:44.095439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:39:44.095439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:44.095439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 52/105] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:44.105382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d2d7-36a3-4ed2-84f2-cce9fa9ecb5d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:44.127073 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 54/106] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:44.148867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:44.229385 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d2d7-36a3-4ed2-84f2-cce9fa9ecb5d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:44.265369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1d2a7-a58a-4151-925b-af46f86b585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:44.265979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1d2a7-a58a-4151-925b-af46f86b585c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:44.266311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1d2a7-a58a-4151-925b-af46f86b585c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:44.266592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1d2a7-a58a-4151-925b-af46f86b585c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:44.267431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1d2a7-a58a-4151-925b-af46f86b585c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:44.267737 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1d2a7-a58a-4151-925b-af46f86b585c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:44.269117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1d2a7-a58a-4151-925b-af46f86b585c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:44.278579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 53/107] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:39:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:44.284753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b39547-6a08-46ed-9e06-1695bad99235 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:44.404130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b39547-6a08-46ed-9e06-1695bad99235 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:44.415581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695329b-07b0-4a68-ac6f-6c823ea0a0cb None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:44.415886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695329b-07b0-4a68-ac6f-6c823ea0a0cb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:44.416145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695329b-07b0-4a68-ac6f-6c823ea0a0cb None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:44.417510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 54/108] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:44.422712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534ea7-ab76-4868-a74a-cb1b29b1a7c1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:44.423034 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534ea7-ab76-4868-a74a-cb1b29b1a7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:44.423317 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534ea7-ab76-4868-a74a-cb1b29b1a7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:44.467414 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bf534ea7-ab76-4868-a74a-cb1b29b1a7c1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:44.468633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bf534ea7-ab76-4868-a74a-cb1b29b1a7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:44.473115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7093f0-73b0-4b70-a65d-3dae9f1e97c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:44.473761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7093f0-73b0-4b70-a65d-3dae9f1e97c7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:44.474049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7093f0-73b0-4b70-a65d-3dae9f1e97c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:44.474324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7093f0-73b0-4b70-a65d-3dae9f1e97c7 None admin] PATH_INFO: `/v3/users/b2ae7ea5649a43958b37cc7898c7d75e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:44.497966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7093f0-73b0-4b70-a65d-3dae9f1e97c7 None admin] RBAC: Authorizing `identity:get_user(user_id=b2ae7ea5649a43958b37cc7898c7d75e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:44.499460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7093f0-73b0-4b70-a65d-3dae9f1e97c7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:44.501374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 55/109] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:44 2022] GET /identity/v3/users/b2ae7ea5649a43958b37cc7898c7d75e => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:44.508615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7093f0-73b0-4b70-a65d-3dae9f1e97c7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:44.578762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:44.625265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 55/110] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:44.626067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf534ea7-ab76-4868-a74a-cb1b29b1a7c1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:44.667195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:44.713038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7093f0-73b0-4b70-a65d-3dae9f1e97c7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:44.782036 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc6f49-838e-4051-856a-03bf82b54276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:44.782644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc6f49-838e-4051-856a-03bf82b54276 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:44.782953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc6f49-838e-4051-856a-03bf82b54276 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:44.783225 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc6f49-838e-4051-856a-03bf82b54276 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:44.801307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf534ea7-ab76-4868-a74a-cb1b29b1a7c1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:44.879242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae584af-0178-4389-aaf5-4af7f7ef6c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:44.882109 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae584af-0178-4389-aaf5-4af7f7ef6c8f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:44.882386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae584af-0178-4389-aaf5-4af7f7ef6c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:44.882655 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae584af-0178-4389-aaf5-4af7f7ef6c8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:44.908726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae584af-0178-4389-aaf5-4af7f7ef6c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-dae584af-0178-4389-aaf5-4af7f7ef6c8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:44.914035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:44.914919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:44.915700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:44.915700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:44.915700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:44.915700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:44.915700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:44.915700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:44.915700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:44.915700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:44.915700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:44.915700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:44.915700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:44.915700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:44.919635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 56/111] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:39:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:44.920871 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dad67-5c8d-4571-9a31-b07b6191ab7c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:44.921152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dad67-5c8d-4571-9a31-b07b6191ab7c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:44.921422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dad67-5c8d-4571-9a31-b07b6191ab7c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:44.923069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 57/112] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:44.924514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfc08b-fee6-42bf-991f-5625b90ca11f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:44.924795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfc08b-fee6-42bf-991f-5625b90ca11f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:44.925090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfc08b-fee6-42bf-991f-5625b90ca11f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:44.927395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 58/113] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:44.928103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc6f49-838e-4051-856a-03bf82b54276 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:44.928560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfc08b-fee6-42bf-991f-5625b90ca11f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:44.930236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc6f49-838e-4051-856a-03bf82b54276 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:44.962819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:45.022079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:45.041719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 56/114] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:39:45.043642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8d66-82c1-4fe6-8497-e4715198072f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:45.043933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8d66-82c1-4fe6-8497-e4715198072f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:45.044214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8d66-82c1-4fe6-8497-e4715198072f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:45.047610 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfc08b-fee6-42bf-991f-5625b90ca11f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:45.063422 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a22b8d66-82c1-4fe6-8497-e4715198072f None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:45.064898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a22b8d66-82c1-4fe6-8497-e4715198072f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:45.083288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f17da2-cf15-46d1-947f-b9de9ce9bfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:45.084123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f17da2-cf15-46d1-947f-b9de9ce9bfb9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:45.084409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f17da2-cf15-46d1-947f-b9de9ce9bfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:45.084681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f17da2-cf15-46d1-947f-b9de9ce9bfb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:45.085346 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f17da2-cf15-46d1-947f-b9de9ce9bfb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:45.085650 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f17da2-cf15-46d1-947f-b9de9ce9bfb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:45.087067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f17da2-cf15-46d1-947f-b9de9ce9bfb9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:45.095358 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 59/115] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:45.096542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cf1c0-fd8e-4b32-9e32-0b7ae4a0a96d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:45.096829 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cf1c0-fd8e-4b32-9e32-0b7ae4a0a96d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:45.097111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cf1c0-fd8e-4b32-9e32-0b7ae4a0a96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:45.114509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-087cf1c0-fd8e-4b32-9e32-0b7ae4a0a96d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:45.116259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-087cf1c0-fd8e-4b32-9e32-0b7ae4a0a96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:45.146065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 57/116] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:45.152113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b8d66-82c1-4fe6-8497-e4715198072f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:45.194809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 60/117] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:45.194809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cf1c0-fd8e-4b32-9e32-0b7ae4a0a96d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:45.254631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:45.321315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b8d66-82c1-4fe6-8497-e4715198072f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:45.325233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:45.380337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cf1c0-fd8e-4b32-9e32-0b7ae4a0a96d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:45.385756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baaa0b-acf4-458b-bed9-824527d25512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:45.386556 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baaa0b-acf4-458b-bed9-824527d25512 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:45.387014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baaa0b-acf4-458b-bed9-824527d25512 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:45.387426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baaa0b-acf4-458b-bed9-824527d25512 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:45.405724 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4baaa0b-acf4-458b-bed9-824527d25512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a4baaa0b-acf4-458b-bed9-824527d25512 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:45.411205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:45.412766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:45.413723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:45.413723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:45.413723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:45.413723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:45.413723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:45.413723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:45.413723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:45.413723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:45.413723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:45.413723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:45.413723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:45.413723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:39:45.418180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 58/118] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:45.419895 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baaa0b-acf4-458b-bed9-824527d25512 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:45.456756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb306b-55ac-4aba-95ce-62595f296f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:45.458313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb306b-55ac-4aba-95ce-62595f296f16 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:45.458672 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb306b-55ac-4aba-95ce-62595f296f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:45.459337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb306b-55ac-4aba-95ce-62595f296f16 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:45.460845 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb306b-55ac-4aba-95ce-62595f296f16 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:45.463060 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb306b-55ac-4aba-95ce-62595f296f16 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:45.465699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 61/119] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:45 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:45.466611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb306b-55ac-4aba-95ce-62595f296f16 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:45.541243 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baaa0b-acf4-458b-bed9-824527d25512 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:45.565202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:45.579513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859f5fc-420a-4ad0-a292-858b898abcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:45.580141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859f5fc-420a-4ad0-a292-858b898abcfc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:45.580426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859f5fc-420a-4ad0-a292-858b898abcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:45.580705 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859f5fc-420a-4ad0-a292-858b898abcfc None admin] PATH_INFO: `/v3/users/c252561ac77c437ba347f9d9a260e990` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:45.581840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859f5fc-420a-4ad0-a292-858b898abcfc None admin] RBAC: Authorizing `identity:get_user(user_id=c252561ac77c437ba347f9d9a260e990)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:45.583603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859f5fc-420a-4ad0-a292-858b898abcfc None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:45.585957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 59/120] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:45 2022] GET /identity/v3/users/c252561ac77c437ba347f9d9a260e990 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:45.586588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859f5fc-420a-4ad0-a292-858b898abcfc None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:45.595032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb306b-55ac-4aba-95ce-62595f296f16 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:45.630385 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bec72-a939-461f-a7e3-e0e5380dcdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:45.631564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bec72-a939-461f-a7e3-e0e5380dcdb8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:45.631850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bec72-a939-461f-a7e3-e0e5380dcdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:45.632125 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bec72-a939-461f-a7e3-e0e5380dcdb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:45.632784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bec72-a939-461f-a7e3-e0e5380dcdb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:45.633085 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bec72-a939-461f-a7e3-e0e5380dcdb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:45.635172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bec72-a939-461f-a7e3-e0e5380dcdb8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:45.640877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:45.644196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 62/121] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:39:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:45.645128 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bec72-a939-461f-a7e3-e0e5380dcdb8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:45.700359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859f5fc-420a-4ad0-a292-858b898abcfc None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:45.735794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdddc05-4fb2-418b-a925-7f268914baf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:45.736429 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdddc05-4fb2-418b-a925-7f268914baf3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:45.736711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdddc05-4fb2-418b-a925-7f268914baf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:45.736981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdddc05-4fb2-418b-a925-7f268914baf3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:45.748535 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdddc05-4fb2-418b-a925-7f268914baf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:45.752314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bec72-a939-461f-a7e3-e0e5380dcdb8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-dfdddc05-4fb2-418b-a925-7f268914baf3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:45.753996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:45.754986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:45.755754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:45.755754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:45.755754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:45.755754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:45.755754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:45.755754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:45.755754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:45.755754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:45.755754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:45.755754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:45.755754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:39:45.755754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:39:45.756392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 60/122] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:39:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:45.756884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdddc05-4fb2-418b-a925-7f268914baf3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:45.791321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dbccf-f806-438c-a161-47f10a3330bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:45.792399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dbccf-f806-438c-a161-47f10a3330bc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:45.792920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dbccf-f806-438c-a161-47f10a3330bc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:45.793238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dbccf-f806-438c-a161-47f10a3330bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:45.794019 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dbccf-f806-438c-a161-47f10a3330bc None admin] RBAC: Adding query filter params (role.id=ec07f55a1c534d79af2517e37b41fc75, scope.project.id=97e41b93d02a4c21aed2b712c418d461, user.id=b2ae7ea5649a43958b37cc7898c7d75e) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:45.794336 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dbccf-f806-438c-a161-47f10a3330bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:45.795810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dbccf-f806-438c-a161-47f10a3330bc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:45.801745 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 63/123] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:39:45 2022] GET /identity/v3/role_assignments?user.id=b2ae7ea5649a43958b37cc7898c7d75e&scope.project.id=97e41b93d02a4c21aed2b712c418d461&role.id=ec07f55a1c534d79af2517e37b41fc75 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:45.802570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dbccf-f806-438c-a161-47f10a3330bc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:45.817892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:45.886539 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdddc05-4fb2-418b-a925-7f268914baf3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:45.901169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:45.931903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400e1d6-823f-46e3-9fef-297a8f00bbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:45.932629 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400e1d6-823f-46e3-9fef-297a8f00bbf7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:45.932829 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400e1d6-823f-46e3-9fef-297a8f00bbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:45.933102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400e1d6-823f-46e3-9fef-297a8f00bbf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:45.947212 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400e1d6-823f-46e3-9fef-297a8f00bbf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d400e1d6-823f-46e3-9fef-297a8f00bbf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:45.952231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:45.953158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 61/124] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:45.959791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400e1d6-823f-46e3-9fef-297a8f00bbf7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:45.967972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dbccf-f806-438c-a161-47f10a3330bc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:46.009790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ac07b-afe7-496c-a3d2-eeebced4fdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:46.010673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ac07b-afe7-496c-a3d2-eeebced4fdf4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:46.011180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ac07b-afe7-496c-a3d2-eeebced4fdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:46.011594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ac07b-afe7-496c-a3d2-eeebced4fdf4 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:46.012890 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ac07b-afe7-496c-a3d2-eeebced4fdf4 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:46.014489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ac07b-afe7-496c-a3d2-eeebced4fdf4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:46.021334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 64/125] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:45 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:46.022928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ac07b-afe7-496c-a3d2-eeebced4fdf4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:46.081197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400e1d6-823f-46e3-9fef-297a8f00bbf7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:46.094508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5efe9-c9db-46d7-bcda-ecc3e4b6d2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:46.125396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5efe9-c9db-46d7-bcda-ecc3e4b6d2ce None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:46.125857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5efe9-c9db-46d7-bcda-ecc3e4b6d2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:46.126142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5efe9-c9db-46d7-bcda-ecc3e4b6d2ce None admin] PATH_INFO: `/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:46.127698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5efe9-c9db-46d7-bcda-ecc3e4b6d2ce None admin] RBAC: Authorizing `identity:get_user(user_id=ad45b1b3038c4a20809d31f56bf8ddf8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:46.129643 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5efe9-c9db-46d7-bcda-ecc3e4b6d2ce None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:46.136402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 62/126] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:45 2022] GET /identity/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:46.137501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5efe9-c9db-46d7-bcda-ecc3e4b6d2ce None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:46.153433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ac07b-afe7-496c-a3d2-eeebced4fdf4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:46.194530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:46.203222 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845a031-131a-4e71-a176-9d89c0fac5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:46.204353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845a031-131a-4e71-a176-9d89c0fac5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:46.205161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845a031-131a-4e71-a176-9d89c0fac5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:46.205847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845a031-131a-4e71-a176-9d89c0fac5a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:46.206902 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845a031-131a-4e71-a176-9d89c0fac5a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:46.207237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845a031-131a-4e71-a176-9d89c0fac5a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:46.208908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845a031-131a-4e71-a176-9d89c0fac5a7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:46.222375 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 65/127] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:39:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:46.223570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845a031-131a-4e71-a176-9d89c0fac5a7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:46.271649 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5efe9-c9db-46d7-bcda-ecc3e4b6d2ce None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:46.322437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd598d8-9744-4fbf-be12-11b5bb11e8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:46.323649 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd598d8-9744-4fbf-be12-11b5bb11e8fc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:46.324155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd598d8-9744-4fbf-be12-11b5bb11e8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:46.325023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd598d8-9744-4fbf-be12-11b5bb11e8fc None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:46.326167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd598d8-9744-4fbf-be12-11b5bb11e8fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:46.326668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd598d8-9744-4fbf-be12-11b5bb11e8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:46.328935 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd598d8-9744-4fbf-be12-11b5bb11e8fc None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:46.345192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 63/128] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:39:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:46.345192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd598d8-9744-4fbf-be12-11b5bb11e8fc None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:46.356692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845a031-131a-4e71-a176-9d89c0fac5a7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:46.400615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:46.408048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95100582-152a-4a51-a308-b0549e849b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:46.409245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95100582-152a-4a51-a308-b0549e849b95 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:46.409964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95100582-152a-4a51-a308-b0549e849b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:46.410443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95100582-152a-4a51-a308-b0549e849b95 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461/users/c252561ac77c437ba347f9d9a260e990/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:46.413082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95100582-152a-4a51-a308-b0549e849b95 None admin] RBAC: Authorizing `identity:create_grant(project_id=97e41b93d02a4c21aed2b712c418d461, user_id=c252561ac77c437ba347f9d9a260e990, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:46.415637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95100582-152a-4a51-a308-b0549e849b95 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:46.446882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 66/129] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:39:46 2022] PUT /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461/users/c252561ac77c437ba347f9d9a260e990/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:39:46.448065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95100582-152a-4a51-a308-b0549e849b95 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:46.468834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd598d8-9744-4fbf-be12-11b5bb11e8fc None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:46.514717 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14be1eb-05a5-416b-b1b2-e6850eb38447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:46.517046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be1eb-05a5-416b-b1b2-e6850eb38447 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:46.517782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be1eb-05a5-416b-b1b2-e6850eb38447 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:46.518427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be1eb-05a5-416b-b1b2-e6850eb38447 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:46.521352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14be1eb-05a5-416b-b1b2-e6850eb38447 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:46.523489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14be1eb-05a5-416b-b1b2-e6850eb38447 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:46.528883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 64/130] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:46 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:46.531278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14be1eb-05a5-416b-b1b2-e6850eb38447 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:46.571879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:46.628307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95100582-152a-4a51-a308-b0549e849b95 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:46.670669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc7df4-ad28-4949-b566-67630d979653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:46.672177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7df4-ad28-4949-b566-67630d979653 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:46.672616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7df4-ad28-4949-b566-67630d979653 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:46.673159 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7df4-ad28-4949-b566-67630d979653 None admin] PATH_INFO: `/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:46.674653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc7df4-ad28-4949-b566-67630d979653 None admin] RBAC: Authorizing `identity:get_user(user_id=ad45b1b3038c4a20809d31f56bf8ddf8)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:46.676358 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc7df4-ad28-4949-b566-67630d979653 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:46.678751 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 67/131] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:46 2022] GET /identity/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:46.680008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc7df4-ad28-4949-b566-67630d979653 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:46.732283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14be1eb-05a5-416b-b1b2-e6850eb38447 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:46.742746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:46.772912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe17612-a0b4-4afd-bf76-842285d925da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:46.773594 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe17612-a0b4-4afd-bf76-842285d925da None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:46.773815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe17612-a0b4-4afd-bf76-842285d925da None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:46.774096 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe17612-a0b4-4afd-bf76-842285d925da None admin] PATH_INFO: `/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:46.775296 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe17612-a0b4-4afd-bf76-842285d925da None admin] RBAC: Authorizing `identity:get_user(user_id=ad45b1b3038c4a20809d31f56bf8ddf8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:46.777714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe17612-a0b4-4afd-bf76-842285d925da None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:46.779615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 65/132] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:46 2022] GET /identity/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:46.780448 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe17612-a0b4-4afd-bf76-842285d925da None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:46.816177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc7df4-ad28-4949-b566-67630d979653 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:46.851084 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:46.861795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9420de-3918-4c2f-8c85-878fcf2de32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:46.862709 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9420de-3918-4c2f-8c85-878fcf2de32f None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:46.863312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9420de-3918-4c2f-8c85-878fcf2de32f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:46.863735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9420de-3918-4c2f-8c85-878fcf2de32f None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461/users/ad45b1b3038c4a20809d31f56bf8ddf8/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:46.865996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9420de-3918-4c2f-8c85-878fcf2de32f None admin] RBAC: Authorizing `identity:create_grant(project_id=97e41b93d02a4c21aed2b712c418d461, user_id=ad45b1b3038c4a20809d31f56bf8ddf8, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:46.868202 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9420de-3918-4c2f-8c85-878fcf2de32f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:46.890824 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 68/133] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:39:46 2022] PUT /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461/users/ad45b1b3038c4a20809d31f56bf8ddf8/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:39:46.893091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f21e9-bce4-4d6e-92a3-998567837dee None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:46.894001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f21e9-bce4-4d6e-92a3-998567837dee None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:46.894627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f21e9-bce4-4d6e-92a3-998567837dee None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:46.896376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 69/134] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:46.897216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe17612-a0b4-4afd-bf76-842285d925da None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:46.897794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f21e9-bce4-4d6e-92a3-998567837dee None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:46.972805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e5780-3017-4dc8-a023-b950031da672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:46.975890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e5780-3017-4dc8-a023-b950031da672 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:46.976177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e5780-3017-4dc8-a023-b950031da672 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:46.976448 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e5780-3017-4dc8-a023-b950031da672 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:46.977768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e5780-3017-4dc8-a023-b950031da672 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:46.979261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e5780-3017-4dc8-a023-b950031da672 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:46.987209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 66/135] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:46 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:46.990768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b5395-31a0-4d60-816f-10797d134a85 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:46.991050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b5395-31a0-4d60-816f-10797d134a85 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:46.991325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b5395-31a0-4d60-816f-10797d134a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:47.031601 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ac9b5395-31a0-4d60-816f-10797d134a85 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:47.035456 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ac9b5395-31a0-4d60-816f-10797d134a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:47.095895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f21e9-bce4-4d6e-92a3-998567837dee None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:47.114044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:47.138295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 67/136] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:47.139628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b5395-31a0-4d60-816f-10797d134a85 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:47.145068 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782ca2a-bb00-4567-a21b-76a57b50abc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:47.145796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782ca2a-bb00-4567-a21b-76a57b50abc7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:47.146164 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782ca2a-bb00-4567-a21b-76a57b50abc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:47.146510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782ca2a-bb00-4567-a21b-76a57b50abc7 None admin] PATH_INFO: `/v3/projects/b248d95f957545bf93dbe6d1bca7e819` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:47.147774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782ca2a-bb00-4567-a21b-76a57b50abc7 None admin] RBAC: Authorizing `identity:get_project(project_id=b248d95f957545bf93dbe6d1bca7e819)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:47.149929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782ca2a-bb00-4567-a21b-76a57b50abc7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:47.151728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 70/137] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:46 2022] GET /identity/v3/projects/b248d95f957545bf93dbe6d1bca7e819 => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:47.157484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782ca2a-bb00-4567-a21b-76a57b50abc7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:47.217183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:47.320530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b5395-31a0-4d60-816f-10797d134a85 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:47.324751 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782ca2a-bb00-4567-a21b-76a57b50abc7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:47.390753 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67251928-58a4-4aad-98df-2927ba22ffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:47.391760 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9701f9d-1951-49d4-973e-d7922be29a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:47.392685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67251928-58a4-4aad-98df-2927ba22ffe8 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:47.393542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9701f9d-1951-49d4-973e-d7922be29a24 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:47.394020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67251928-58a4-4aad-98df-2927ba22ffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:47.394489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9701f9d-1951-49d4-973e-d7922be29a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:47.395053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9701f9d-1951-49d4-973e-d7922be29a24 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461/users/ad45b1b3038c4a20809d31f56bf8ddf8/roles/5e35afebe51a448a9ee3ed338209d739` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:47.395496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67251928-58a4-4aad-98df-2927ba22ffe8 None admin] PATH_INFO: `/v3/projects/b248d95f957545bf93dbe6d1bca7e819/users/ad45b1b3038c4a20809d31f56bf8ddf8/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:47.399580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67251928-58a4-4aad-98df-2927ba22ffe8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b248d95f957545bf93dbe6d1bca7e819, user_id=ad45b1b3038c4a20809d31f56bf8ddf8, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:47.400424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9701f9d-1951-49d4-973e-d7922be29a24 None admin] RBAC: Authorizing `identity:create_grant(project_id=97e41b93d02a4c21aed2b712c418d461, user_id=ad45b1b3038c4a20809d31f56bf8ddf8, role_id=5e35afebe51a448a9ee3ed338209d739)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:47.402980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67251928-58a4-4aad-98df-2927ba22ffe8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:47.403772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9701f9d-1951-49d4-973e-d7922be29a24 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:47.436176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 68/138] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:39:47 2022] PUT /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461/users/ad45b1b3038c4a20809d31f56bf8ddf8/roles/5e35afebe51a448a9ee3ed338209d739 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:39:47.443345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 71/139] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:39:47 2022] PUT /identity/v3/projects/b248d95f957545bf93dbe6d1bca7e819/users/ad45b1b3038c4a20809d31f56bf8ddf8/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:39:47.643580 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9701f9d-1951-49d4-973e-d7922be29a24 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:47.684668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:47.763806 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9701f9d-1951-49d4-973e-d7922be29a24 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:47.804590 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4fcbf-193b-48e9-921b-96b786cdc79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:47.805242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4fcbf-193b-48e9-921b-96b786cdc79c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:47.805527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4fcbf-193b-48e9-921b-96b786cdc79c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:47.805801 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4fcbf-193b-48e9-921b-96b786cdc79c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:47.807499 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4fcbf-193b-48e9-921b-96b786cdc79c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:47.808966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4fcbf-193b-48e9-921b-96b786cdc79c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:47.810884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 69/140] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:39:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:47.816570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67251928-58a4-4aad-98df-2927ba22ffe8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:47.932329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67251928-58a4-4aad-98df-2927ba22ffe8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:47.945600 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:47.986181 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ad73e-7971-49f9-95a9-610e416595bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:47.987187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ad73e-7971-49f9-95a9-610e416595bb None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:47.987656 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ad73e-7971-49f9-95a9-610e416595bb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:47.988111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ad73e-7971-49f9-95a9-610e416595bb None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:47.989047 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ad73e-7971-49f9-95a9-610e416595bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:47.991235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ad73e-7971-49f9-95a9-610e416595bb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:48.018435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 72/141] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:39:47 2022] POST /identity/v3/users => generated 283 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:39:48.516673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b326533-a98e-4ff2-9cbb-f208369128b4 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:48.517229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b326533-a98e-4ff2-9cbb-f208369128b4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:48.517229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b326533-a98e-4ff2-9cbb-f208369128b4 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:48.518835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 70/142] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:48.523961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d34e1-d3fd-4668-a619-13a6c9e4b2d8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:48.524365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d34e1-d3fd-4668-a619-13a6c9e4b2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:48.524530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d34e1-d3fd-4668-a619-13a6c9e4b2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:48.552215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e03d34e1-d3fd-4668-a619-13a6c9e4b2d8 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:48.554001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e03d34e1-d3fd-4668-a619-13a6c9e4b2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:48.636758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 73/143] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:49.171582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b326533-a98e-4ff2-9cbb-f208369128b4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:49.303321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b326533-a98e-4ff2-9cbb-f208369128b4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:49.305404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:49.340757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01035829-a2b0-4eaf-8d17-ef8bb5058b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:49.341393 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01035829-a2b0-4eaf-8d17-ef8bb5058b74 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:49.341675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01035829-a2b0-4eaf-8d17-ef8bb5058b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:49.341949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01035829-a2b0-4eaf-8d17-ef8bb5058b74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:49.353208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01035829-a2b0-4eaf-8d17-ef8bb5058b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-01035829-a2b0-4eaf-8d17-ef8bb5058b74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:49.358115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:49.359023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:49.359873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:49.359873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:49.359873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:49.359873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:49.359873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:49.359873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:49.359873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:49.359873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:49.359873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:49.359873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:49.359873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:39:49.359873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:39:49.359873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 71/144] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:49.367018 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d34e1-d3fd-4668-a619-13a6c9e4b2d8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:49.371586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72caa5f-1835-43ea-b03a-d6a70bb188cc None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:49.371875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72caa5f-1835-43ea-b03a-d6a70bb188cc None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:49.372155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72caa5f-1835-43ea-b03a-d6a70bb188cc None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:49.373490 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 72/145] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:39:49.381143 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd36aea-3927-4eb1-971e-4359beebc986 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:49.381954 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd36aea-3927-4eb1-971e-4359beebc986 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:49.382238 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd36aea-3927-4eb1-971e-4359beebc986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:49.400639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ecd36aea-3927-4eb1-971e-4359beebc986 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:49.401832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ecd36aea-3927-4eb1-971e-4359beebc986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:49.494754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 73/146] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:49.499097 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:49.508289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d34e1-d3fd-4668-a619-13a6c9e4b2d8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:49.557703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54317216-2b6b-47de-a79c-3e45354b6c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:49.559101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54317216-2b6b-47de-a79c-3e45354b6c66 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:49.559580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54317216-2b6b-47de-a79c-3e45354b6c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:49.560056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54317216-2b6b-47de-a79c-3e45354b6c66 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:49.560918 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54317216-2b6b-47de-a79c-3e45354b6c66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:49.561411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54317216-2b6b-47de-a79c-3e45354b6c66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:49.563081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54317216-2b6b-47de-a79c-3e45354b6c66 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:49.572788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 74/147] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:39:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:49.579005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd36aea-3927-4eb1-971e-4359beebc986 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:49.689445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:49.701856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd36aea-3927-4eb1-971e-4359beebc986 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:49.745876 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da155cd7-a16c-4902-9c60-8daac5ae3598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:49.746530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da155cd7-a16c-4902-9c60-8daac5ae3598 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:49.746854 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da155cd7-a16c-4902-9c60-8daac5ae3598 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:49.747158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da155cd7-a16c-4902-9c60-8daac5ae3598 None admin] PATH_INFO: `/v3/users/b2ae7ea5649a43958b37cc7898c7d75e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:49.748335 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da155cd7-a16c-4902-9c60-8daac5ae3598 None admin] RBAC: Authorizing `identity:get_user(user_id=b2ae7ea5649a43958b37cc7898c7d75e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:49.749774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da155cd7-a16c-4902-9c60-8daac5ae3598 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:49.751387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 74/148] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:49 2022] GET /identity/v3/users/b2ae7ea5649a43958b37cc7898c7d75e => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:49.757463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54317216-2b6b-47de-a79c-3e45354b6c66 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:49.906818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54317216-2b6b-47de-a79c-3e45354b6c66 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:49.950244 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc58c0-e2c5-4fda-a9d4-58a722511a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:49.951252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc58c0-e2c5-4fda-a9d4-58a722511a80 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:49.951784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc58c0-e2c5-4fda-a9d4-58a722511a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:49.952248 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc58c0-e2c5-4fda-a9d4-58a722511a80 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:49.953605 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc58c0-e2c5-4fda-a9d4-58a722511a80 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:49.955283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc58c0-e2c5-4fda-a9d4-58a722511a80 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:49.957129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 75/149] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:49 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:49.963807 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da155cd7-a16c-4902-9c60-8daac5ae3598 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:50.020828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc58c0-e2c5-4fda-a9d4-58a722511a80 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:50.060762 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:50.099641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da155cd7-a16c-4902-9c60-8daac5ae3598 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:50.140784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc58c0-e2c5-4fda-a9d4-58a722511a80 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:50.155539 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa91c59-905e-459c-9666-1a5a0f8d3f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:50.156235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa91c59-905e-459c-9666-1a5a0f8d3f8c None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:50.156883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa91c59-905e-459c-9666-1a5a0f8d3f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:50.156883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa91c59-905e-459c-9666-1a5a0f8d3f8c None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461/users/b2ae7ea5649a43958b37cc7898c7d75e/roles/ec07f55a1c534d79af2517e37b41fc75` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:50.159232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa91c59-905e-459c-9666-1a5a0f8d3f8c None admin] RBAC: Authorizing `identity:create_grant(project_id=97e41b93d02a4c21aed2b712c418d461, user_id=b2ae7ea5649a43958b37cc7898c7d75e, role_id=ec07f55a1c534d79af2517e37b41fc75)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:50.160351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa91c59-905e-459c-9666-1a5a0f8d3f8c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:50.191498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e6cd4-adbf-46a8-b564-775ef5bad7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:50.193046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e6cd4-adbf-46a8-b564-775ef5bad7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:50.194517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e6cd4-adbf-46a8-b564-775ef5bad7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:50.195131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 75/150] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:39:49 2022] PUT /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461/users/b2ae7ea5649a43958b37cc7898c7d75e/roles/ec07f55a1c534d79af2517e37b41fc75 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:39:50.195750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e6cd4-adbf-46a8-b564-775ef5bad7d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:50.210192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e6cd4-adbf-46a8-b564-775ef5bad7d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-985e6cd4-adbf-46a8-b564-775ef5bad7d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:50.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:50.229191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:50.229964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:50.229964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:50.229964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:50.229964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:50.229964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:50.229964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:50.229964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:50.229964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:50.229964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:50.229964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:50.229964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:50.229964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:50.232579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 76/151] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:39:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:39:50.243907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa91c59-905e-459c-9666-1a5a0f8d3f8c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:50.290671 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:50.385248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa91c59-905e-459c-9666-1a5a0f8d3f8c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:50.440050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3df9bd-fc73-40e2-acba-06e5787d841c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:50.440451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3df9bd-fc73-40e2-acba-06e5787d841c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:50.440724 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3df9bd-fc73-40e2-acba-06e5787d841c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:50.442292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 77/152] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:50.447922 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebd694-4e15-4ae9-bcac-d61a81468041 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:50.448117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b6ef3-0f4a-4a43-a3a8-b9a757b08702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:50.448366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebd694-4e15-4ae9-bcac-d61a81468041 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:50.448533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebd694-4e15-4ae9-bcac-d61a81468041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:50.448620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6ef3-0f4a-4a43-a3a8-b9a757b08702 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:50.448839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6ef3-0f4a-4a43-a3a8-b9a757b08702 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:50.449113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6ef3-0f4a-4a43-a3a8-b9a757b08702 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:50.449791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b6ef3-0f4a-4a43-a3a8-b9a757b08702 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:50.450095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b6ef3-0f4a-4a43-a3a8-b9a757b08702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:50.451620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b6ef3-0f4a-4a43-a3a8-b9a757b08702 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:50.470149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 76/153] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:50.479753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b6ef3-0f4a-4a43-a3a8-b9a757b08702 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:50.482063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-11ebd694-4e15-4ae9-bcac-d61a81468041 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:50.483311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-11ebd694-4e15-4ae9-bcac-d61a81468041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:50.644440 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 78/154] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:39:50.645543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c55d63-ff88-4cce-b9ff-7d119f8c1556 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:50.645822 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c55d63-ff88-4cce-b9ff-7d119f8c1556 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:50.646087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c55d63-ff88-4cce-b9ff-7d119f8c1556 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:50.647408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 79/155] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:50.654151 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a364072-2c76-457b-8270-578ab107a04b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:50.654428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a364072-2c76-457b-8270-578ab107a04b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:50.654695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a364072-2c76-457b-8270-578ab107a04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:50.685532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:50.690480 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1a364072-2c76-457b-8270-578ab107a04b None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:50.700109 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1a364072-2c76-457b-8270-578ab107a04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:50.729772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b6ef3-0f4a-4a43-a3a8-b9a757b08702 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:50.733367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:50.800356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845ce0a-daf3-433b-a1fa-7cad978e51ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:50.801003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845ce0a-daf3-433b-a1fa-7cad978e51ed None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:50.801284 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845ce0a-daf3-433b-a1fa-7cad978e51ed None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:50.801551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845ce0a-daf3-433b-a1fa-7cad978e51ed None admin] PATH_INFO: `/v3/users/c252561ac77c437ba347f9d9a260e990` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:50.802699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845ce0a-daf3-433b-a1fa-7cad978e51ed None admin] RBAC: Authorizing `identity:get_user(user_id=c252561ac77c437ba347f9d9a260e990)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:50.804765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845ce0a-daf3-433b-a1fa-7cad978e51ed None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:50.806348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 77/156] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:50 2022] GET /identity/v3/users/c252561ac77c437ba347f9d9a260e990 => generated 247 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:50.812206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845ce0a-daf3-433b-a1fa-7cad978e51ed None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:50.872084 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 80/157] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:39:50.937593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845ce0a-daf3-433b-a1fa-7cad978e51ed None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:50.980760 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055eb04-c300-48b7-936a-ddbaee9b0e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:50.981297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055eb04-c300-48b7-936a-ddbaee9b0e38 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:50.981578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055eb04-c300-48b7-936a-ddbaee9b0e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:50.981849 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055eb04-c300-48b7-936a-ddbaee9b0e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:51.006494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:51.061482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055eb04-c300-48b7-936a-ddbaee9b0e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:51.062963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055eb04-c300-48b7-936a-ddbaee9b0e38 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:51.103807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a364072-2c76-457b-8270-578ab107a04b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:51.181963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 78/158] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:39:51.188319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055eb04-c300-48b7-936a-ddbaee9b0e38 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:51.267467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:51.331824 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055eb04-c300-48b7-936a-ddbaee9b0e38 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:51.382720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67206e1-e0d3-4f87-8d36-56affed28905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:51.383380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67206e1-e0d3-4f87-8d36-56affed28905 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:51.383657 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67206e1-e0d3-4f87-8d36-56affed28905 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:51.383925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67206e1-e0d3-4f87-8d36-56affed28905 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:51.385074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67206e1-e0d3-4f87-8d36-56affed28905 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:51.386509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67206e1-e0d3-4f87-8d36-56affed28905 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:51.388345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 79/159] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:51 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:51.394285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67206e1-e0d3-4f87-8d36-56affed28905 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:51.396089 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a364072-2c76-457b-8270-578ab107a04b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:51.491526 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf915a-4104-4207-a8cb-fb7307f18741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:51.492191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf915a-4104-4207-a8cb-fb7307f18741 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:51.492473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf915a-4104-4207-a8cb-fb7307f18741 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:51.492744 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf915a-4104-4207-a8cb-fb7307f18741 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:51.521172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf915a-4104-4207-a8cb-fb7307f18741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:51.525767 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67206e1-e0d3-4f87-8d36-56affed28905 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-aeaf915a-4104-4207-a8cb-fb7307f18741 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:51.526140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:51.527008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:51.527809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:51.527809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:51.527809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:51.527809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:51.527809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:51.527809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:51.527809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:51.527809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:51.527809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:51.527809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:51.527809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:51.527809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:51.527809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 81/160] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:51.535708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf915a-4104-4207-a8cb-fb7307f18741 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:51.565368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:51.567854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:51.586754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8113c-e4ca-4d1a-88c1-fe58dfee56aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:51.586754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8113c-e4ca-4d1a-88c1-fe58dfee56aa None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:51.586754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8113c-e4ca-4d1a-88c1-fe58dfee56aa None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:51.586754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8113c-e4ca-4d1a-88c1-fe58dfee56aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:51.587225 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8113c-e4ca-4d1a-88c1-fe58dfee56aa None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=97e41b93d02a4c21aed2b712c418d461, user.id=c252561ac77c437ba347f9d9a260e990) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:51.587225 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8113c-e4ca-4d1a-88c1-fe58dfee56aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:51.587225 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8113c-e4ca-4d1a-88c1-fe58dfee56aa None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:51.595595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 80/161] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:39:51 2022] GET /identity/v3/role_assignments?user.id=c252561ac77c437ba347f9d9a260e990&scope.project.id=97e41b93d02a4c21aed2b712c418d461&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:51.597081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8113c-e4ca-4d1a-88c1-fe58dfee56aa None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:51.749213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8113c-e4ca-4d1a-88c1-fe58dfee56aa None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:51.781007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf915a-4104-4207-a8cb-fb7307f18741 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:51.805055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181c6c7-361c-4db2-a17c-e7663cb322fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:51.805709 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c6c7-361c-4db2-a17c-e7663cb322fc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:51.805984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c6c7-361c-4db2-a17c-e7663cb322fc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:51.806250 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c6c7-361c-4db2-a17c-e7663cb322fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:51.828737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181c6c7-361c-4db2-a17c-e7663cb322fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-6181c6c7-361c-4db2-a17c-e7663cb322fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:51.837196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:51.838188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:51.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:51.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:51.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:51.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:51.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:51.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:51.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:51.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:51.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:51.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:51.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:39:51.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:39:51.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 81/162] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:39:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:39:51.844031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628afba1-110f-46e0-8f51-2a8207351f77 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:51.844315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628afba1-110f-46e0-8f51-2a8207351f77 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:51.844586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628afba1-110f-46e0-8f51-2a8207351f77 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:51.845970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 82/163] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:51.855346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7f130-d379-4390-99f7-ecd97e8c96f8 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:51.855635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7f130-d379-4390-99f7-ecd97e8c96f8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:51.855904 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7f130-d379-4390-99f7-ecd97e8c96f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:51.860530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ccf17-5550-4eb1-ad75-4456ae52bb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:51.861156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ccf17-5550-4eb1-ad75-4456ae52bb6f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:51.861434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ccf17-5550-4eb1-ad75-4456ae52bb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:51.861800 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ccf17-5550-4eb1-ad75-4456ae52bb6f None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:51.863488 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ccf17-5550-4eb1-ad75-4456ae52bb6f None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:51.863798 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ccf17-5550-4eb1-ad75-4456ae52bb6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:51.866066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ccf17-5550-4eb1-ad75-4456ae52bb6f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:51.884059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-49f7f130-d379-4390-99f7-ecd97e8c96f8 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:51.885278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-49f7f130-d379-4390-99f7-ecd97e8c96f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:51.886253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 82/164] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:39:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:51.887254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ccf17-5550-4eb1-ad75-4456ae52bb6f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:51.950399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:51.997388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 83/165] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:51.998271 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7f130-d379-4390-99f7-ecd97e8c96f8 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:52.079584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:52.140613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7f130-d379-4390-99f7-ecd97e8c96f8 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:52.169132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ccf17-5550-4eb1-ad75-4456ae52bb6f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:52.200383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac08cb-13ab-4679-944b-f534244daedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:52.201030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac08cb-13ab-4679-944b-f534244daedf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:52.201313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac08cb-13ab-4679-944b-f534244daedf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:52.201570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac08cb-13ab-4679-944b-f534244daedf None admin] PATH_INFO: `/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:52.202708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac08cb-13ab-4679-944b-f534244daedf None admin] RBAC: Authorizing `identity:get_user(user_id=ad45b1b3038c4a20809d31f56bf8ddf8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:52.204173 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac08cb-13ab-4679-944b-f534244daedf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:52.205961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 84/166] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:51 2022] GET /identity/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:52.212944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac08cb-13ab-4679-944b-f534244daedf None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:52.255441 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def68ab-d681-419f-87cc-552d7982e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:52.256071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def68ab-d681-419f-87cc-552d7982e97b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:52.256358 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def68ab-d681-419f-87cc-552d7982e97b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:52.256633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def68ab-d681-419f-87cc-552d7982e97b None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:52.257344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def68ab-d681-419f-87cc-552d7982e97b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:52.257647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def68ab-d681-419f-87cc-552d7982e97b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:52.259063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def68ab-d681-419f-87cc-552d7982e97b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:52.270035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 83/167] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:39:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:52.275836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def68ab-d681-419f-87cc-552d7982e97b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:52.276385 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:52.346130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac08cb-13ab-4679-944b-f534244daedf None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:52.400402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285be8b2-9c05-4693-b499-3db35414f5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:52.401020 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285be8b2-9c05-4693-b499-3db35414f5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:52.401297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285be8b2-9c05-4693-b499-3db35414f5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:52.401565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285be8b2-9c05-4693-b499-3db35414f5e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:52.468126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def68ab-d681-419f-87cc-552d7982e97b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:52.505322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285be8b2-9c05-4693-b499-3db35414f5e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:52.506839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285be8b2-9c05-4693-b499-3db35414f5e1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:52.512647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:52.528777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676da377-076a-4863-92db-ca67f2832fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:52.529432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676da377-076a-4863-92db-ca67f2832fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:52.529716 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676da377-076a-4863-92db-ca67f2832fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:52.529996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676da377-076a-4863-92db-ca67f2832fa5 None admin] PATH_INFO: `/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:52.535426 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676da377-076a-4863-92db-ca67f2832fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=ad45b1b3038c4a20809d31f56bf8ddf8)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:52.536903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676da377-076a-4863-92db-ca67f2832fa5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:52.538911 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 84/168] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:52 2022] GET /identity/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:52.544722 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676da377-076a-4863-92db-ca67f2832fa5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:52.568867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:52.659273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 85/169] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:39:52.660065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285be8b2-9c05-4693-b499-3db35414f5e1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:52.669631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676da377-076a-4863-92db-ca67f2832fa5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:52.721287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49929887-e3b7-47a8-be46-48a41e681227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:52.721908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49929887-e3b7-47a8-be46-48a41e681227 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:52.722187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49929887-e3b7-47a8-be46-48a41e681227 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:52.722453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49929887-e3b7-47a8-be46-48a41e681227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:52.809192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:52.812712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49929887-e3b7-47a8-be46-48a41e681227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:52.814418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49929887-e3b7-47a8-be46-48a41e681227 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:52.838142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285be8b2-9c05-4693-b499-3db35414f5e1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:52.900475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23374038-a0a7-4f54-bb32-62e99a6299b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:52.901479 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374038-a0a7-4f54-bb32-62e99a6299b5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:52.901949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374038-a0a7-4f54-bb32-62e99a6299b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:52.902415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374038-a0a7-4f54-bb32-62e99a6299b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:52.911125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:52.918867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 85/170] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:39:52.921262 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49929887-e3b7-47a8-be46-48a41e681227 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:52.921770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23374038-a0a7-4f54-bb32-62e99a6299b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-23374038-a0a7-4f54-bb32-62e99a6299b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:52.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:52.931568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:52.932423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:52.932423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:52.932423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:52.932423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:52.932423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:52.932423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:52.932423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:52.932423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:52.932423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:52.932423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:52.932423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:52.932423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:39:52.934709 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 86/171] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:52.935712 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23374038-a0a7-4f54-bb32-62e99a6299b5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:53.020118 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:53.023731 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49929887-e3b7-47a8-be46-48a41e681227 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:53.048504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23374038-a0a7-4f54-bb32-62e99a6299b5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:53.059419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a091a-7694-4b6a-a460-6fdb15175baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:53.060139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a091a-7694-4b6a-a460-6fdb15175baf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:53.060334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a091a-7694-4b6a-a460-6fdb15175baf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:53.060571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a091a-7694-4b6a-a460-6fdb15175baf None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:53.061677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a091a-7694-4b6a-a460-6fdb15175baf None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:53.063278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a091a-7694-4b6a-a460-6fdb15175baf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:53.068843 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 86/172] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:52 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:53.070219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a091a-7694-4b6a-a460-6fdb15175baf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:53.088332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70098688-675d-4613-88b0-8165e1756d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:53.089298 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098688-675d-4613-88b0-8165e1756d68 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:53.089867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098688-675d-4613-88b0-8165e1756d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:53.090478 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098688-675d-4613-88b0-8165e1756d68 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:53.091857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70098688-675d-4613-88b0-8165e1756d68 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:53.093632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70098688-675d-4613-88b0-8165e1756d68 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:53.095745 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 87/173] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:52 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:53.096687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70098688-675d-4613-88b0-8165e1756d68 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:53.169307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:53.179873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a091a-7694-4b6a-a460-6fdb15175baf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:53.208202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70098688-675d-4613-88b0-8165e1756d68 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:53.214843 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebf35e-95f7-4ba9-bc36-91b1c605433b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:53.215458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebf35e-95f7-4ba9-bc36-91b1c605433b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:53.215729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebf35e-95f7-4ba9-bc36-91b1c605433b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:53.215993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebf35e-95f7-4ba9-bc36-91b1c605433b None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:53.216647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebf35e-95f7-4ba9-bc36-91b1c605433b None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:53.216943 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebf35e-95f7-4ba9-bc36-91b1c605433b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:53.218304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebf35e-95f7-4ba9-bc36-91b1c605433b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:53.227105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 87/174] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:39:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:53.228012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebf35e-95f7-4ba9-bc36-91b1c605433b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:53.248423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435928cb-2d99-4cef-88aa-33714bb0722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:53.249419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435928cb-2d99-4cef-88aa-33714bb0722b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:53.249927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435928cb-2d99-4cef-88aa-33714bb0722b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:53.250412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435928cb-2d99-4cef-88aa-33714bb0722b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:53.251447 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435928cb-2d99-4cef-88aa-33714bb0722b None admin] RBAC: Adding query filter params (role.id=f5585030f686473c89e1de214b25b6ff, scope.project.id=97e41b93d02a4c21aed2b712c418d461, user.id=ad45b1b3038c4a20809d31f56bf8ddf8) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:53.251988 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435928cb-2d99-4cef-88aa-33714bb0722b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:53.253882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435928cb-2d99-4cef-88aa-33714bb0722b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:53.257205 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:53.262260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 88/175] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:39:53 2022] GET /identity/v3/role_assignments?user.id=ad45b1b3038c4a20809d31f56bf8ddf8&scope.project.id=97e41b93d02a4c21aed2b712c418d461&role.id=f5585030f686473c89e1de214b25b6ff => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:53.263579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435928cb-2d99-4cef-88aa-33714bb0722b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:53.381214 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebf35e-95f7-4ba9-bc36-91b1c605433b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:53.391424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435928cb-2d99-4cef-88aa-33714bb0722b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:53.428118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:53.442830 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db96df-c1da-4ca7-8e4b-3628caf60ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:53.442830 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db96df-c1da-4ca7-8e4b-3628caf60ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:53.442830 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db96df-c1da-4ca7-8e4b-3628caf60ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:53.442830 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db96df-c1da-4ca7-8e4b-3628caf60ad3 None admin] PATH_INFO: `/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:53.443197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db96df-c1da-4ca7-8e4b-3628caf60ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=ad45b1b3038c4a20809d31f56bf8ddf8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:53.444406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db96df-c1da-4ca7-8e4b-3628caf60ad3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:53.446438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 89/176] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:53 2022] GET /identity/v3/users/ad45b1b3038c4a20809d31f56bf8ddf8 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:53.452083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db96df-c1da-4ca7-8e4b-3628caf60ad3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:53.457367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6ed8d-579b-4927-b82e-14687dbb9a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:53.458040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6ed8d-579b-4927-b82e-14687dbb9a09 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:53.458320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6ed8d-579b-4927-b82e-14687dbb9a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:53.458590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6ed8d-579b-4927-b82e-14687dbb9a09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:53.459643 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6ed8d-579b-4927-b82e-14687dbb9a09 None admin] RBAC: Adding query filter params (role.id=5e35afebe51a448a9ee3ed338209d739, scope.project.id=97e41b93d02a4c21aed2b712c418d461, user.id=ad45b1b3038c4a20809d31f56bf8ddf8) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:53.459947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6ed8d-579b-4927-b82e-14687dbb9a09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:53.461986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6ed8d-579b-4927-b82e-14687dbb9a09 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:53.474150 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 88/177] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:39:53 2022] GET /identity/v3/role_assignments?user.id=ad45b1b3038c4a20809d31f56bf8ddf8&scope.project.id=97e41b93d02a4c21aed2b712c418d461&role.id=5e35afebe51a448a9ee3ed338209d739 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:53.546805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f205963-38d3-41ea-97b5-9d9e73a3fd23 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:53.547123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f205963-38d3-41ea-97b5-9d9e73a3fd23 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:53.547356 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f205963-38d3-41ea-97b5-9d9e73a3fd23 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:53.548806 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 89/178] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:39:53.560261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf0b79-a995-4c65-b197-8252bb37f581 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:53.560602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf0b79-a995-4c65-b197-8252bb37f581 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:53.560793 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf0b79-a995-4c65-b197-8252bb37f581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:53.578962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db96df-c1da-4ca7-8e4b-3628caf60ad3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:53.593607 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8bdf0b79-a995-4c65-b197-8252bb37f581 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:53.594887 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8bdf0b79-a995-4c65-b197-8252bb37f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:53.621430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9c6c3-abd8-427e-8d2a-dee44d8148d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:53.622059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9c6c3-abd8-427e-8d2a-dee44d8148d0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:53.622333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9c6c3-abd8-427e-8d2a-dee44d8148d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:53.622599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9c6c3-abd8-427e-8d2a-dee44d8148d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:53.710703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:53.714252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9c6c3-abd8-427e-8d2a-dee44d8148d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:53.715912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9c6c3-abd8-427e-8d2a-dee44d8148d0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:53.736059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 90/179] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:53.826151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 90/180] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:39:53.831954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf0b79-a995-4c65-b197-8252bb37f581 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:53.870310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:53.971924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf0b79-a995-4c65-b197-8252bb37f581 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:54.011435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f8ec0-1305-4800-88db-7052308410a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:54.012069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f8ec0-1305-4800-88db-7052308410a8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:54.012338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f8ec0-1305-4800-88db-7052308410a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:54.012603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f8ec0-1305-4800-88db-7052308410a8 None admin] PATH_INFO: `/v3/projects/b248d95f957545bf93dbe6d1bca7e819` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:54.013714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f8ec0-1305-4800-88db-7052308410a8 None admin] RBAC: Authorizing `identity:get_project(project_id=b248d95f957545bf93dbe6d1bca7e819)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:54.015498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f8ec0-1305-4800-88db-7052308410a8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:54.017149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 91/181] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:53 2022] GET /identity/v3/projects/b248d95f957545bf93dbe6d1bca7e819 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:54.023786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9c6c3-abd8-427e-8d2a-dee44d8148d0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:54.118713 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f8ec0-1305-4800-88db-7052308410a8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:54.174856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:54.181044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9c6c3-abd8-427e-8d2a-dee44d8148d0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:54.275748 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05651d-43cf-45ad-8cc2-3f2f9285fc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:54.276275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05651d-43cf-45ad-8cc2-3f2f9285fc3a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:54.276547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05651d-43cf-45ad-8cc2-3f2f9285fc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:54.276812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05651d-43cf-45ad-8cc2-3f2f9285fc3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:54.277541 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05651d-43cf-45ad-8cc2-3f2f9285fc3a None admin] RBAC: Adding query filter params (role.id=f5585030f686473c89e1de214b25b6ff, scope.project.id=b248d95f957545bf93dbe6d1bca7e819, user.id=ad45b1b3038c4a20809d31f56bf8ddf8) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:54.277838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05651d-43cf-45ad-8cc2-3f2f9285fc3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:54.283684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05651d-43cf-45ad-8cc2-3f2f9285fc3a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:54.292851 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:54.297576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 91/182] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:39:54 2022] GET /identity/v3/role_assignments?user.id=ad45b1b3038c4a20809d31f56bf8ddf8&scope.project.id=b248d95f957545bf93dbe6d1bca7e819&role.id=f5585030f686473c89e1de214b25b6ff => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:54.301148 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac12f74-95cb-4ff1-b3b6-3c2c45f6aaa9 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:54.301434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac12f74-95cb-4ff1-b3b6-3c2c45f6aaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:54.301705 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac12f74-95cb-4ff1-b3b6-3c2c45f6aaa9 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:54.303202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 92/183] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:39:54.309939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7f030-0df4-4a99-abb9-aca3f4353daf None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:54.310213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7f030-0df4-4a99-abb9-aca3f4353daf None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:54.310483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7f030-0df4-4a99-abb9-aca3f4353daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:54.311796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f8ec0-1305-4800-88db-7052308410a8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:54.329527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-56a7f030-0df4-4a99-abb9-aca3f4353daf None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:54.330763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-56a7f030-0df4-4a99-abb9-aca3f4353daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:54.353605 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec299fb-d467-4ee2-bf2a-2cf7f2ac31be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:54.354768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec299fb-d467-4ee2-bf2a-2cf7f2ac31be None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:54.355242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec299fb-d467-4ee2-bf2a-2cf7f2ac31be None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:54.355690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec299fb-d467-4ee2-bf2a-2cf7f2ac31be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:54.368553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec299fb-d467-4ee2-bf2a-2cf7f2ac31be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9ec299fb-d467-4ee2-bf2a-2cf7f2ac31be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:54.373891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:54.376156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 92/184] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:39:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:39:54.378719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df821557-366b-437f-b828-466109a37212 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:54.380690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df821557-366b-437f-b828-466109a37212 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:54.380690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df821557-366b-437f-b828-466109a37212 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:54.380690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 93/185] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:54.380690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab38134-7ec5-47d2-921f-5167bdf34197 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:54.380690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab38134-7ec5-47d2-921f-5167bdf34197 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:54.380690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab38134-7ec5-47d2-921f-5167bdf34197 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:54.386811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 94/186] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:54.386811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39fce6-0170-4454-90fc-d322d8a09cb9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:54.386811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39fce6-0170-4454-90fc-d322d8a09cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:54.386811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39fce6-0170-4454-90fc-d322d8a09cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:54.405173 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 93/187] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:54.406041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7f030-0df4-4a99-abb9-aca3f4353daf None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:54.406582 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4b39fce6-0170-4454-90fc-d322d8a09cb9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:54.407960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4b39fce6-0170-4454-90fc-d322d8a09cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:54.507953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 95/188] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:54.509570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4bcff-5afa-435b-8a52-bd527fb20dd0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:54.510073 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4bcff-5afa-435b-8a52-bd527fb20dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:54.510543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4bcff-5afa-435b-8a52-bd527fb20dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:54.532271 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:54.533506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2cd4bcff-5afa-435b-8a52-bd527fb20dd0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:54.535658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2cd4bcff-5afa-435b-8a52-bd527fb20dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:54.540576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7f030-0df4-4a99-abb9-aca3f4353daf None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:54.582029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63dd37-72cb-48a0-b620-745129137548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:54.582405 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63dd37-72cb-48a0-b620-745129137548 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:54.582818 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63dd37-72cb-48a0-b620-745129137548 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:54.583189 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63dd37-72cb-48a0-b620-745129137548 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:54.585059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63dd37-72cb-48a0-b620-745129137548 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:54.585562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63dd37-72cb-48a0-b620-745129137548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:54.587062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63dd37-72cb-48a0-b620-745129137548 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:54.597094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 94/189] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:54.603652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63dd37-72cb-48a0-b620-745129137548 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:54.625388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 96/190] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:54.701798 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4bcff-5afa-435b-8a52-bd527fb20dd0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:54.716936 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:54.722885 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63dd37-72cb-48a0-b620-745129137548 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:54.766952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762cd0c-cf67-4519-8825-f26cb928882d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:54.767183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762cd0c-cf67-4519-8825-f26cb928882d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:54.767461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762cd0c-cf67-4519-8825-f26cb928882d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:54.767752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762cd0c-cf67-4519-8825-f26cb928882d None admin] PATH_INFO: `/v3/users/821f1fb909174a539e7dc2cddec28838` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:54.785796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762cd0c-cf67-4519-8825-f26cb928882d None admin] RBAC: Authorizing `identity:get_user(user_id=821f1fb909174a539e7dc2cddec28838)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:54.787612 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762cd0c-cf67-4519-8825-f26cb928882d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:54.795469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 95/191] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:54 2022] GET /identity/v3/users/821f1fb909174a539e7dc2cddec28838 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:54.795632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762cd0c-cf67-4519-8825-f26cb928882d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:54.816016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:54.826571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4bcff-5afa-435b-8a52-bd527fb20dd0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:54.863260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6903b3-e194-4541-8fbf-ab12b3587fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:54.863907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6903b3-e194-4541-8fbf-ab12b3587fbf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:54.864149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6903b3-e194-4541-8fbf-ab12b3587fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:54.864414 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6903b3-e194-4541-8fbf-ab12b3587fbf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:54.877187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6903b3-e194-4541-8fbf-ab12b3587fbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6c6903b3-e194-4541-8fbf-ab12b3587fbf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:54.884407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:54.885298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:54.886081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:54.886081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:54.886081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:54.886081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:54.886081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:54.886081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:54.886081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:54.886081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:54.886081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:54.886081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:54.886081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:39:54.886081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:54.886081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 97/192] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:39:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:54.887545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6903b3-e194-4541-8fbf-ab12b3587fbf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:54.916155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762cd0c-cf67-4519-8825-f26cb928882d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:54.951538 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166c738-0493-4e6e-8544-1bcec686e228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:54.952137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166c738-0493-4e6e-8544-1bcec686e228 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:54.952418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166c738-0493-4e6e-8544-1bcec686e228 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:54.952690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166c738-0493-4e6e-8544-1bcec686e228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:54.960301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:54.991565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6903b3-e194-4541-8fbf-ab12b3587fbf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:55.020451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166c738-0493-4e6e-8544-1bcec686e228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:55.021997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166c738-0493-4e6e-8544-1bcec686e228 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:55.025009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7edb68-d833-4527-907d-2ff0e06cc7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:55.025639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7edb68-d833-4527-907d-2ff0e06cc7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:55.025912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7edb68-d833-4527-907d-2ff0e06cc7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:55.026183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7edb68-d833-4527-907d-2ff0e06cc7b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:55.036095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7edb68-d833-4527-907d-2ff0e06cc7b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:55.037673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4f7edb68-d833-4527-907d-2ff0e06cc7b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:55.041835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:55.042953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:55.042953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:55.042953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:55.042953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:55.042953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:55.042953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:55.042953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:55.042953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:55.042953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:55.042953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:55.042953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:39:55.042953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:55.042953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 98/193] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:55.043961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7edb68-d833-4527-907d-2ff0e06cc7b4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:55.125958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 96/194] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:39:55.127004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166c738-0493-4e6e-8544-1bcec686e228 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:55.141020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7edb68-d833-4527-907d-2ff0e06cc7b4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:55.169602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:55.175758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f800ab-4408-41f4-bb1e-ddefc4233027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:55.176364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f800ab-4408-41f4-bb1e-ddefc4233027 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:55.176641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f800ab-4408-41f4-bb1e-ddefc4233027 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:55.176909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f800ab-4408-41f4-bb1e-ddefc4233027 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:55.177569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f800ab-4408-41f4-bb1e-ddefc4233027 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:55.177871 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f800ab-4408-41f4-bb1e-ddefc4233027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:55.179325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f800ab-4408-41f4-bb1e-ddefc4233027 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:55.187055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 99/195] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:39:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:55.187832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f800ab-4408-41f4-bb1e-ddefc4233027 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:55.233090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166c738-0493-4e6e-8544-1bcec686e228 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:55.247932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:55.267850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec3282-d958-4253-a47f-1468b4431654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:55.268474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec3282-d958-4253-a47f-1468b4431654 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:55.268749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec3282-d958-4253-a47f-1468b4431654 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:55.269016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec3282-d958-4253-a47f-1468b4431654 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:55.270115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec3282-d958-4253-a47f-1468b4431654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:55.271575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec3282-d958-4253-a47f-1468b4431654 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:55.273144 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 97/196] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:39:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:55.273895 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec3282-d958-4253-a47f-1468b4431654 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:55.293525 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f800ab-4408-41f4-bb1e-ddefc4233027 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:55.326366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b5e96-793f-4716-b831-d2cb90e14b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:55.326997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b5e96-793f-4716-b831-d2cb90e14b10 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:55.327286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b5e96-793f-4716-b831-d2cb90e14b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:55.327548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b5e96-793f-4716-b831-d2cb90e14b10 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:55.328210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b5e96-793f-4716-b831-d2cb90e14b10 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:55.328516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b5e96-793f-4716-b831-d2cb90e14b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:55.329880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b5e96-793f-4716-b831-d2cb90e14b10 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:55.338066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 100/197] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:39:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:55.338882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b5e96-793f-4716-b831-d2cb90e14b10 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:55.375257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec3282-d958-4253-a47f-1468b4431654 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:55.392409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:55.408662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad3756-909d-4461-bd5d-efbf91eb5526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:55.409282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad3756-909d-4461-bd5d-efbf91eb5526 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:55.409557 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad3756-909d-4461-bd5d-efbf91eb5526 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:55.409822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad3756-909d-4461-bd5d-efbf91eb5526 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:55.410953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad3756-909d-4461-bd5d-efbf91eb5526 None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:55.412367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad3756-909d-4461-bd5d-efbf91eb5526 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:55.414480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 98/198] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:55 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:55.416694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad3756-909d-4461-bd5d-efbf91eb5526 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:55.441487 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b5e96-793f-4716-b831-d2cb90e14b10 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:55.467015 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:55.475161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0361282-6dd9-42df-9859-d6084de457f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:55.475790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0361282-6dd9-42df-9859-d6084de457f2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:55.476130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0361282-6dd9-42df-9859-d6084de457f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:55.476407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0361282-6dd9-42df-9859-d6084de457f2 None admin] PATH_INFO: `/v3/users/821f1fb909174a539e7dc2cddec28838` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:55.477561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0361282-6dd9-42df-9859-d6084de457f2 None admin] RBAC: Authorizing `identity:get_user(user_id=821f1fb909174a539e7dc2cddec28838)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:55.479034 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0361282-6dd9-42df-9859-d6084de457f2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:55.480597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 101/199] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:55 2022] GET /identity/v3/users/821f1fb909174a539e7dc2cddec28838 => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:55.481355 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0361282-6dd9-42df-9859-d6084de457f2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:55.519426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad3756-909d-4461-bd5d-efbf91eb5526 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:55.552472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af20359-83d7-48e9-85bb-a044e90ca0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:55.553395 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af20359-83d7-48e9-85bb-a044e90ca0b9 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:55.553679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af20359-83d7-48e9-85bb-a044e90ca0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:55.553948 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af20359-83d7-48e9-85bb-a044e90ca0b9 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:55.555133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af20359-83d7-48e9-85bb-a044e90ca0b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:55.556918 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af20359-83d7-48e9-85bb-a044e90ca0b9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:55.578221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0361282-6dd9-42df-9859-d6084de457f2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:55.582502 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 99/200] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:39:55 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:39:55.583410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af20359-83d7-48e9-85bb-a044e90ca0b9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:55.612161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:55.625041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ed552-3b37-4f73-9faa-742cc2232237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:55.625746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ed552-3b37-4f73-9faa-742cc2232237 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:55.626027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ed552-3b37-4f73-9faa-742cc2232237 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:55.626300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ed552-3b37-4f73-9faa-742cc2232237 None admin] PATH_INFO: `/v3/users/b2ae7ea5649a43958b37cc7898c7d75e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:55.627536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ed552-3b37-4f73-9faa-742cc2232237 None admin] RBAC: Authorizing `identity:get_user(user_id=b2ae7ea5649a43958b37cc7898c7d75e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:55.629113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ed552-3b37-4f73-9faa-742cc2232237 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:55.636210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 102/201] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:55 2022] GET /identity/v3/users/b2ae7ea5649a43958b37cc7898c7d75e => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:55.636210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ed552-3b37-4f73-9faa-742cc2232237 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:55.702939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af20359-83d7-48e9-85bb-a044e90ca0b9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:55.713025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:55.745333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ed552-3b37-4f73-9faa-742cc2232237 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:55.746324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb602ac-2571-4d00-8cde-13a89b33c37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:55.747147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb602ac-2571-4d00-8cde-13a89b33c37a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:55.747427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb602ac-2571-4d00-8cde-13a89b33c37a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:55.748548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb602ac-2571-4d00-8cde-13a89b33c37a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:55.749300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb602ac-2571-4d00-8cde-13a89b33c37a None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=c1020531a2814c51b1db55f62f23ea32, user.id=821f1fb909174a539e7dc2cddec28838) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:55.749608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb602ac-2571-4d00-8cde-13a89b33c37a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:55.751103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb602ac-2571-4d00-8cde-13a89b33c37a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:55.758256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 100/202] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:39:55 2022] GET /identity/v3/role_assignments?user.id=821f1fb909174a539e7dc2cddec28838&scope.project.id=c1020531a2814c51b1db55f62f23ea32&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:55.759253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb602ac-2571-4d00-8cde-13a89b33c37a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:55.797099 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659a355-2fed-4255-8611-bc2b463b52c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:55.797732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659a355-2fed-4255-8611-bc2b463b52c3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:55.798011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659a355-2fed-4255-8611-bc2b463b52c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:55.798282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659a355-2fed-4255-8611-bc2b463b52c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:55.877434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:55.889733 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659a355-2fed-4255-8611-bc2b463b52c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:55.891228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659a355-2fed-4255-8611-bc2b463b52c3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:55.915422 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb602ac-2571-4d00-8cde-13a89b33c37a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:55.964789 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e6834-df62-4294-a162-c8856caef0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:55.965403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e6834-df62-4294-a162-c8856caef0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:55.965681 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e6834-df62-4294-a162-c8856caef0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:55.965955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e6834-df62-4294-a162-c8856caef0c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:56.022182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:56.035338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 103/203] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:39:56.045960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659a355-2fed-4255-8611-bc2b463b52c3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:56.061323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e6834-df62-4294-a162-c8856caef0c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:56.063486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e6834-df62-4294-a162-c8856caef0c0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:56.204287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:56.222037 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659a355-2fed-4255-8611-bc2b463b52c3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:56.227777 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 101/204] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:39:56.234202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e6834-df62-4294-a162-c8856caef0c0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:56.277579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c256ef-14db-40a7-8a12-ad4f9b5610eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:56.278461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c256ef-14db-40a7-8a12-ad4f9b5610eb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:56.279062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c256ef-14db-40a7-8a12-ad4f9b5610eb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:56.279487 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c256ef-14db-40a7-8a12-ad4f9b5610eb None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:56.280902 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c256ef-14db-40a7-8a12-ad4f9b5610eb None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:56.282990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c256ef-14db-40a7-8a12-ad4f9b5610eb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:56.284795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 104/205] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:56 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:56.290762 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c256ef-14db-40a7-8a12-ad4f9b5610eb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:56.350115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:56.383964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e6834-df62-4294-a162-c8856caef0c0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:56.419117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c256ef-14db-40a7-8a12-ad4f9b5610eb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:56.447820 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0fd0-840f-4fa7-9544-b957e86900e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:56.448515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0fd0-840f-4fa7-9544-b957e86900e3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:56.448796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0fd0-840f-4fa7-9544-b957e86900e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:56.449071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0fd0-840f-4fa7-9544-b957e86900e3 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:56.455477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee0fd0-840f-4fa7-9544-b957e86900e3 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:56.456876 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee0fd0-840f-4fa7-9544-b957e86900e3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:56.458963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 102/206] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:56 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:56.460402 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e9242-1075-46be-9bc0-d60d6e274929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:56.461782 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e9242-1075-46be-9bc0-d60d6e274929 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:56.462250 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e9242-1075-46be-9bc0-d60d6e274929 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:56.462707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e9242-1075-46be-9bc0-d60d6e274929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:56.463669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e9242-1075-46be-9bc0-d60d6e274929 None admin] RBAC: Adding query filter params (role.id=5e35afebe51a448a9ee3ed338209d739, scope.project.id=c1020531a2814c51b1db55f62f23ea32, user.id=821f1fb909174a539e7dc2cddec28838) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:56.464173 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e9242-1075-46be-9bc0-d60d6e274929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:56.465380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0fd0-840f-4fa7-9544-b957e86900e3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:56.466105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e9242-1075-46be-9bc0-d60d6e274929 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:56.472199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 105/207] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:39:56 2022] GET /identity/v3/role_assignments?user.id=821f1fb909174a539e7dc2cddec28838&scope.project.id=c1020531a2814c51b1db55f62f23ea32&role.id=5e35afebe51a448a9ee3ed338209d739 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:56.601905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0fd0-840f-4fa7-9544-b957e86900e3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:56.640769 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d132d-062d-41d7-b2e5-60b757a970b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:56.641385 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d132d-062d-41d7-b2e5-60b757a970b6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:56.641663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d132d-062d-41d7-b2e5-60b757a970b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:56.641928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d132d-062d-41d7-b2e5-60b757a970b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:56.642664 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d132d-062d-41d7-b2e5-60b757a970b6 None admin] RBAC: Adding query filter params (role.id=ec07f55a1c534d79af2517e37b41fc75, scope.project.id=97e41b93d02a4c21aed2b712c418d461, user.id=b2ae7ea5649a43958b37cc7898c7d75e) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:56.642993 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d132d-062d-41d7-b2e5-60b757a970b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:56.644447 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d132d-062d-41d7-b2e5-60b757a970b6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:56.651476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 103/208] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:39:56 2022] GET /identity/v3/role_assignments?user.id=b2ae7ea5649a43958b37cc7898c7d75e&scope.project.id=97e41b93d02a4c21aed2b712c418d461&role.id=ec07f55a1c534d79af2517e37b41fc75 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:39:58.183405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15565e-cb2c-4a9b-a232-71bd4a780dd9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:58.183955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15565e-cb2c-4a9b-a232-71bd4a780dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:58.183955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15565e-cb2c-4a9b-a232-71bd4a780dd9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:58.185395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 106/209] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:58.191051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458fbf4-ef30-47a8-9572-07d036aeb0d9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:58.191496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458fbf4-ef30-47a8-9572-07d036aeb0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:58.191572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458fbf4-ef30-47a8-9572-07d036aeb0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:58.200076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:58.214150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6458fbf4-ef30-47a8-9572-07d036aeb0d9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:58.215691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6458fbf4-ef30-47a8-9572-07d036aeb0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:58.285526 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c491f34-a90f-48d9-9f46-76125fbfeb9a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:58.285807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c491f34-a90f-48d9-9f46-76125fbfeb9a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:58.286089 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c491f34-a90f-48d9-9f46-76125fbfeb9a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:58.287469 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 107/210] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:39:58.289971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 104/211] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:58.294817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130009f5-ffa0-47fe-8cf6-fc77933b303a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:58.294817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130009f5-ffa0-47fe-8cf6-fc77933b303a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:58.294817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130009f5-ffa0-47fe-8cf6-fc77933b303a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:58.311810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-130009f5-ffa0-47fe-8cf6-fc77933b303a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:58.313002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-130009f5-ffa0-47fe-8cf6-fc77933b303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:58.339913 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e794f3-082d-42da-80bc-57e1dabf847d None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:58.340198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e794f3-082d-42da-80bc-57e1dabf847d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:58.340476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e794f3-082d-42da-80bc-57e1dabf847d None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:58.341817 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 105/212] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:39:58.345861 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:58.346713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0ee0-d4da-459f-b600-6a87fdbdc572 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:58.347023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0ee0-d4da-459f-b600-6a87fdbdc572 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:58.347293 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0ee0-d4da-459f-b600-6a87fdbdc572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:58.365787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4e9b0ee0-d4da-459f-b600-6a87fdbdc572 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:58.366978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4e9b0ee0-d4da-459f-b600-6a87fdbdc572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:58.391522 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 108/213] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:39:58.438926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 106/214] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:39:58.578132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130009f5-ffa0-47fe-8cf6-fc77933b303a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:58.666752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b0ee0-d4da-459f-b600-6a87fdbdc572 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:58.698333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130009f5-ffa0-47fe-8cf6-fc77933b303a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:58.729207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:58.736300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868e5f6-4d1e-465c-bd8a-b56c0781d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:58.736963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868e5f6-4d1e-465c-bd8a-b56c0781d6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:58.737241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868e5f6-4d1e-465c-bd8a-b56c0781d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:58.737512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868e5f6-4d1e-465c-bd8a-b56c0781d6e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:58.748660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868e5f6-4d1e-465c-bd8a-b56c0781d6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6868e5f6-4d1e-465c-bd8a-b56c0781d6e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:58.754162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:58.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:58.755883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:58.755883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:58.755883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:58.755883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:58.755883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:58.755883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:58.755883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:58.755883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:58.755883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:58.755883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:58.755883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:39:58.755883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:39:58.755883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 109/215] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:39:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:58.756541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868e5f6-4d1e-465c-bd8a-b56c0781d6e6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:58.769439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b0ee0-d4da-459f-b600-6a87fdbdc572 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:58.772031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:58.801899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c3119-af29-42a9-971b-f2dbbc1466f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:58.802521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c3119-af29-42a9-971b-f2dbbc1466f6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:58.802830 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c3119-af29-42a9-971b-f2dbbc1466f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:58.803105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c3119-af29-42a9-971b-f2dbbc1466f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:58.813701 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c3119-af29-42a9-971b-f2dbbc1466f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b61c3119-af29-42a9-971b-f2dbbc1466f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:58.818582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:58.819605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:58.820610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:58.820610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:58.820610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:58.820610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:58.820610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:58.820610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:58.820610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:58.820610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:58.820610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:58.820610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:58.820610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:39:58.820610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:39:58.820610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 107/216] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:58.823177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29224-8867-4e92-b908-733d74673c75 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:58.823459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29224-8867-4e92-b908-733d74673c75 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:58.823728 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29224-8867-4e92-b908-733d74673c75 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:58.825064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 108/217] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:39:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:39:58.825748 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b29224-8867-4e92-b908-733d74673c75 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:58.859449 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868e5f6-4d1e-465c-bd8a-b56c0781d6e6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:58.892975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c44190-4d24-4759-8ec2-a591bec9d2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:58.893601 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c44190-4d24-4759-8ec2-a591bec9d2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:58.893879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c44190-4d24-4759-8ec2-a591bec9d2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:58.894147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c44190-4d24-4759-8ec2-a591bec9d2e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:58.895282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c44190-4d24-4759-8ec2-a591bec9d2e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:58.896727 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c44190-4d24-4759-8ec2-a591bec9d2e9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:58.898271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 110/218] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:39:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:58.902971 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c44190-4d24-4759-8ec2-a591bec9d2e9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:58.924724 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b29224-8867-4e92-b908-733d74673c75 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:58.947558 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:58.959619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6b2d6-c0cd-46c0-85df-f6cb3523c651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:58.960167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6b2d6-c0cd-46c0-85df-f6cb3523c651 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:58.960713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6b2d6-c0cd-46c0-85df-f6cb3523c651 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:58.961014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6b2d6-c0cd-46c0-85df-f6cb3523c651 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:58.961675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6b2d6-c0cd-46c0-85df-f6cb3523c651 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:58.961976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6b2d6-c0cd-46c0-85df-f6cb3523c651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:58.963434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6b2d6-c0cd-46c0-85df-f6cb3523c651 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:58.971369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 109/219] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:39:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:58.972503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a3092-34da-42af-8cb7-78ca0d8736eb None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:58.972786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a3092-34da-42af-8cb7-78ca0d8736eb None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:58.973170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a3092-34da-42af-8cb7-78ca0d8736eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:58.980037 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:58.991296 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5f2a3092-34da-42af-8cb7-78ca0d8736eb None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:39:58.992575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5f2a3092-34da-42af-8cb7-78ca0d8736eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:39:58.999116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c44190-4d24-4759-8ec2-a591bec9d2e9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:59.034351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e227e-ff83-465b-adcd-d8ba7b6a7e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:59.035047 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e227e-ff83-465b-adcd-d8ba7b6a7e1c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:59.035327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e227e-ff83-465b-adcd-d8ba7b6a7e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:59.035599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e227e-ff83-465b-adcd-d8ba7b6a7e1c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:59.036261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e227e-ff83-465b-adcd-d8ba7b6a7e1c None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:39:59.036564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e227e-ff83-465b-adcd-d8ba7b6a7e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:59.038054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e227e-ff83-465b-adcd-d8ba7b6a7e1c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:59.047375 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 111/220] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:39:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:59.048172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e227e-ff83-465b-adcd-d8ba7b6a7e1c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:59.064443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 110/221] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:39:59.065269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a3092-34da-42af-8cb7-78ca0d8736eb None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:59.155806 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e227e-ff83-465b-adcd-d8ba7b6a7e1c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:59.172019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a3092-34da-42af-8cb7-78ca0d8736eb None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:59.185506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:59.191803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef073b-d32c-4279-abc8-db2c274664eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:59.192520 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef073b-d32c-4279-abc8-db2c274664eb None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:59.192794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef073b-d32c-4279-abc8-db2c274664eb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:59.193070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef073b-d32c-4279-abc8-db2c274664eb None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:59.193693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef073b-d32c-4279-abc8-db2c274664eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:59.195173 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef073b-d32c-4279-abc8-db2c274664eb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:59.207530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb6d81-b22e-4cf6-ae71-84c2be403790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:59.209400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb6d81-b22e-4cf6-ae71-84c2be403790 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:59.209939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb6d81-b22e-4cf6-ae71-84c2be403790 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:59.210055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb6d81-b22e-4cf6-ae71-84c2be403790 None admin] PATH_INFO: `/v3/users/821f1fb909174a539e7dc2cddec28838` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:59.212000 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb6d81-b22e-4cf6-ae71-84c2be403790 None admin] RBAC: Authorizing `identity:get_user(user_id=821f1fb909174a539e7dc2cddec28838)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:59.213914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb6d81-b22e-4cf6-ae71-84c2be403790 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:59.214423 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:59.216525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 111/222] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:59 2022] GET /identity/v3/users/821f1fb909174a539e7dc2cddec28838 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:59.217688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb6d81-b22e-4cf6-ae71-84c2be403790 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:59.223604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 112/223] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:39:59 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:39:59.224441 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef073b-d32c-4279-abc8-db2c274664eb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:59.340132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb6d81-b22e-4cf6-ae71-84c2be403790 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:59.367064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef073b-d32c-4279-abc8-db2c274664eb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:59.383866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459f358-6e9b-446a-99d2-35fc0f2df135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:59.384770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459f358-6e9b-446a-99d2-35fc0f2df135 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:59.385312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459f358-6e9b-446a-99d2-35fc0f2df135 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:59.385753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459f358-6e9b-446a-99d2-35fc0f2df135 None admin] PATH_INFO: `/v3/users/6ee15c80c02e487e80e858cbce46348f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:59.405791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767e00f-beb4-4031-b2f1-73478d55cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:59.406129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459f358-6e9b-446a-99d2-35fc0f2df135 None admin] RBAC: Authorizing `identity:get_user(user_id=6ee15c80c02e487e80e858cbce46348f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:59.406443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767e00f-beb4-4031-b2f1-73478d55cf8a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:59.406746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767e00f-beb4-4031-b2f1-73478d55cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:59.407021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767e00f-beb4-4031-b2f1-73478d55cf8a None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:59.408161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767e00f-beb4-4031-b2f1-73478d55cf8a None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:59.408376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459f358-6e9b-446a-99d2-35fc0f2df135 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:59.409604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767e00f-beb4-4031-b2f1-73478d55cf8a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:59.410253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 112/224] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:39:59 2022] GET /identity/v3/users/6ee15c80c02e487e80e858cbce46348f => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:59.410827 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459f358-6e9b-446a-99d2-35fc0f2df135 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:59.411263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 113/225] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:59 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:39:59.416729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767e00f-beb4-4031-b2f1-73478d55cf8a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:59.471051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:59.492832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:59.540868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767e00f-beb4-4031-b2f1-73478d55cf8a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:59.552416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459f358-6e9b-446a-99d2-35fc0f2df135 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:59.581200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dde7a-53a4-4f62-bab9-2ba1bbf85104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:59.581830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dde7a-53a4-4f62-bab9-2ba1bbf85104 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:59.582082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dde7a-53a4-4f62-bab9-2ba1bbf85104 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:59.582347 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dde7a-53a4-4f62-bab9-2ba1bbf85104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:59.598124 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf66a3-81ab-4a7e-a0f0-8e5db99e4e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:59.598321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf66a3-81ab-4a7e-a0f0-8e5db99e4e78 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:59.598431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf66a3-81ab-4a7e-a0f0-8e5db99e4e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:59.598700 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf66a3-81ab-4a7e-a0f0-8e5db99e4e78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:59.611279 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf66a3-81ab-4a7e-a0f0-8e5db99e4e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a4cf66a3-81ab-4a7e-a0f0-8e5db99e4e78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:39:59.616622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:39:59.617570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:39:59.618348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:39:59.618348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:39:59.618348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:39:59.618348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:39:59.618348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:39:59.618348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:39:59.618348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:39:59.618348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:39:59.618348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:39:59.618348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:39:59.618348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:39:59.618348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:39:59.618348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 113/226] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:39:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:39:59.619048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf66a3-81ab-4a7e-a0f0-8e5db99e4e78 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:59.671824 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dde7a-53a4-4f62-bab9-2ba1bbf85104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:59.673695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dde7a-53a4-4f62-bab9-2ba1bbf85104 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:59.734347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:59.739062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf66a3-81ab-4a7e-a0f0-8e5db99e4e78 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:59.751599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:39:59.782507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe10bf8-b21a-4ce6-b97a-0896dfec2395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:59.783727 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe10bf8-b21a-4ce6-b97a-0896dfec2395 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:59.784104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe10bf8-b21a-4ce6-b97a-0896dfec2395 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:59.784477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe10bf8-b21a-4ce6-b97a-0896dfec2395 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32/users/821f1fb909174a539e7dc2cddec28838/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:59.787350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe10bf8-b21a-4ce6-b97a-0896dfec2395 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1020531a2814c51b1db55f62f23ea32, user_id=821f1fb909174a539e7dc2cddec28838, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:59.789913 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe10bf8-b21a-4ce6-b97a-0896dfec2395 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:59.796913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 114/227] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:39:59.798191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dde7a-53a4-4f62-bab9-2ba1bbf85104 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:59.807846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 114/228] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:39:59 2022] PUT /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32/users/821f1fb909174a539e7dc2cddec28838/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:39:59.813130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe10bf8-b21a-4ce6-b97a-0896dfec2395 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:39:59.934359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe10bf8-b21a-4ce6-b97a-0896dfec2395 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:39:59.993490 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490c44e-1aa9-4e78-badf-092c71e34fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:39:59.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490c44e-1aa9-4e78-badf-092c71e34fec None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:39:59.994332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490c44e-1aa9-4e78-badf-092c71e34fec None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:39:59.994673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490c44e-1aa9-4e78-badf-092c71e34fec None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:39:59.996285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490c44e-1aa9-4e78-badf-092c71e34fec None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:39:59.997736 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490c44e-1aa9-4e78-badf-092c71e34fec None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:39:59.999433 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 115/229] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:39:59 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:00.010703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490c44e-1aa9-4e78-badf-092c71e34fec None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:00.048948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dde7a-53a4-4f62-bab9-2ba1bbf85104 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:00.051561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:00.096161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b828f13-656f-4651-a4d5-50b998b92e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:00.096822 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b828f13-656f-4651-a4d5-50b998b92e98 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:00.097333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b828f13-656f-4651-a4d5-50b998b92e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:00.097603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b828f13-656f-4651-a4d5-50b998b92e98 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:00.098273 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b828f13-656f-4651-a4d5-50b998b92e98 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:00.098623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b828f13-656f-4651-a4d5-50b998b92e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:00.100136 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b828f13-656f-4651-a4d5-50b998b92e98 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:00.112031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 115/230] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:39:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:00.117067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b828f13-656f-4651-a4d5-50b998b92e98 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:00.139452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490c44e-1aa9-4e78-badf-092c71e34fec None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:00.153310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:00.178894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357f907-dfc3-42a0-9380-7947e01b99f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:00.178894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357f907-dfc3-42a0-9380-7947e01b99f2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:00.178894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357f907-dfc3-42a0-9380-7947e01b99f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:00.178894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357f907-dfc3-42a0-9380-7947e01b99f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:00.179303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357f907-dfc3-42a0-9380-7947e01b99f2 None admin] RBAC: Adding query filter params (role.id=f5585030f686473c89e1de214b25b6ff, scope.project.id=c1020531a2814c51b1db55f62f23ea32, user.id=6ee15c80c02e487e80e858cbce46348f) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:00.179303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357f907-dfc3-42a0-9380-7947e01b99f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:00.179616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357f907-dfc3-42a0-9380-7947e01b99f2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:00.186458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 116/231] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:00 2022] GET /identity/v3/role_assignments?user.id=6ee15c80c02e487e80e858cbce46348f&scope.project.id=c1020531a2814c51b1db55f62f23ea32&role.id=f5585030f686473c89e1de214b25b6ff => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:00.244092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b828f13-656f-4651-a4d5-50b998b92e98 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:00.296497 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b968-293a-4116-827d-3d4968183faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:00.297162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b968-293a-4116-827d-3d4968183faf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:00.297443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b968-293a-4116-827d-3d4968183faf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:00.297712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b968-293a-4116-827d-3d4968183faf None admin] PATH_INFO: `/v3/users/821f1fb909174a539e7dc2cddec28838` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:00.299000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2b968-293a-4116-827d-3d4968183faf None admin] RBAC: Authorizing `identity:get_user(user_id=821f1fb909174a539e7dc2cddec28838)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:00.300491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2b968-293a-4116-827d-3d4968183faf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:00.302495 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 116/232] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:00 2022] GET /identity/v3/users/821f1fb909174a539e7dc2cddec28838 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:00.308736 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357f907-dfc3-42a0-9380-7947e01b99f2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:00.473157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:00.482147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357f907-dfc3-42a0-9380-7947e01b99f2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:00.519397 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd4c78-2a09-4f62-87ba-5d4a2eb723a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:00.519949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4c78-2a09-4f62-87ba-5d4a2eb723a3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:00.520224 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4c78-2a09-4f62-87ba-5d4a2eb723a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:00.520491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4c78-2a09-4f62-87ba-5d4a2eb723a3 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:00.526229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd4c78-2a09-4f62-87ba-5d4a2eb723a3 None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:00.527866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd4c78-2a09-4f62-87ba-5d4a2eb723a3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:00.530088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 117/233] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:00 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:00.535533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b968-293a-4116-827d-3d4968183faf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:00.674187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:00.680784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b968-293a-4116-827d-3d4968183faf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:00.728380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0326228-151b-47f8-8e7d-fcd12396d062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:00.729057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0326228-151b-47f8-8e7d-fcd12396d062 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:00.729336 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0326228-151b-47f8-8e7d-fcd12396d062 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:00.729610 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0326228-151b-47f8-8e7d-fcd12396d062 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32/users/821f1fb909174a539e7dc2cddec28838/roles/5e35afebe51a448a9ee3ed338209d739` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:00.731873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0326228-151b-47f8-8e7d-fcd12396d062 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1020531a2814c51b1db55f62f23ea32, user_id=821f1fb909174a539e7dc2cddec28838, role_id=5e35afebe51a448a9ee3ed338209d739)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:00.733319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0326228-151b-47f8-8e7d-fcd12396d062 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:00.753385 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 117/234] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:40:00 2022] PUT /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32/users/821f1fb909174a539e7dc2cddec28838/roles/5e35afebe51a448a9ee3ed338209d739 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:40:02.043971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20149d-e1b2-4d56-8d19-d11da112b22a None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:02.044489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20149d-e1b2-4d56-8d19-d11da112b22a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:02.044489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20149d-e1b2-4d56-8d19-d11da112b22a None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:02.045823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 118/235] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:02.051455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896a1e2-f6fe-41c8-9909-638c2d087db3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:02.052330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896a1e2-f6fe-41c8-9909-638c2d087db3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:02.052791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896a1e2-f6fe-41c8-9909-638c2d087db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:02.056675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a935f-84b1-4a63-899c-b951757601d6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:02.058113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a935f-84b1-4a63-899c-b951757601d6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:02.058965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a935f-84b1-4a63-899c-b951757601d6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:02.060971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 119/236] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:02.072102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72e92c-0fbe-4017-93a2-15d1a5e4d91d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:02.072640 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72e92c-0fbe-4017-93a2-15d1a5e4d91d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:02.073156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72e92c-0fbe-4017-93a2-15d1a5e4d91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:02.091544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f896a1e2-f6fe-41c8-9909-638c2d087db3 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:02.093115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f896a1e2-f6fe-41c8-9909-638c2d087db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:02.106581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3c72e92c-0fbe-4017-93a2-15d1a5e4d91d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:02.108224 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3c72e92c-0fbe-4017-93a2-15d1a5e4d91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:02.217817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 118/237] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:02.224360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 120/238] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:02.453926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd951c-f0d8-43ae-8bdb-0b5d9b5656cc None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:02.454246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd951c-f0d8-43ae-8bdb-0b5d9b5656cc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:02.454496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd951c-f0d8-43ae-8bdb-0b5d9b5656cc None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:02.455872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 119/239] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:02.469279 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0944e-a217-4cb8-843e-1d4757ec8b07 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:02.469568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0944e-a217-4cb8-843e-1d4757ec8b07 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:02.469844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0944e-a217-4cb8-843e-1d4757ec8b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:02.490161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e6e0944e-a217-4cb8-843e-1d4757ec8b07 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:02.491356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e6e0944e-a217-4cb8-843e-1d4757ec8b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:02.551976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd951c-f0d8-43ae-8bdb-0b5d9b5656cc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:02.587220 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 121/240] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:02.593908 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0944e-a217-4cb8-843e-1d4757ec8b07 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:02.635191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:02.707498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:02.733000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd951c-f0d8-43ae-8bdb-0b5d9b5656cc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:02.773460 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2488ea-5d87-4d61-9d9e-d480667635fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:02.774172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2488ea-5d87-4d61-9d9e-d480667635fd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:02.774614 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2488ea-5d87-4d61-9d9e-d480667635fd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:02.774921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2488ea-5d87-4d61-9d9e-d480667635fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:02.780774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0944e-a217-4cb8-843e-1d4757ec8b07 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:02.787261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2488ea-5d87-4d61-9d9e-d480667635fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-cf2488ea-5d87-4d61-9d9e-d480667635fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:02.793947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:02.794877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:02.795676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:02.795676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:02.795676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:02.795676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:02.795676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:02.795676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:02.795676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:02.795676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:02.795676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:02.795676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:02.795676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:40:02.795676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:02.795676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 120/241] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:02.804670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2488ea-5d87-4d61-9d9e-d480667635fd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:02.849123 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d5212-186f-4371-8aaf-ac9b307511a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:02.849979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d5212-186f-4371-8aaf-ac9b307511a6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:02.850256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d5212-186f-4371-8aaf-ac9b307511a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:02.850526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d5212-186f-4371-8aaf-ac9b307511a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:02.853934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d5212-186f-4371-8aaf-ac9b307511a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:02.855380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d5212-186f-4371-8aaf-ac9b307511a6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:02.861011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 122/242] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:02.866220 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d5212-186f-4371-8aaf-ac9b307511a6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:02.957274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2488ea-5d87-4d61-9d9e-d480667635fd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:02.967982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:02.982844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d5212-186f-4371-8aaf-ac9b307511a6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:02.995343 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35de0e-616c-401a-a9d0-6b3bd546a52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:02.995996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35de0e-616c-401a-a9d0-6b3bd546a52d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:02.996270 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35de0e-616c-401a-a9d0-6b3bd546a52d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:02.996587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35de0e-616c-401a-a9d0-6b3bd546a52d None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:02.997340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35de0e-616c-401a-a9d0-6b3bd546a52d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:02.997633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35de0e-616c-401a-a9d0-6b3bd546a52d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:02.999202 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35de0e-616c-401a-a9d0-6b3bd546a52d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:03.013049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 121/243] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:03.013049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35de0e-616c-401a-a9d0-6b3bd546a52d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:03.024849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:03.025307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe15a4c-c970-43fb-9680-728106ad9ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:03.025911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe15a4c-c970-43fb-9680-728106ad9ddf None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:03.026189 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe15a4c-c970-43fb-9680-728106ad9ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:03.026462 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe15a4c-c970-43fb-9680-728106ad9ddf None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:03.029427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe15a4c-c970-43fb-9680-728106ad9ddf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:03.030981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe15a4c-c970-43fb-9680-728106ad9ddf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:03.057601 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 123/244] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:40:02 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:40:03.058988 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdd37b-e006-41a4-b51d-3c79314a78d0 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:03.059276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdd37b-e006-41a4-b51d-3c79314a78d0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:03.059549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdd37b-e006-41a4-b51d-3c79314a78d0 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:03.060863 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 124/245] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:03.065550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdd37b-e006-41a4-b51d-3c79314a78d0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:03.188117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35de0e-616c-401a-a9d0-6b3bd546a52d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:03.195139 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdd37b-e006-41a4-b51d-3c79314a78d0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:03.237622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e19c4-7c18-4cbf-80a7-abe53e2cae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:03.238356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e19c4-7c18-4cbf-80a7-abe53e2cae81 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:03.238745 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e19c4-7c18-4cbf-80a7-abe53e2cae81 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:03.239408 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e19c4-7c18-4cbf-80a7-abe53e2cae81 None admin] PATH_INFO: `/v3/users/9ae7b26373f34e30833b33b49a012ff0` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:03.249043 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b5fb5-f100-4ab6-9d37-d9778db72c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:03.249698 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b5fb5-f100-4ab6-9d37-d9778db72c52 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:03.250640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b5fb5-f100-4ab6-9d37-d9778db72c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:03.250942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b5fb5-f100-4ab6-9d37-d9778db72c52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:03.256630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e19c4-7c18-4cbf-80a7-abe53e2cae81 None admin] RBAC: Authorizing `identity:get_user(user_id=9ae7b26373f34e30833b33b49a012ff0)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:03.258384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e19c4-7c18-4cbf-80a7-abe53e2cae81 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:03.267847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 125/246] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:03 2022] GET /identity/v3/users/9ae7b26373f34e30833b33b49a012ff0 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:03.267847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1321597-5476-4774-9b47-ce26cd8074dd None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:03.267847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1321597-5476-4774-9b47-ce26cd8074dd None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:03.267847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1321597-5476-4774-9b47-ce26cd8074dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:03.268195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b5fb5-f100-4ab6-9d37-d9778db72c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:03.272165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5f6b5fb5-f100-4ab6-9d37-d9778db72c52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:03.273868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:03.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:03.276274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:03.276274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:03.276274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:03.276274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:03.276274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:03.276274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:03.276274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:03.276274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:03.276274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:03.276274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:03.276274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:40:03.276274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:03.277531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 122/247] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:40:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:03.278384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b5fb5-f100-4ab6-9d37-d9778db72c52 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:03.291861 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e1321597-5476-4774-9b47-ce26cd8074dd None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:03.293052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e1321597-5476-4774-9b47-ce26cd8074dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:03.365962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:03.381506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 126/248] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:03.382089 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1321597-5476-4774-9b47-ce26cd8074dd None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:03.442609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b5fb5-f100-4ab6-9d37-d9778db72c52 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:03.514220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a621c18-74f5-480b-bfc2-57f37983f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:03.514846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621c18-74f5-480b-bfc2-57f37983f870 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:03.515130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621c18-74f5-480b-bfc2-57f37983f870 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:03.515403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621c18-74f5-480b-bfc2-57f37983f870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:03.556376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1321597-5476-4774-9b47-ce26cd8074dd None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:03.606051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:03.609765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a621c18-74f5-480b-bfc2-57f37983f870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:03.612635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a621c18-74f5-480b-bfc2-57f37983f870 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:03.615527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5905e-4f71-46c1-a358-7c402932514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:03.617394 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5905e-4f71-46c1-a358-7c402932514b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:03.617859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5905e-4f71-46c1-a358-7c402932514b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:03.618304 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5905e-4f71-46c1-a358-7c402932514b None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:03.619167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5905e-4f71-46c1-a358-7c402932514b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:03.619615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5905e-4f71-46c1-a358-7c402932514b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:03.621586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5905e-4f71-46c1-a358-7c402932514b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:03.636793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 127/249] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:03.642823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5905e-4f71-46c1-a358-7c402932514b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:03.708815 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:03.753896 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 123/250] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:03.755795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae314228-b540-4c7b-ac3c-882c197a709f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:03.756224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae314228-b540-4c7b-ac3c-882c197a709f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:03.756636 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae314228-b540-4c7b-ac3c-882c197a709f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:03.759381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 124/251] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:03.760298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae314228-b540-4c7b-ac3c-882c197a709f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:03.778836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5905e-4f71-46c1-a358-7c402932514b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:03.817272 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9cd97-9c15-4240-bd22-5af9c6a21edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:03.818251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9cd97-9c15-4240-bd22-5af9c6a21edc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:03.818810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9cd97-9c15-4240-bd22-5af9c6a21edc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:03.819253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9cd97-9c15-4240-bd22-5af9c6a21edc None admin] PATH_INFO: `/v3/users/821f1fb909174a539e7dc2cddec28838` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:03.820591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9cd97-9c15-4240-bd22-5af9c6a21edc None admin] RBAC: Authorizing `identity:get_user(user_id=821f1fb909174a539e7dc2cddec28838)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:03.823379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9cd97-9c15-4240-bd22-5af9c6a21edc None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:03.826030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 128/252] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:03 2022] GET /identity/v3/users/821f1fb909174a539e7dc2cddec28838 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:03.827055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9cd97-9c15-4240-bd22-5af9c6a21edc None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:03.878148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae314228-b540-4c7b-ac3c-882c197a709f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:03.896038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:03.918295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a5fe2-f383-4b26-a5c8-d487f7617c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:03.918959 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a5fe2-f383-4b26-a5c8-d487f7617c3f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:03.919224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a5fe2-f383-4b26-a5c8-d487f7617c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:03.919490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a5fe2-f383-4b26-a5c8-d487f7617c3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:03.931130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a5fe2-f383-4b26-a5c8-d487f7617c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-406a5fe2-f383-4b26-a5c8-d487f7617c3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:03.936415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:03.937309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:03.938102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:03.938102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:03.938102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:03.938102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:03.938102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:03.938102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:03.938102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:03.938102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:03.938102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:03.938102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:03.938102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:03.938102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:03.938102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 125/253] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:03.939694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62e289-7545-4800-ac1e-1f0f3def0f72 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:03.939807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62e289-7545-4800-ac1e-1f0f3def0f72 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:03.940042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62e289-7545-4800-ac1e-1f0f3def0f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:03.946841 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9cd97-9c15-4240-bd22-5af9c6a21edc None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:03.958783 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1b62e289-7545-4800-ac1e-1f0f3def0f72 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:03.959957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1b62e289-7545-4800-ac1e-1f0f3def0f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:03.983799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a7de6-b3de-4c15-9489-740960d0ac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:03.984693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a7de6-b3de-4c15-9489-740960d0ac81 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:03.985116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a7de6-b3de-4c15-9489-740960d0ac81 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:03.985545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:03.985965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a7de6-b3de-4c15-9489-740960d0ac81 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:03.988241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a7de6-b3de-4c15-9489-740960d0ac81 None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:03.990827 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a7de6-b3de-4c15-9489-740960d0ac81 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:03.993410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 129/254] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:03 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:03.994416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a7de6-b3de-4c15-9489-740960d0ac81 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:04.033715 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 126/255] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:04.039069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62e289-7545-4800-ac1e-1f0f3def0f72 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:04.144329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a7de6-b3de-4c15-9489-740960d0ac81 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:04.199103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:04.205756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa6f77-cae9-4ce2-ac4e-e1c02961c5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:04.206629 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa6f77-cae9-4ce2-ac4e-e1c02961c5fb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:04.206935 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa6f77-cae9-4ce2-ac4e-e1c02961c5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:04.207208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa6f77-cae9-4ce2-ac4e-e1c02961c5fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:04.221293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62e289-7545-4800-ac1e-1f0f3def0f72 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:04.286876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7d5d7-e48d-454a-b688-b79e0cd38f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:04.287999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7d5d7-e48d-454a-b688-b79e0cd38f7e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:04.289525 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7d5d7-e48d-454a-b688-b79e0cd38f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:04.290257 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7d5d7-e48d-454a-b688-b79e0cd38f7e None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:04.291519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7d5d7-e48d-454a-b688-b79e0cd38f7e None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:04.292832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7d5d7-e48d-454a-b688-b79e0cd38f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:04.294477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7d5d7-e48d-454a-b688-b79e0cd38f7e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:04.313976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 127/256] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:04.316407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7d5d7-e48d-454a-b688-b79e0cd38f7e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:04.339652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa6f77-cae9-4ce2-ac4e-e1c02961c5fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:04.341132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa6f77-cae9-4ce2-ac4e-e1c02961c5fb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:04.348368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:04.452412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7d5d7-e48d-454a-b688-b79e0cd38f7e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:04.453209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 130/257] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:04.458533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa6f77-cae9-4ce2-ac4e-e1c02961c5fb None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:04.490720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:04.500269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ce67f-34b7-4b40-a041-b9ad5ca5a4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:04.501279 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ce67f-34b7-4b40-a041-b9ad5ca5a4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:04.502267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ce67f-34b7-4b40-a041-b9ad5ca5a4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:04.502753 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ce67f-34b7-4b40-a041-b9ad5ca5a4f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:04.504165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ce67f-34b7-4b40-a041-b9ad5ca5a4f3 None admin] RBAC: Adding query filter params (role.id=ec07f55a1c534d79af2517e37b41fc75, scope.project.id=c1020531a2814c51b1db55f62f23ea32, user.id=9ae7b26373f34e30833b33b49a012ff0) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:04.504691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ce67f-34b7-4b40-a041-b9ad5ca5a4f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:04.507067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ce67f-34b7-4b40-a041-b9ad5ca5a4f3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:04.514899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 128/258] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:04 2022] GET /identity/v3/role_assignments?user.id=9ae7b26373f34e30833b33b49a012ff0&scope.project.id=c1020531a2814c51b1db55f62f23ea32&role.id=ec07f55a1c534d79af2517e37b41fc75 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:04.516478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ce67f-34b7-4b40-a041-b9ad5ca5a4f3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:04.598849 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa6f77-cae9-4ce2-ac4e-e1c02961c5fb None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:04.637442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:04.649515 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ce67f-34b7-4b40-a041-b9ad5ca5a4f3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:04.689900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745f268-016a-4a76-9b06-8769c0e03470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:04.690546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745f268-016a-4a76-9b06-8769c0e03470 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:04.690864 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745f268-016a-4a76-9b06-8769c0e03470 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:04.691287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745f268-016a-4a76-9b06-8769c0e03470 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:04.704504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745f268-016a-4a76-9b06-8769c0e03470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b745f268-016a-4a76-9b06-8769c0e03470 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:04.710938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:04.712696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:04.713570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:04.713570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:04.713570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:04.713570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:04.713570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:04.713570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:04.713570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:04.713570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:04.713570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:04.713570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:04.713570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:04.713570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:04.718047 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 129/259] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:40:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:04.719164 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745f268-016a-4a76-9b06-8769c0e03470 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:04.747580 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b852d7-c280-4424-a3fb-5f1160dd3610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:04.748521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b852d7-c280-4424-a3fb-5f1160dd3610 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:04.748521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b852d7-c280-4424-a3fb-5f1160dd3610 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:04.748854 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b852d7-c280-4424-a3fb-5f1160dd3610 None admin] PATH_INFO: `/v3/users/6ee15c80c02e487e80e858cbce46348f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:04.749937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b852d7-c280-4424-a3fb-5f1160dd3610 None admin] RBAC: Authorizing `identity:get_user(user_id=6ee15c80c02e487e80e858cbce46348f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:04.751417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b852d7-c280-4424-a3fb-5f1160dd3610 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:04.752990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 131/260] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:04 2022] GET /identity/v3/users/6ee15c80c02e487e80e858cbce46348f => generated 297 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:04.753751 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b852d7-c280-4424-a3fb-5f1160dd3610 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:04.877079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745f268-016a-4a76-9b06-8769c0e03470 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:04.906533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:04.914677 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b852d7-c280-4424-a3fb-5f1160dd3610 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:04.938454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a377-aba3-450c-bcdc-601a13d6df4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:04.939109 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a377-aba3-450c-bcdc-601a13d6df4d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:04.939382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a377-aba3-450c-bcdc-601a13d6df4d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:04.939648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a377-aba3-450c-bcdc-601a13d6df4d None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:04.940900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70a377-aba3-450c-bcdc-601a13d6df4d None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:04.942353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70a377-aba3-450c-bcdc-601a13d6df4d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:04.943999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 130/261] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:04 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:04.944759 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a377-aba3-450c-bcdc-601a13d6df4d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:04.969117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065b1f9-d39d-4672-85fd-59e3396f6d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:04.969724 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065b1f9-d39d-4672-85fd-59e3396f6d50 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:04.969998 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065b1f9-d39d-4672-85fd-59e3396f6d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:04.970259 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065b1f9-d39d-4672-85fd-59e3396f6d50 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:04.974933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065b1f9-d39d-4672-85fd-59e3396f6d50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:04.974933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065b1f9-d39d-4672-85fd-59e3396f6d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:04.974933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065b1f9-d39d-4672-85fd-59e3396f6d50 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:04.981622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 132/262] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:04.982152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:04.989055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065b1f9-d39d-4672-85fd-59e3396f6d50 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:05.094617 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065b1f9-d39d-4672-85fd-59e3396f6d50 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:05.130228 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0e20b-998b-42c4-b9e2-0b2abe770494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:05.130967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e20b-998b-42c4-b9e2-0b2abe770494 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:05.131339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e20b-998b-42c4-b9e2-0b2abe770494 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:05.131702 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e20b-998b-42c4-b9e2-0b2abe770494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:05.132542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0e20b-998b-42c4-b9e2-0b2abe770494 None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=c1020531a2814c51b1db55f62f23ea32, user.id=821f1fb909174a539e7dc2cddec28838) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:05.132944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0e20b-998b-42c4-b9e2-0b2abe770494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:05.135049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0e20b-998b-42c4-b9e2-0b2abe770494 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:05.141237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 133/263] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:04 2022] GET /identity/v3/role_assignments?user.id=821f1fb909174a539e7dc2cddec28838&scope.project.id=c1020531a2814c51b1db55f62f23ea32&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:05.141817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a377-aba3-450c-bcdc-601a13d6df4d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:05.142329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0e20b-998b-42c4-b9e2-0b2abe770494 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:05.193480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:05.208096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbea10d-6309-460b-b613-f2f82bcb2617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:05.208751 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbea10d-6309-460b-b613-f2f82bcb2617 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:05.209031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbea10d-6309-460b-b613-f2f82bcb2617 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:05.209302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbea10d-6309-460b-b613-f2f82bcb2617 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:05.215434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbea10d-6309-460b-b613-f2f82bcb2617 None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:05.216974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbea10d-6309-460b-b613-f2f82bcb2617 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:05.218923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 131/264] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:04 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:05.226541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbea10d-6309-460b-b613-f2f82bcb2617 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:05.300688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0e20b-998b-42c4-b9e2-0b2abe770494 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:05.350838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccf82f-c238-46a8-8977-622c2dc1f202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:05.351542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccf82f-c238-46a8-8977-622c2dc1f202 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:05.351818 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccf82f-c238-46a8-8977-622c2dc1f202 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:05.352086 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccf82f-c238-46a8-8977-622c2dc1f202 None admin] PATH_INFO: `/v3/users/821f1fb909174a539e7dc2cddec28838` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:05.362852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccf82f-c238-46a8-8977-622c2dc1f202 None admin] RBAC: Authorizing `identity:get_user(user_id=821f1fb909174a539e7dc2cddec28838)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:05.362852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccf82f-c238-46a8-8977-622c2dc1f202 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:05.363123 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 134/265] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:05 2022] GET /identity/v3/users/821f1fb909174a539e7dc2cddec28838 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:05.371753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccf82f-c238-46a8-8977-622c2dc1f202 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:05.411474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:05.468964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbea10d-6309-460b-b613-f2f82bcb2617 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:05.536801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17b579-0e03-484f-804d-9c6672c124f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:05.537495 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17b579-0e03-484f-804d-9c6672c124f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:05.537775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17b579-0e03-484f-804d-9c6672c124f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:05.539424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17b579-0e03-484f-804d-9c6672c124f7 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32/users/6ee15c80c02e487e80e858cbce46348f/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:05.540916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17b579-0e03-484f-804d-9c6672c124f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1020531a2814c51b1db55f62f23ea32, user_id=6ee15c80c02e487e80e858cbce46348f, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:05.542377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17b579-0e03-484f-804d-9c6672c124f7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:05.580606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 132/266] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:40:05 2022] PUT /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32/users/6ee15c80c02e487e80e858cbce46348f/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:40:05.615143 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:05.640378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccf82f-c238-46a8-8977-622c2dc1f202 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:05.702185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f5e89-715d-40ab-b103-753a9b9f0d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:05.703199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5e89-715d-40ab-b103-753a9b9f0d61 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:05.703199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5e89-715d-40ab-b103-753a9b9f0d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:05.703472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5e89-715d-40ab-b103-753a9b9f0d61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:05.807625 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f5e89-715d-40ab-b103-753a9b9f0d61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:05.809086 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f5e89-715d-40ab-b103-753a9b9f0d61 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:05.943680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:05.955657 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 135/267] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:05.961542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17b579-0e03-484f-804d-9c6672c124f7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:06.016151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39c347-6d5c-4b4e-a54b-72c65b65a66b None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:06.016657 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39c347-6d5c-4b4e-a54b-72c65b65a66b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:06.017130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39c347-6d5c-4b4e-a54b-72c65b65a66b None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:06.018916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 136/268] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:40:06.024234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0043c6-27f7-42e1-8090-6c595966a8f0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:06.025280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0043c6-27f7-42e1-8090-6c595966a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:06.025722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0043c6-27f7-42e1-8090-6c595966a8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:06.045447 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-aa0043c6-27f7-42e1-8090-6c595966a8f0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:06.047073 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-aa0043c6-27f7-42e1-8090-6c595966a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:06.094983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17b579-0e03-484f-804d-9c6672c124f7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:06.122832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 137/269] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:06.165730 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7065a07-19d4-4fec-aae0-8d9404f96f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:06.166368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7065a07-19d4-4fec-aae0-8d9404f96f31 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:06.166649 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7065a07-19d4-4fec-aae0-8d9404f96f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:06.166943 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7065a07-19d4-4fec-aae0-8d9404f96f31 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:06.171400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7065a07-19d4-4fec-aae0-8d9404f96f31 None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:06.172847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7065a07-19d4-4fec-aae0-8d9404f96f31 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:06.174672 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 133/270] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:05 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:06.180626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0043c6-27f7-42e1-8090-6c595966a8f0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:06.381484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0043c6-27f7-42e1-8090-6c595966a8f0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:06.445897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:06.462495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41c3e3-53a5-4be5-be3f-64ed815c30ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:06.463127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41c3e3-53a5-4be5-be3f-64ed815c30ff None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:06.463405 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41c3e3-53a5-4be5-be3f-64ed815c30ff None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:06.463675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41c3e3-53a5-4be5-be3f-64ed815c30ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:06.464402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41c3e3-53a5-4be5-be3f-64ed815c30ff None admin] RBAC: Adding query filter params (role.id=5e35afebe51a448a9ee3ed338209d739, scope.project.id=c1020531a2814c51b1db55f62f23ea32, user.id=821f1fb909174a539e7dc2cddec28838) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:06.464707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41c3e3-53a5-4be5-be3f-64ed815c30ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:06.466138 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41c3e3-53a5-4be5-be3f-64ed815c30ff None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:06.475290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 138/271] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:06 2022] GET /identity/v3/role_assignments?user.id=821f1fb909174a539e7dc2cddec28838&scope.project.id=c1020531a2814c51b1db55f62f23ea32&role.id=5e35afebe51a448a9ee3ed338209d739 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:06.480585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7065a07-19d4-4fec-aae0-8d9404f96f31 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:06.497281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701b8fe-5979-4c61-bc01-3f0c82989288 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:06.497638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701b8fe-5979-4c61-bc01-3f0c82989288 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:06.497821 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701b8fe-5979-4c61-bc01-3f0c82989288 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:06.499104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:06.501399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 139/272] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:06.511247 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73698085-1069-4398-b46c-1d3fd29cebb9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:06.511616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73698085-1069-4398-b46c-1d3fd29cebb9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:06.512663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73698085-1069-4398-b46c-1d3fd29cebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:06.547829 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-73698085-1069-4398-b46c-1d3fd29cebb9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:06.549105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-73698085-1069-4398-b46c-1d3fd29cebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:06.656806 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 140/273] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:06.675435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7065a07-19d4-4fec-aae0-8d9404f96f31 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:06.726703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df09065-8738-4f9d-b88f-f7ef79f0891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:06.727780 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df09065-8738-4f9d-b88f-f7ef79f0891b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:06.728766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df09065-8738-4f9d-b88f-f7ef79f0891b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:06.729240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df09065-8738-4f9d-b88f-f7ef79f0891b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:06.730578 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df09065-8738-4f9d-b88f-f7ef79f0891b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:06.732410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df09065-8738-4f9d-b88f-f7ef79f0891b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:06.734183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 134/274] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:06.740461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73698085-1069-4398-b46c-1d3fd29cebb9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:06.843443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73698085-1069-4398-b46c-1d3fd29cebb9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:06.863212 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:06.883435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbc315-8534-418b-8a55-ce1c9a5f02da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:06.884631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbc315-8534-418b-8a55-ce1c9a5f02da None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:06.885102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbc315-8534-418b-8a55-ce1c9a5f02da None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:06.885570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbc315-8534-418b-8a55-ce1c9a5f02da None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:06.886410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbc315-8534-418b-8a55-ce1c9a5f02da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:06.888132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbc315-8534-418b-8a55-ce1c9a5f02da None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:06.923050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 141/275] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:40:06 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:40:06.978314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df09065-8738-4f9d-b88f-f7ef79f0891b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:07.065308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:07.091946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df09065-8738-4f9d-b88f-f7ef79f0891b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:07.130394 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b0ab4-6dd9-4c83-874b-0fba63ef79dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:07.131069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b0ab4-6dd9-4c83-874b-0fba63ef79dc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:07.131344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b0ab4-6dd9-4c83-874b-0fba63ef79dc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:07.131610 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b0ab4-6dd9-4c83-874b-0fba63ef79dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:07.142017 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b0ab4-6dd9-4c83-874b-0fba63ef79dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-875b0ab4-6dd9-4c83-874b-0fba63ef79dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:07.147351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:07.148335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:07.149126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:07.149126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:07.149126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:07.149126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:07.149126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:07.149126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:07.149126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:07.149126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:07.149126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:07.149126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:07.149126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:07.149126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:07.149126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 135/276] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:07.154505 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbc315-8534-418b-8a55-ce1c9a5f02da None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:07.278209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbc315-8534-418b-8a55-ce1c9a5f02da None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:07.318132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1b09d-24e8-4d87-9905-58e6acc8c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:07.318770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1b09d-24e8-4d87-9905-58e6acc8c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:07.320026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1b09d-24e8-4d87-9905-58e6acc8c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:07.320026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1b09d-24e8-4d87-9905-58e6acc8c9b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:07.320417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1b09d-24e8-4d87-9905-58e6acc8c9b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:07.320788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1b09d-24e8-4d87-9905-58e6acc8c9b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:07.322698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1b09d-24e8-4d87-9905-58e6acc8c9b5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:07.333430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 142/277] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:07.339709 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b0ab4-6dd9-4c83-874b-0fba63ef79dc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:07.358068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b996e-9693-4dc2-9f03-b3d162d87981 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:07.358667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b996e-9693-4dc2-9f03-b3d162d87981 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:07.359206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b996e-9693-4dc2-9f03-b3d162d87981 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:07.361187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 143/278] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:40:07.366458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb749bb-3602-4eac-bfb8-91addee5efd7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:07.367008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb749bb-3602-4eac-bfb8-91addee5efd7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:07.367281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb749bb-3602-4eac-bfb8-91addee5efd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:07.390621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6cb749bb-3602-4eac-bfb8-91addee5efd7 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:07.391938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6cb749bb-3602-4eac-bfb8-91addee5efd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:07.424772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:07.463641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b0ab4-6dd9-4c83-874b-0fba63ef79dc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:07.470488 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 144/279] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:07.504835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49f105-c1bf-41be-9904-addafe42f59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:07.505496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49f105-c1bf-41be-9904-addafe42f59d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:07.505736 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49f105-c1bf-41be-9904-addafe42f59d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:07.506003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49f105-c1bf-41be-9904-addafe42f59d None admin] PATH_INFO: `/v3/users/047b7b654600452193763a0dc2ffddc3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:07.508720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:07.521746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49f105-c1bf-41be-9904-addafe42f59d None admin] RBAC: Authorizing `identity:get_user(user_id=047b7b654600452193763a0dc2ffddc3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:07.523232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49f105-c1bf-41be-9904-addafe42f59d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:07.525212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 136/280] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:07 2022] GET /identity/v3/users/047b7b654600452193763a0dc2ffddc3 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:07.532084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb749bb-3602-4eac-bfb8-91addee5efd7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:07.668922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb749bb-3602-4eac-bfb8-91addee5efd7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:07.703910 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04222a8-e459-4726-9ed9-bafd15659a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:07.704855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04222a8-e459-4726-9ed9-bafd15659a68 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:07.705332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04222a8-e459-4726-9ed9-bafd15659a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:07.705798 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04222a8-e459-4726-9ed9-bafd15659a68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:07.706711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04222a8-e459-4726-9ed9-bafd15659a68 None admin] RBAC: Adding query filter params (role.id=f5585030f686473c89e1de214b25b6ff, user.id=047b7b654600452193763a0dc2ffddc3, scope.system=all) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:07.707263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04222a8-e459-4726-9ed9-bafd15659a68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:07.708890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04222a8-e459-4726-9ed9-bafd15659a68 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:07.715369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 145/281] 10.222.0.33 () {56 vars in 1308 bytes} [Sun Sep 11 00:40:07 2022] GET /identity/v3/role_assignments?user.id=047b7b654600452193763a0dc2ffddc3&scope.system=all&role.id=f5585030f686473c89e1de214b25b6ff => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:07.807230 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49f105-c1bf-41be-9904-addafe42f59d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:07.933834 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49f105-c1bf-41be-9904-addafe42f59d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:07.984960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed5d09-8fb3-43f1-9970-a2097c6ee946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:07.985596 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed5d09-8fb3-43f1-9970-a2097c6ee946 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:07.985874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed5d09-8fb3-43f1-9970-a2097c6ee946 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:07.986142 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed5d09-8fb3-43f1-9970-a2097c6ee946 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:07.997386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed5d09-8fb3-43f1-9970-a2097c6ee946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ffed5d09-8fb3-43f1-9970-a2097c6ee946 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:08.002243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:08.003133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:08.003925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:08.003925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:08.003925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:08.003925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:08.003925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:08.003925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:08.003925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:08.003925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:08.003925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:08.003925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:08.003925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:40:08.003925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:08.003925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 137/282] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:08.009429 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04222a8-e459-4726-9ed9-bafd15659a68 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:08.048945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:08.148898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04222a8-e459-4726-9ed9-bafd15659a68 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:08.194406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae93be-7ede-4907-9a75-ed1895c81fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:08.195094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae93be-7ede-4907-9a75-ed1895c81fec None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:08.195370 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae93be-7ede-4907-9a75-ed1895c81fec None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:08.195637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae93be-7ede-4907-9a75-ed1895c81fec None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:08.196307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae93be-7ede-4907-9a75-ed1895c81fec None admin] RBAC: Adding query filter params (name=reader) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:08.196607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae93be-7ede-4907-9a75-ed1895c81fec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:08.197997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae93be-7ede-4907-9a75-ed1895c81fec None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:08.206894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 146/283] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:08.215838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed5d09-8fb3-43f1-9970-a2097c6ee946 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:08.302297 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:08.370418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed5d09-8fb3-43f1-9970-a2097c6ee946 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:08.417668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77598b-ad91-48fa-883f-65c511b9b9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:08.418220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77598b-ad91-48fa-883f-65c511b9b9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:08.418500 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77598b-ad91-48fa-883f-65c511b9b9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:08.418876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77598b-ad91-48fa-883f-65c511b9b9f6 None admin] PATH_INFO: `/v3/users/9ae7b26373f34e30833b33b49a012ff0` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:08.425781 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77598b-ad91-48fa-883f-65c511b9b9f6 None admin] RBAC: Authorizing `identity:get_user(user_id=9ae7b26373f34e30833b33b49a012ff0)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:08.425781 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77598b-ad91-48fa-883f-65c511b9b9f6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:08.427297 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 138/284] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:08 2022] GET /identity/v3/users/9ae7b26373f34e30833b33b49a012ff0 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:08.439599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae93be-7ede-4907-9a75-ed1895c81fec None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:08.487789 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8c9e1-9a3b-4ba1-9a4b-c90df325c266 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:08.488535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8c9e1-9a3b-4ba1-9a4b-c90df325c266 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:08.489008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8c9e1-9a3b-4ba1-9a4b-c90df325c266 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:08.490967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 139/285] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:08.497319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cdfae-61bf-42cc-835f-1e6d8c0aa8cf None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:08.497862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cdfae-61bf-42cc-835f-1e6d8c0aa8cf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:08.498358 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cdfae-61bf-42cc-835f-1e6d8c0aa8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:08.534376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-532cdfae-61bf-42cc-835f-1e6d8c0aa8cf None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:08.535578 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-532cdfae-61bf-42cc-835f-1e6d8c0aa8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:08.592183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:08.611037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae93be-7ede-4907-9a75-ed1895c81fec None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:08.658236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 140/286] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:08.666746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0187d-43a8-4d96-b213-259854cc1624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:08.667629 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0187d-43a8-4d96-b213-259854cc1624 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:08.668132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0187d-43a8-4d96-b213-259854cc1624 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:08.668574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0187d-43a8-4d96-b213-259854cc1624 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:08.669946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0187d-43a8-4d96-b213-259854cc1624 None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:08.671580 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0187d-43a8-4d96-b213-259854cc1624 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:08.673651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 147/287] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:08 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:08.679503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cdfae-61bf-42cc-835f-1e6d8c0aa8cf None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:08.738813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:08.781985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cdfae-61bf-42cc-835f-1e6d8c0aa8cf None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:08.816076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e710-13da-4308-af37-2fa1c1445b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:08.817024 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e710-13da-4308-af37-2fa1c1445b89 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:08.817474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e710-13da-4308-af37-2fa1c1445b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:08.817931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e710-13da-4308-af37-2fa1c1445b89 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32/users/9ae7b26373f34e30833b33b49a012ff0/roles/ec07f55a1c534d79af2517e37b41fc75` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:08.820110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995e710-13da-4308-af37-2fa1c1445b89 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1020531a2814c51b1db55f62f23ea32, user_id=9ae7b26373f34e30833b33b49a012ff0, role_id=ec07f55a1c534d79af2517e37b41fc75)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:08.822351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995e710-13da-4308-af37-2fa1c1445b89 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:08.846023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 141/288] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:40:08 2022] PUT /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32/users/9ae7b26373f34e30833b33b49a012ff0/roles/ec07f55a1c534d79af2517e37b41fc75 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:40:09.090909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0187d-43a8-4d96-b213-259854cc1624 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:09.203605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0187d-43a8-4d96-b213-259854cc1624 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:09.239186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc67b15-dbb6-4fbf-ab5d-cc8e48f42092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:09.239821 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc67b15-dbb6-4fbf-ab5d-cc8e48f42092 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:09.240095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc67b15-dbb6-4fbf-ab5d-cc8e48f42092 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:09.240360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc67b15-dbb6-4fbf-ab5d-cc8e48f42092 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:09.251332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc67b15-dbb6-4fbf-ab5d-cc8e48f42092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-bcc67b15-dbb6-4fbf-ab5d-cc8e48f42092 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:09.256783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:09.257663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:09.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:09.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:09.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:09.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:09.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:09.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:09.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:09.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:09.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:09.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:09.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:09.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:09.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 148/289] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:09.264401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e710-13da-4308-af37-2fa1c1445b89 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:09.411455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e710-13da-4308-af37-2fa1c1445b89 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:09.439094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:09.471257 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98850afc-a3cf-4752-ad6a-b88480cb7b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:09.472075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98850afc-a3cf-4752-ad6a-b88480cb7b25 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:09.472353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98850afc-a3cf-4752-ad6a-b88480cb7b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:09.472620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98850afc-a3cf-4752-ad6a-b88480cb7b25 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:09.473303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98850afc-a3cf-4752-ad6a-b88480cb7b25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:09.473601 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98850afc-a3cf-4752-ad6a-b88480cb7b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:09.475004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98850afc-a3cf-4752-ad6a-b88480cb7b25 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:09.490273 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 142/290] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:09.496701 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc67b15-dbb6-4fbf-ab5d-cc8e48f42092 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:09.527891 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:09.643973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc67b15-dbb6-4fbf-ab5d-cc8e48f42092 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:09.675910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181b8f8-322a-4956-a366-82a4d0223185 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:09.676397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181b8f8-322a-4956-a366-82a4d0223185 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:09.676397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181b8f8-322a-4956-a366-82a4d0223185 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:09.678036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 143/291] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:09.683573 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a60875-921e-408e-995a-c13105ae9b38 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:09.683912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a60875-921e-408e-995a-c13105ae9b38 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:09.684254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a60875-921e-408e-995a-c13105ae9b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:09.690410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f123e57-9f3f-4dfe-9fed-f5eda3054b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:09.691518 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f123e57-9f3f-4dfe-9fed-f5eda3054b70 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:09.691974 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f123e57-9f3f-4dfe-9fed-f5eda3054b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:09.693289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f123e57-9f3f-4dfe-9fed-f5eda3054b70 None admin] PATH_INFO: `/v3/users/6ee15c80c02e487e80e858cbce46348f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:09.697790 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f123e57-9f3f-4dfe-9fed-f5eda3054b70 None admin] RBAC: Authorizing `identity:get_user(user_id=6ee15c80c02e487e80e858cbce46348f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:09.700197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f123e57-9f3f-4dfe-9fed-f5eda3054b70 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:09.702289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 149/292] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:09 2022] GET /identity/v3/users/6ee15c80c02e487e80e858cbce46348f => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:09.703694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-28a60875-921e-408e-995a-c13105ae9b38 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:09.704929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-28a60875-921e-408e-995a-c13105ae9b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:09.707564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f123e57-9f3f-4dfe-9fed-f5eda3054b70 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:09.834464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 144/293] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:09.841516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:09.851017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f123e57-9f3f-4dfe-9fed-f5eda3054b70 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:09.903437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c8b15-69e5-4e60-8ca6-815eef62b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:09.904057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c8b15-69e5-4e60-8ca6-815eef62b8ee None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:09.904340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c8b15-69e5-4e60-8ca6-815eef62b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:09.904604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c8b15-69e5-4e60-8ca6-815eef62b8ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:09.937149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3237bc-4d90-46ea-a259-a4bb03033d99 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:09.937436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3237bc-4d90-46ea-a259-a4bb03033d99 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:09.937621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3237bc-4d90-46ea-a259-a4bb03033d99 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:09.939339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 145/294] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:40:09.944453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5df83f-3c5a-4e2e-a991-311c13120c20 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:09.944735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5df83f-3c5a-4e2e-a991-311c13120c20 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:09.945009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5df83f-3c5a-4e2e-a991-311c13120c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:09.974990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ca5df83f-3c5a-4e2e-a991-311c13120c20 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:09.976301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ca5df83f-3c5a-4e2e-a991-311c13120c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:10.004700 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c8b15-69e5-4e60-8ca6-815eef62b8ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:10.006167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c8b15-69e5-4e60-8ca6-815eef62b8ee None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:10.051513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 146/295] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:10.152317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:10.174927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 150/296] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:10.180425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5df83f-3c5a-4e2e-a991-311c13120c20 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:10.223405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:10.295892 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5df83f-3c5a-4e2e-a991-311c13120c20 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:10.330524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810385eb-99b7-4524-a4e9-280c0d647189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:10.331184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810385eb-99b7-4524-a4e9-280c0d647189 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:10.331464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810385eb-99b7-4524-a4e9-280c0d647189 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:10.331732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810385eb-99b7-4524-a4e9-280c0d647189 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:10.332848 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810385eb-99b7-4524-a4e9-280c0d647189 None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:10.334363 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810385eb-99b7-4524-a4e9-280c0d647189 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:10.336188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 147/297] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:10 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:10.343964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c8b15-69e5-4e60-8ca6-815eef62b8ee None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:10.387397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810385eb-99b7-4524-a4e9-280c0d647189 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:10.495971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c8b15-69e5-4e60-8ca6-815eef62b8ee None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:10.521129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810385eb-99b7-4524-a4e9-280c0d647189 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:10.531511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:10.537410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552783ab-41e2-4ff7-a032-d12a134f4847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:10.538813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552783ab-41e2-4ff7-a032-d12a134f4847 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:10.539595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552783ab-41e2-4ff7-a032-d12a134f4847 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:10.540062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552783ab-41e2-4ff7-a032-d12a134f4847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:10.541011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552783ab-41e2-4ff7-a032-d12a134f4847 None admin] RBAC: Adding query filter params (role.id=f5585030f686473c89e1de214b25b6ff, scope.project.id=c1020531a2814c51b1db55f62f23ea32, user.id=6ee15c80c02e487e80e858cbce46348f) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:10.541514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552783ab-41e2-4ff7-a032-d12a134f4847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:10.543915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552783ab-41e2-4ff7-a032-d12a134f4847 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:10.550973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 151/298] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:10 2022] GET /identity/v3/role_assignments?user.id=6ee15c80c02e487e80e858cbce46348f&scope.project.id=c1020531a2814c51b1db55f62f23ea32&role.id=f5585030f686473c89e1de214b25b6ff => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:10.552085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552783ab-41e2-4ff7-a032-d12a134f4847 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:10.559493 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b34a7-42d5-4cbf-8767-6f01c6b5c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:10.560153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b34a7-42d5-4cbf-8767-6f01c6b5c1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:10.560430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b34a7-42d5-4cbf-8767-6f01c6b5c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:10.560699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b34a7-42d5-4cbf-8767-6f01c6b5c1d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:10.579014 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b34a7-42d5-4cbf-8767-6f01c6b5c1d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3e1b34a7-42d5-4cbf-8767-6f01c6b5c1d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:10.584494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:10.585462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:10.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:10.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:10.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:10.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:10.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:10.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:10.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:10.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:10.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:10.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:10.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:40:10.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:10.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 148/299] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:10.586964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3f0ea-55e9-4695-90be-8cb840c7cdb0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:10.588333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3f0ea-55e9-4695-90be-8cb840c7cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:10.588333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3f0ea-55e9-4695-90be-8cb840c7cdb0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:10.593446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 149/300] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:10.595345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3f0ea-55e9-4695-90be-8cb840c7cdb0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:10.626129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:10.690903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552783ab-41e2-4ff7-a032-d12a134f4847 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:10.723163 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3f0ea-55e9-4695-90be-8cb840c7cdb0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:10.742913 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ee9a6-97e0-46e4-bb95-822b020aae25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:10.742913 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ee9a6-97e0-46e4-bb95-822b020aae25 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:10.742913 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ee9a6-97e0-46e4-bb95-822b020aae25 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:10.742913 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ee9a6-97e0-46e4-bb95-822b020aae25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:10.744055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ee9a6-97e0-46e4-bb95-822b020aae25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:10.745620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ee9a6-97e0-46e4-bb95-822b020aae25 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:10.747208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 152/301] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:10.752814 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0774091-f597-40f8-9b9b-2f362d316c38 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:10.753104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0774091-f597-40f8-9b9b-2f362d316c38 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:10.753440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0774091-f597-40f8-9b9b-2f362d316c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:10.773095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70861588-4a70-4df1-a5fe-aa8f56398ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:10.773717 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70861588-4a70-4df1-a5fe-aa8f56398ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:10.773910 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b0774091-f597-40f8-9b9b-2f362d316c38 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:10.774008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70861588-4a70-4df1-a5fe-aa8f56398ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:10.774296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70861588-4a70-4df1-a5fe-aa8f56398ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:10.774992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70861588-4a70-4df1-a5fe-aa8f56398ab7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:10.775105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b0774091-f597-40f8-9b9b-2f362d316c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:10.775917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70861588-4a70-4df1-a5fe-aa8f56398ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:10.777393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70861588-4a70-4df1-a5fe-aa8f56398ab7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:10.788653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 150/302] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:10.789650 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70861588-4a70-4df1-a5fe-aa8f56398ab7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:10.824009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:10.869031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 153/303] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:10.875980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0774091-f597-40f8-9b9b-2f362d316c38 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:10.910296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70861588-4a70-4df1-a5fe-aa8f56398ab7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:10.939711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:10.944617 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75af496-10c3-4fa3-ba88-29eea18b2524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:10.945747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af496-10c3-4fa3-ba88-29eea18b2524 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:10.946556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af496-10c3-4fa3-ba88-29eea18b2524 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:10.947750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af496-10c3-4fa3-ba88-29eea18b2524 None admin] PATH_INFO: `/v3/groups` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:10.948577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75af496-10c3-4fa3-ba88-29eea18b2524 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:10.950224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75af496-10c3-4fa3-ba88-29eea18b2524 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:10.974846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 151/304] 10.222.0.33 () {60 vars in 1134 bytes} [Sun Sep 11 00:40:10 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:40:11.003723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0774091-f597-40f8-9b9b-2f362d316c38 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:11.044475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15485af-740f-473d-bc81-db3f125baf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:11.045134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15485af-740f-473d-bc81-db3f125baf1b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:11.045443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15485af-740f-473d-bc81-db3f125baf1b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:11.045697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15485af-740f-473d-bc81-db3f125baf1b None admin] PATH_INFO: `/v3/users/89c8946b6e5a491fa22cef216d804913` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:11.063085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15485af-740f-473d-bc81-db3f125baf1b None admin] RBAC: Authorizing `identity:get_user(user_id=89c8946b6e5a491fa22cef216d804913)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:11.064635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15485af-740f-473d-bc81-db3f125baf1b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:11.066713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 154/305] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:10 2022] GET /identity/v3/users/89c8946b6e5a491fa22cef216d804913 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:11.072763 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75af496-10c3-4fa3-ba88-29eea18b2524 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:11.141898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15485af-740f-473d-bc81-db3f125baf1b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:11.171231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:11.192579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75af496-10c3-4fa3-ba88-29eea18b2524 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:11.238648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f3edf-7428-4108-b115-49b468fe2d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:11.239434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f3edf-7428-4108-b115-49b468fe2d8f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:11.239812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f3edf-7428-4108-b115-49b468fe2d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:11.240199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f3edf-7428-4108-b115-49b468fe2d8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:11.241027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f3edf-7428-4108-b115-49b468fe2d8f None admin] RBAC: Adding query filter params (role.id=ec07f55a1c534d79af2517e37b41fc75, user.id=89c8946b6e5a491fa22cef216d804913, scope.system=all) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:11.241340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f3edf-7428-4108-b115-49b468fe2d8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:11.242817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f3edf-7428-4108-b115-49b468fe2d8f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:11.250424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 152/306] 10.222.0.33 () {56 vars in 1308 bytes} [Sun Sep 11 00:40:11 2022] GET /identity/v3/role_assignments?user.id=89c8946b6e5a491fa22cef216d804913&scope.system=all&role.id=ec07f55a1c534d79af2517e37b41fc75 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:11.284654 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15485af-740f-473d-bc81-db3f125baf1b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:11.293315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:11.323216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c90f99-796c-49fb-a94d-825fd1179761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:11.323874 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90f99-796c-49fb-a94d-825fd1179761 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:11.324148 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90f99-796c-49fb-a94d-825fd1179761 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:11.324410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90f99-796c-49fb-a94d-825fd1179761 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:11.336301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c90f99-796c-49fb-a94d-825fd1179761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-92c90f99-796c-49fb-a94d-825fd1179761 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:11.341799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:11.342781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:11.343823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:11.343823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:11.343823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:11.343823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:11.343823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:11.343823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:11.343823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:11.343823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:11.343823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:11.343823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:11.343823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:11.343823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:11.343823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 155/307] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:11.351247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f3edf-7428-4108-b115-49b468fe2d8f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:11.469221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f3edf-7428-4108-b115-49b468fe2d8f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:11.502406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975591a8-c49c-4ed6-8765-56fbd4a836bf None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:11.502713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975591a8-c49c-4ed6-8765-56fbd4a836bf None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:11.502992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975591a8-c49c-4ed6-8765-56fbd4a836bf None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:11.504584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 156/308] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:40:11.504693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4287e-2e2d-40d8-bf9a-6e19ea2f46fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:11.505188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4287e-2e2d-40d8-bf9a-6e19ea2f46fd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:11.505465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4287e-2e2d-40d8-bf9a-6e19ea2f46fd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:11.505781 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4287e-2e2d-40d8-bf9a-6e19ea2f46fd None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:11.506445 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4287e-2e2d-40d8-bf9a-6e19ea2f46fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:11.506754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4287e-2e2d-40d8-bf9a-6e19ea2f46fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:11.508120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4287e-2e2d-40d8-bf9a-6e19ea2f46fd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:11.509665 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc168f0-a729-4082-910f-f69b64ab4709 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:11.509958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc168f0-a729-4082-910f-f69b64ab4709 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:11.510234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc168f0-a729-4082-910f-f69b64ab4709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:11.517461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 153/309] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:11.522844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4287e-2e2d-40d8-bf9a-6e19ea2f46fd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:11.530329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2bc168f0-a729-4082-910f-f69b64ab4709 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:11.531555 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2bc168f0-a729-4082-910f-f69b64ab4709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:11.539413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:11.607005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 157/310] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:11.625318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4287e-2e2d-40d8-bf9a-6e19ea2f46fd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:11.659572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741abb20-27a6-4cff-b5e6-f10410d4770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:11.660207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741abb20-27a6-4cff-b5e6-f10410d4770d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:11.660483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741abb20-27a6-4cff-b5e6-f10410d4770d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:11.660749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741abb20-27a6-4cff-b5e6-f10410d4770d None admin] PATH_INFO: `/v3/users/047b7b654600452193763a0dc2ffddc3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:11.661877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741abb20-27a6-4cff-b5e6-f10410d4770d None admin] RBAC: Authorizing `identity:get_user(user_id=047b7b654600452193763a0dc2ffddc3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:11.663427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741abb20-27a6-4cff-b5e6-f10410d4770d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:11.665039 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 154/311] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:11 2022] GET /identity/v3/users/047b7b654600452193763a0dc2ffddc3 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:11.671266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc168f0-a729-4082-910f-f69b64ab4709 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:11.768762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:11.774648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc168f0-a729-4082-910f-f69b64ab4709 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:11.810784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e6875-7a97-4414-92f2-7ce4c1f84880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:11.811368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e6875-7a97-4414-92f2-7ce4c1f84880 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:11.811647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e6875-7a97-4414-92f2-7ce4c1f84880 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:11.811917 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e6875-7a97-4414-92f2-7ce4c1f84880 None admin] PATH_INFO: `/v3/system/users/047b7b654600452193763a0dc2ffddc3/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:11.813336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e6875-7a97-4414-92f2-7ce4c1f84880 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=047b7b654600452193763a0dc2ffddc3, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:11.814700 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e6875-7a97-4414-92f2-7ce4c1f84880 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:11.825129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 158/312] 10.222.0.33 () {58 vars in 1334 bytes} [Sun Sep 11 00:40:11 2022] PUT /identity/v3/system/users/047b7b654600452193763a0dc2ffddc3/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:40:11.909738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741abb20-27a6-4cff-b5e6-f10410d4770d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:12.014325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:12.035876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741abb20-27a6-4cff-b5e6-f10410d4770d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:12.071898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2eda0-d126-4c8f-be64-6f407f1bc0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:12.073036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2eda0-d126-4c8f-be64-6f407f1bc0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:12.073315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2eda0-d126-4c8f-be64-6f407f1bc0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:12.073579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2eda0-d126-4c8f-be64-6f407f1bc0f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:12.083905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2eda0-d126-4c8f-be64-6f407f1bc0f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-35f2eda0-d126-4c8f-be64-6f407f1bc0f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:12.089516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:12.090412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:12.091231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:12.091231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:12.091231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:12.091231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:12.091231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:12.091231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:12.091231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:12.091231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:12.091231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:12.091231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:12.091231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:40:12.091231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:12.091231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 155/313] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:12.096491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e6875-7a97-4414-92f2-7ce4c1f84880 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:12.202758 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e6875-7a97-4414-92f2-7ce4c1f84880 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:12.239258 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058ead6-6563-434c-9a2b-a67f56ec2a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:12.239862 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058ead6-6563-434c-9a2b-a67f56ec2a5a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:12.240176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058ead6-6563-434c-9a2b-a67f56ec2a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:12.240402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058ead6-6563-434c-9a2b-a67f56ec2a5a None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:12.241067 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058ead6-6563-434c-9a2b-a67f56ec2a5a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:12.241370 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058ead6-6563-434c-9a2b-a67f56ec2a5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:12.242721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058ead6-6563-434c-9a2b-a67f56ec2a5a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:12.251759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 159/314] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:12.257367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2eda0-d126-4c8f-be64-6f407f1bc0f8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:12.365080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2eda0-d126-4c8f-be64-6f407f1bc0f8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:12.399810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d46e6-c7d6-44c6-90d3-61d41bb73f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:12.400489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d46e6-c7d6-44c6-90d3-61d41bb73f18 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:12.401281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d46e6-c7d6-44c6-90d3-61d41bb73f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:12.401552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d46e6-c7d6-44c6-90d3-61d41bb73f18 None admin] PATH_INFO: `/v3/users/9ae7b26373f34e30833b33b49a012ff0` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:12.402679 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d46e6-c7d6-44c6-90d3-61d41bb73f18 None admin] RBAC: Authorizing `identity:get_user(user_id=9ae7b26373f34e30833b33b49a012ff0)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:12.404140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d46e6-c7d6-44c6-90d3-61d41bb73f18 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:12.406032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 156/315] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:12 2022] GET /identity/v3/users/9ae7b26373f34e30833b33b49a012ff0 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:12.411211 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058ead6-6563-434c-9a2b-a67f56ec2a5a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:12.437343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:12.516992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058ead6-6563-434c-9a2b-a67f56ec2a5a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:12.551821 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c870861-87b2-4cfc-83d6-8ac479ecb52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:12.552429 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870861-87b2-4cfc-83d6-8ac479ecb52a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:12.552710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870861-87b2-4cfc-83d6-8ac479ecb52a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:12.552981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870861-87b2-4cfc-83d6-8ac479ecb52a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:12.623340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c870861-87b2-4cfc-83d6-8ac479ecb52a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:12.624725 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c870861-87b2-4cfc-83d6-8ac479ecb52a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:12.649617 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:12.729017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 160/316] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:12.735869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d46e6-c7d6-44c6-90d3-61d41bb73f18 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:12.746226 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:12.844168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d46e6-c7d6-44c6-90d3-61d41bb73f18 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:12.882997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d8e68-4fb6-4482-968f-d30ea3011387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:12.883601 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d8e68-4fb6-4482-968f-d30ea3011387 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:12.883883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d8e68-4fb6-4482-968f-d30ea3011387 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:12.884152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d8e68-4fb6-4482-968f-d30ea3011387 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:12.885822 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d8e68-4fb6-4482-968f-d30ea3011387 None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:12.887359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d8e68-4fb6-4482-968f-d30ea3011387 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:12.889299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 157/317] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:12 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:12.894888 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c870861-87b2-4cfc-83d6-8ac479ecb52a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:13.004291 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c870861-87b2-4cfc-83d6-8ac479ecb52a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:13.028797 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:13.042089 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d4115-21f2-4535-9dc5-50cf87a5c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:13.042909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d4115-21f2-4535-9dc5-50cf87a5c946 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:13.043205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d4115-21f2-4535-9dc5-50cf87a5c946 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:13.043527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d4115-21f2-4535-9dc5-50cf87a5c946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:13.044263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d4115-21f2-4535-9dc5-50cf87a5c946 None admin] RBAC: Adding query filter params (role.id=ec07f55a1c534d79af2517e37b41fc75, scope.project.id=c1020531a2814c51b1db55f62f23ea32, user.id=9ae7b26373f34e30833b33b49a012ff0) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:13.044568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d4115-21f2-4535-9dc5-50cf87a5c946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:13.046197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d4115-21f2-4535-9dc5-50cf87a5c946 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:13.053438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 161/318] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:12 2022] GET /identity/v3/role_assignments?user.id=9ae7b26373f34e30833b33b49a012ff0&scope.project.id=c1020531a2814c51b1db55f62f23ea32&role.id=ec07f55a1c534d79af2517e37b41fc75 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:13.350404 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b18921-a61e-4161-b345-df6c646aaec9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:13.350942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b18921-a61e-4161-b345-df6c646aaec9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:13.351025 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b18921-a61e-4161-b345-df6c646aaec9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:13.352322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 158/319] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:13.358005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df927478-70f8-4aaa-993c-c2aedcd3126a None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:13.358292 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df927478-70f8-4aaa-993c-c2aedcd3126a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:13.358561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df927478-70f8-4aaa-993c-c2aedcd3126a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:13.377192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-df927478-70f8-4aaa-993c-c2aedcd3126a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:13.378365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-df927478-70f8-4aaa-993c-c2aedcd3126a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:13.455657 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 162/320] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:13.534411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953514f-e4be-4d90-b46d-d3edb8e50cdb None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:13.534801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953514f-e4be-4d90-b46d-d3edb8e50cdb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:13.535167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953514f-e4be-4d90-b46d-d3edb8e50cdb None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:13.536606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 159/321] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:13.541708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17709b-a271-4a6b-9c65-9bf9595463ca None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:13.541991 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17709b-a271-4a6b-9c65-9bf9595463ca None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:13.542260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17709b-a271-4a6b-9c65-9bf9595463ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:13.560750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0f17709b-a271-4a6b-9c65-9bf9595463ca None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:13.561904 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0f17709b-a271-4a6b-9c65-9bf9595463ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:13.629547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 163/322] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:13.722884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953514f-e4be-4d90-b46d-d3edb8e50cdb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:13.798443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:13.824648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953514f-e4be-4d90-b46d-d3edb8e50cdb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:13.857703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f776d-14c1-435b-9d82-9de3c7df0ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:13.858317 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f776d-14c1-435b-9d82-9de3c7df0ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:13.858588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f776d-14c1-435b-9d82-9de3c7df0ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:13.858879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f776d-14c1-435b-9d82-9de3c7df0ce0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:13.859950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f776d-14c1-435b-9d82-9de3c7df0ce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:13.861384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f776d-14c1-435b-9d82-9de3c7df0ce0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:13.863100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 160/323] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:13.868578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17709b-a271-4a6b-9c65-9bf9595463ca None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:13.898425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f776d-14c1-435b-9d82-9de3c7df0ce0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:13.915627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:13.974151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17709b-a271-4a6b-9c65-9bf9595463ca None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:14.006857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f776d-14c1-435b-9d82-9de3c7df0ce0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:14.008592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b1883-5feb-488e-80a9-652c92335713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:14.009684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b1883-5feb-488e-80a9-652c92335713 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:14.009684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b1883-5feb-488e-80a9-652c92335713 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:14.009684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b1883-5feb-488e-80a9-652c92335713 None admin] PATH_INFO: `/v3/groups` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:14.010922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b1883-5feb-488e-80a9-652c92335713 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:14.012337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b1883-5feb-488e-80a9-652c92335713 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:14.031328 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 164/324] 10.222.0.33 () {60 vars in 1134 bytes} [Sun Sep 11 00:40:13 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:40:14.049117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31c754-2e59-404b-9576-4374abb62e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:14.049776 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31c754-2e59-404b-9576-4374abb62e61 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:14.050057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31c754-2e59-404b-9576-4374abb62e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:14.050318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31c754-2e59-404b-9576-4374abb62e61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:14.062114 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe14a7e-7a33-450e-9b39-d0a555a39a22 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:14.062397 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe14a7e-7a33-450e-9b39-d0a555a39a22 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:14.062608 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31c754-2e59-404b-9576-4374abb62e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:14.062856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe14a7e-7a33-450e-9b39-d0a555a39a22 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:14.064151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 165/325] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4b31c754-2e59-404b-9576-4374abb62e61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:14.068328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:14.069298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:14.071755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:14.071755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:14.071755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:14.071755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:14.071755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:14.071755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:14.071755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:14.071755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:14.071755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:14.071755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:14.071755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:40:14.071755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:14.072351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b782f2-6e91-49ba-8d8f-1c8ba19d2ecf None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:14.072434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 161/326] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:14.072502 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b782f2-6e91-49ba-8d8f-1c8ba19d2ecf None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:14.072502 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b782f2-6e91-49ba-8d8f-1c8ba19d2ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:14.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31c754-2e59-404b-9576-4374abb62e61 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:14.078888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:14.092916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-54b782f2-6e91-49ba-8d8f-1c8ba19d2ecf None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:14.094130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-54b782f2-6e91-49ba-8d8f-1c8ba19d2ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:14.172231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 166/327] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:14.188153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31c754-2e59-404b-9576-4374abb62e61 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:14.227091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb056ff0-3d7e-491f-ab61-0dc588338e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:14.228001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb056ff0-3d7e-491f-ab61-0dc588338e9c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:14.228276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb056ff0-3d7e-491f-ab61-0dc588338e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:14.228542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb056ff0-3d7e-491f-ab61-0dc588338e9c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:14.229221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb056ff0-3d7e-491f-ab61-0dc588338e9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:14.229517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb056ff0-3d7e-491f-ab61-0dc588338e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:14.230920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb056ff0-3d7e-491f-ab61-0dc588338e9c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:14.239720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 162/328] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:14.245779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b782f2-6e91-49ba-8d8f-1c8ba19d2ecf None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:14.280571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:14.353006 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b782f2-6e91-49ba-8d8f-1c8ba19d2ecf None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:14.393398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e318e6-cd21-4c76-a988-aea6e90ec0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:14.394033 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e318e6-cd21-4c76-a988-aea6e90ec0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:14.394309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e318e6-cd21-4c76-a988-aea6e90ec0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:14.394577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e318e6-cd21-4c76-a988-aea6e90ec0e4 None admin] PATH_INFO: `/v3/users/89c8946b6e5a491fa22cef216d804913` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:14.395753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e318e6-cd21-4c76-a988-aea6e90ec0e4 None admin] RBAC: Authorizing `identity:get_user(user_id=89c8946b6e5a491fa22cef216d804913)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:14.397192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e318e6-cd21-4c76-a988-aea6e90ec0e4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:14.398938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 167/329] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:14 2022] GET /identity/v3/users/89c8946b6e5a491fa22cef216d804913 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:14.404994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb056ff0-3d7e-491f-ab61-0dc588338e9c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:14.466764 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e318e6-cd21-4c76-a988-aea6e90ec0e4 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:14.475400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:14.520214 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb056ff0-3d7e-491f-ab61-0dc588338e9c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:14.559371 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b491b-3afa-4ccd-80c4-92fd19314d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:14.560122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b491b-3afa-4ccd-80c4-92fd19314d56 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:14.560401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b491b-3afa-4ccd-80c4-92fd19314d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:14.560673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b491b-3afa-4ccd-80c4-92fd19314d56 None admin] PATH_INFO: `/v3/system/users/89c8946b6e5a491fa22cef216d804913/roles/ec07f55a1c534d79af2517e37b41fc75` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:14.562635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b491b-3afa-4ccd-80c4-92fd19314d56 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=89c8946b6e5a491fa22cef216d804913, role_id=ec07f55a1c534d79af2517e37b41fc75)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:14.564042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b491b-3afa-4ccd-80c4-92fd19314d56 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:14.575247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 163/330] 10.222.0.33 () {58 vars in 1334 bytes} [Sun Sep 11 00:40:14 2022] PUT /identity/v3/system/users/89c8946b6e5a491fa22cef216d804913/roles/ec07f55a1c534d79af2517e37b41fc75 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:40:14.585172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e318e6-cd21-4c76-a988-aea6e90ec0e4 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:14.612777 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:14.628014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5756-6bfc-469f-97e4-3a085c68051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:14.628683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5756-6bfc-469f-97e4-3a085c68051f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:14.628963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5756-6bfc-469f-97e4-3a085c68051f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:14.629237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5756-6bfc-469f-97e4-3a085c68051f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:14.642157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f5756-6bfc-469f-97e4-3a085c68051f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-323f5756-6bfc-469f-97e4-3a085c68051f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:14.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:14.648392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:14.649181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:14.649181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:14.649181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:14.649181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:14.649181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:14.649181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:14.649181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:14.649181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:14.649181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:14.649181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:14.649181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:14.649181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:14.649181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 168/331] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:14.657671 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b491b-3afa-4ccd-80c4-92fd19314d56 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:14.791257 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b491b-3afa-4ccd-80c4-92fd19314d56 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:14.819678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:14.829814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43537cf-09e2-4830-bcb3-2522879eca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:14.830428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43537cf-09e2-4830-bcb3-2522879eca55 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:14.830705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43537cf-09e2-4830-bcb3-2522879eca55 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:14.831025 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43537cf-09e2-4830-bcb3-2522879eca55 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:14.831698 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43537cf-09e2-4830-bcb3-2522879eca55 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:14.832004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43537cf-09e2-4830-bcb3-2522879eca55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:14.833484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43537cf-09e2-4830-bcb3-2522879eca55 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:14.843833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 164/332] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:14.851064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5756-6bfc-469f-97e4-3a085c68051f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:14.972359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5756-6bfc-469f-97e4-3a085c68051f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:15.013044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606c4c5-970e-473f-82ec-4db4ba76609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:15.014054 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606c4c5-970e-473f-82ec-4db4ba76609e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:15.014581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606c4c5-970e-473f-82ec-4db4ba76609e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:15.015071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606c4c5-970e-473f-82ec-4db4ba76609e None admin] PATH_INFO: `/v3/users/047b7b654600452193763a0dc2ffddc3` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:15.016417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606c4c5-970e-473f-82ec-4db4ba76609e None admin] RBAC: Authorizing `identity:get_user(user_id=047b7b654600452193763a0dc2ffddc3)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:15.018122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606c4c5-970e-473f-82ec-4db4ba76609e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:15.019911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 169/333] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:14 2022] GET /identity/v3/users/047b7b654600452193763a0dc2ffddc3 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:15.026413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43537cf-09e2-4830-bcb3-2522879eca55 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:15.150252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43537cf-09e2-4830-bcb3-2522879eca55 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:15.192753 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816dbc6-b6f4-43a0-bfd4-0769cc1ecf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:15.193367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816dbc6-b6f4-43a0-bfd4-0769cc1ecf59 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:15.193643 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816dbc6-b6f4-43a0-bfd4-0769cc1ecf59 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:15.193914 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816dbc6-b6f4-43a0-bfd4-0769cc1ecf59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:15.194638 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816dbc6-b6f4-43a0-bfd4-0769cc1ecf59 None admin] RBAC: Adding query filter params (role.id=f5585030f686473c89e1de214b25b6ff, user.id=047b7b654600452193763a0dc2ffddc3, scope.system=all) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:15.194970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816dbc6-b6f4-43a0-bfd4-0769cc1ecf59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:15.196433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816dbc6-b6f4-43a0-bfd4-0769cc1ecf59 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:15.214902 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 165/334] 10.222.0.33 () {56 vars in 1308 bytes} [Sun Sep 11 00:40:15 2022] GET /identity/v3/role_assignments?user.id=047b7b654600452193763a0dc2ffddc3&scope.system=all&role.id=f5585030f686473c89e1de214b25b6ff => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:16.681362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c06dd7-a66c-42c6-a2d4-1da168d941a0 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:16.682881 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c06dd7-a66c-42c6-a2d4-1da168d941a0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:16.683380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c06dd7-a66c-42c6-a2d4-1da168d941a0 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:16.685157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 170/335] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:16.693335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9401379-5c30-404a-ab18-c87a900786b9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:16.693776 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9401379-5c30-404a-ab18-c87a900786b9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:16.693956 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9401379-5c30-404a-ab18-c87a900786b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:16.719679 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a9401379-5c30-404a-ab18-c87a900786b9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:16.720863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a9401379-5c30-404a-ab18-c87a900786b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:16.779999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:16.815364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 166/336] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:16.950682 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22633c1-8ee9-4102-97cd-36f67eca25d9 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:16.951327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22633c1-8ee9-4102-97cd-36f67eca25d9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:16.951786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22633c1-8ee9-4102-97cd-36f67eca25d9 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:16.953308 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 171/337] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:16.958855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad06f7e-6600-4e6c-94d0-945e7505668f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:16.959144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad06f7e-6600-4e6c-94d0-945e7505668f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:16.959413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad06f7e-6600-4e6c-94d0-945e7505668f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:16.981669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5ad06f7e-6600-4e6c-94d0-945e7505668f None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:16.982901 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5ad06f7e-6600-4e6c-94d0-945e7505668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:17.069383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 167/338] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:17.297922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22633c1-8ee9-4102-97cd-36f67eca25d9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:17.334392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:17.422817 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22633c1-8ee9-4102-97cd-36f67eca25d9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:17.467091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7742f-0ec9-46a5-8aa1-be3ed51877fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:17.467720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7742f-0ec9-46a5-8aa1-be3ed51877fd None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:17.467994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7742f-0ec9-46a5-8aa1-be3ed51877fd None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:17.468261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7742f-0ec9-46a5-8aa1-be3ed51877fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:17.478751 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7742f-0ec9-46a5-8aa1-be3ed51877fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-55e7742f-0ec9-46a5-8aa1-be3ed51877fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:17.484185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:17.485092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:17.485880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:17.485880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:17.485880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:17.485880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:17.485880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:17.485880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:17.485880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:17.485880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:17.485880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:17.485880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:17.485880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:17.485880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:17.485880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 172/339] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:17.491506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad06f7e-6600-4e6c-94d0-945e7505668f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:17.632636 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad06f7e-6600-4e6c-94d0-945e7505668f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:17.645587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:17.664047 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7742f-0ec9-46a5-8aa1-be3ed51877fd None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:17.681435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936704d7-53c5-4bb0-8f46-199a1b807c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:17.682061 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936704d7-53c5-4bb0-8f46-199a1b807c51 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:17.682342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936704d7-53c5-4bb0-8f46-199a1b807c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:17.683217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936704d7-53c5-4bb0-8f46-199a1b807c51 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:17.683949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936704d7-53c5-4bb0-8f46-199a1b807c51 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:17.684557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936704d7-53c5-4bb0-8f46-199a1b807c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:17.685749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936704d7-53c5-4bb0-8f46-199a1b807c51 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:17.699627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 168/340] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:17.712153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936704d7-53c5-4bb0-8f46-199a1b807c51 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:17.824902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:17.835193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7742f-0ec9-46a5-8aa1-be3ed51877fd None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:17.892484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb586d-e934-4b82-9e06-dc291da2c6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:17.893219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb586d-e934-4b82-9e06-dc291da2c6ab None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:17.893502 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb586d-e934-4b82-9e06-dc291da2c6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:17.893769 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb586d-e934-4b82-9e06-dc291da2c6ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:17.919962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936704d7-53c5-4bb0-8f46-199a1b807c51 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:17.921978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb586d-e934-4b82-9e06-dc291da2c6ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-3ecb586d-e934-4b82-9e06-dc291da2c6ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:17.926899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:17.927747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:17.928522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:17.928522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:17.928522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:17.928522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:17.928522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:17.928522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:17.928522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:17.928522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:17.928522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:17.928522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:17.928522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:17.928522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:17.928522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 173/341] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:40:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:17.929158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1efc3c-b043-4f72-a45a-4c92384215ad None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:17.929940 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1efc3c-b043-4f72-a45a-4c92384215ad None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:17.929940 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1efc3c-b043-4f72-a45a-4c92384215ad None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:17.937657 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 174/342] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:17.938488 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1efc3c-b043-4f72-a45a-4c92384215ad None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:17.990337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbdca6-72a3-46d6-b465-5d4f74c48c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:17.991051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbdca6-72a3-46d6-b465-5d4f74c48c5f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:17.991329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbdca6-72a3-46d6-b465-5d4f74c48c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:17.991598 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbdca6-72a3-46d6-b465-5d4f74c48c5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:18.056382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:18.096471 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbdca6-72a3-46d6-b465-5d4f74c48c5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:18.096744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1efc3c-b043-4f72-a45a-4c92384215ad None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:18.098189 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbdca6-72a3-46d6-b465-5d4f74c48c5f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:18.139706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e9424-5e3d-46a1-a07a-ccf8624ae8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:18.140309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e9424-5e3d-46a1-a07a-ccf8624ae8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:18.140745 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e9424-5e3d-46a1-a07a-ccf8624ae8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:18.141655 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e9424-5e3d-46a1-a07a-ccf8624ae8d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:18.142477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e9424-5e3d-46a1-a07a-ccf8624ae8d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:18.143080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e9424-5e3d-46a1-a07a-ccf8624ae8d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:18.144707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e9424-5e3d-46a1-a07a-ccf8624ae8d4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:18.155400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 175/343] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:18.157452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c837d-289f-4959-b559-e35957759930 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:18.157883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c837d-289f-4959-b559-e35957759930 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:18.158475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c837d-289f-4959-b559-e35957759930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:18.179435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d85c837d-289f-4959-b559-e35957759930 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:18.180839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d85c837d-289f-4959-b559-e35957759930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:18.194030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:18.221810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 169/344] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:40:18.223137 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541e8f4-71bf-400f-aee0-25d4d53b3b97 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:18.223521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541e8f4-71bf-400f-aee0-25d4d53b3b97 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:18.223794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541e8f4-71bf-400f-aee0-25d4d53b3b97 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:18.225368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 170/345] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:18.226070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541e8f4-71bf-400f-aee0-25d4d53b3b97 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:18.259203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 176/346] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:18.260585 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65544-f0a3-4ab1-acd3-a796ce41144c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:18.261438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65544-f0a3-4ab1-acd3-a796ce41144c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:18.261744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65544-f0a3-4ab1-acd3-a796ce41144c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:18.286493 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-54b65544-f0a3-4ab1-acd3-a796ce41144c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:18.287743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-54b65544-f0a3-4ab1-acd3-a796ce41144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:18.350887 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:18.403673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 177/347] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:18.404856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65544-f0a3-4ab1-acd3-a796ce41144c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:18.408116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541e8f4-71bf-400f-aee0-25d4d53b3b97 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:18.480357 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862bca9-3373-4bbb-99f7-f0f80f21ea32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:18.480970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862bca9-3373-4bbb-99f7-f0f80f21ea32 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:18.481246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862bca9-3373-4bbb-99f7-f0f80f21ea32 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:18.481511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862bca9-3373-4bbb-99f7-f0f80f21ea32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:18.513322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:18.545467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65544-f0a3-4ab1-acd3-a796ce41144c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:18.587045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9abd7-a704-4648-9265-339d395c2bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:18.587976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9abd7-a704-4648-9265-339d395c2bab None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:18.588417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9abd7-a704-4648-9265-339d395c2bab None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:18.588849 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9abd7-a704-4648-9265-339d395c2bab None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:18.592110 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9abd7-a704-4648-9265-339d395c2bab None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:18.594229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9abd7-a704-4648-9265-339d395c2bab None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:18.599045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 178/348] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:18 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:18.605337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9abd7-a704-4648-9265-339d395c2bab None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:18.610850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862bca9-3373-4bbb-99f7-f0f80f21ea32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:18.615527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862bca9-3373-4bbb-99f7-f0f80f21ea32 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:18.743482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:18.775488 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9abd7-a704-4648-9265-339d395c2bab None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:18.801768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 171/349] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:18.802644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862bca9-3373-4bbb-99f7-f0f80f21ea32 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:18.853379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e319d53-661c-4933-8488-67fa6475134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:18.854097 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e319d53-661c-4933-8488-67fa6475134f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:18.854559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e319d53-661c-4933-8488-67fa6475134f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:18.855185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e319d53-661c-4933-8488-67fa6475134f None admin] PATH_INFO: `/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:18.868512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e319d53-661c-4933-8488-67fa6475134f None admin] RBAC: Authorizing `identity:get_group(group_id=673236c8ef914f5d9fe82e0e9e3482a5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:18.871191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e319d53-661c-4933-8488-67fa6475134f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:18.873377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 179/350] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:18 2022] GET /identity/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:18.874520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e319d53-661c-4933-8488-67fa6475134f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:18.886600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:18.920660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862bca9-3373-4bbb-99f7-f0f80f21ea32 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:18.967946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920b7a3-8f69-419a-bdad-9dcfe463dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:18.968587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920b7a3-8f69-419a-bdad-9dcfe463dd7e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:18.968996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920b7a3-8f69-419a-bdad-9dcfe463dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:18.969267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920b7a3-8f69-419a-bdad-9dcfe463dd7e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:18.981106 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920b7a3-8f69-419a-bdad-9dcfe463dd7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a920b7a3-8f69-419a-bdad-9dcfe463dd7e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:18.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:18.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:18.989451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:18.989451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:18.989451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:18.989451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:18.989451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:18.989451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:18.989451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:18.989451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:18.989451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:18.989451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:18.989451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:40:18.989451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:18.990067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 172/351] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:18.992522 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920b7a3-8f69-419a-bdad-9dcfe463dd7e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:19.011146 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e319d53-661c-4933-8488-67fa6475134f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:19.031080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:19.050856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fea4c9-f95b-432d-a1e7-f1ebdc6da671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:19.051737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fea4c9-f95b-432d-a1e7-f1ebdc6da671 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:19.052189 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fea4c9-f95b-432d-a1e7-f1ebdc6da671 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:19.052595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fea4c9-f95b-432d-a1e7-f1ebdc6da671 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:19.054005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fea4c9-f95b-432d-a1e7-f1ebdc6da671 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:19.057387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fea4c9-f95b-432d-a1e7-f1ebdc6da671 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:19.057387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 180/352] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:18 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:19.059327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0d2d-90e7-4bc6-a7d2-2d4dfcaf2792 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:19.059327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0d2d-90e7-4bc6-a7d2-2d4dfcaf2792 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:19.059708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0d2d-90e7-4bc6-a7d2-2d4dfcaf2792 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:19.061399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 181/353] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:19.061914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0d2d-90e7-4bc6-a7d2-2d4dfcaf2792 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:19.125279 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920b7a3-8f69-419a-bdad-9dcfe463dd7e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:19.149024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:19.174611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bc8b2-0a6d-48bf-895d-7a94288bf4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:19.175283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bc8b2-0a6d-48bf-895d-7a94288bf4b7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:19.175558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bc8b2-0a6d-48bf-895d-7a94288bf4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:19.175821 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bc8b2-0a6d-48bf-895d-7a94288bf4b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:19.182592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0d2d-90e7-4bc6-a7d2-2d4dfcaf2792 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:19.187935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bc8b2-0a6d-48bf-895d-7a94288bf4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-283bc8b2-0a6d-48bf-895d-7a94288bf4b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:19.193532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:19.194551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:19.195472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:19.195472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:19.195472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:19.195472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:19.195472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:19.195472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:19.195472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:19.195472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:19.195472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:19.195472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:19.195472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:19.195472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:19.195472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 173/354] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:19.196680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bc8b2-0a6d-48bf-895d-7a94288bf4b7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:19.225151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc245e-6646-4561-b2d1-ca7b4c45bb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:19.225778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc245e-6646-4561-b2d1-ca7b4c45bb51 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:19.226062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc245e-6646-4561-b2d1-ca7b4c45bb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:19.226335 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc245e-6646-4561-b2d1-ca7b4c45bb51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:19.227128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc245e-6646-4561-b2d1-ca7b4c45bb51 None admin] RBAC: Adding query filter params (group.id=673236c8ef914f5d9fe82e0e9e3482a5, role.id=f5585030f686473c89e1de214b25b6ff, scope.project.id=97e41b93d02a4c21aed2b712c418d461) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:19.227440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc245e-6646-4561-b2d1-ca7b4c45bb51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:19.229175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc245e-6646-4561-b2d1-ca7b4c45bb51 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:19.236980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 182/355] 10.222.0.33 () {56 vars in 1376 bytes} [Sun Sep 11 00:40:19 2022] GET /identity/v3/role_assignments?group.id=673236c8ef914f5d9fe82e0e9e3482a5&scope.project.id=97e41b93d02a4c21aed2b712c418d461&role.id=f5585030f686473c89e1de214b25b6ff => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:19.238213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54547d5f-9d3b-46f6-bf51-a2d2627037b9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:19.238492 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54547d5f-9d3b-46f6-bf51-a2d2627037b9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:19.238786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54547d5f-9d3b-46f6-bf51-a2d2627037b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:19.259701 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-54547d5f-9d3b-46f6-bf51-a2d2627037b9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:19.261917 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-54547d5f-9d3b-46f6-bf51-a2d2627037b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:19.336206 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:19.350814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bc8b2-0a6d-48bf-895d-7a94288bf4b7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:19.367232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 183/356] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:19.375611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54547d5f-9d3b-46f6-bf51-a2d2627037b9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:19.391188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895484f-7607-43f4-a514-4704a9a72ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:19.391805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895484f-7607-43f4-a514-4704a9a72ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:19.392185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895484f-7607-43f4-a514-4704a9a72ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:19.392459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895484f-7607-43f4-a514-4704a9a72ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:19.393121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895484f-7607-43f4-a514-4704a9a72ba5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:19.393444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895484f-7607-43f4-a514-4704a9a72ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:19.394957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895484f-7607-43f4-a514-4704a9a72ba5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:19.405432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 174/357] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:19.406315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895484f-7607-43f4-a514-4704a9a72ba5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:19.466278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:19.512498 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54547d5f-9d3b-46f6-bf51-a2d2627037b9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:19.543319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895484f-7607-43f4-a514-4704a9a72ba5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:19.559045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc7555-35c9-4130-a062-90b2df9ab6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:19.560179 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7555-35c9-4130-a062-90b2df9ab6ce None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:19.560792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7555-35c9-4130-a062-90b2df9ab6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:19.561265 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7555-35c9-4130-a062-90b2df9ab6ce None admin] PATH_INFO: `/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:19.563087 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc7555-35c9-4130-a062-90b2df9ab6ce None admin] RBAC: Authorizing `identity:get_group(group_id=673236c8ef914f5d9fe82e0e9e3482a5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:19.564734 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc7555-35c9-4130-a062-90b2df9ab6ce None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:19.567619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 184/358] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:19 2022] GET /identity/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:19.569712 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69fb78-020d-4b1f-a9b4-a46c5afc3a68 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:19.570446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69fb78-020d-4b1f-a9b4-a46c5afc3a68 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:19.571214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69fb78-020d-4b1f-a9b4-a46c5afc3a68 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:19.573809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 185/359] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:19.574768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69fb78-020d-4b1f-a9b4-a46c5afc3a68 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:19.594961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781eeb88-4658-457b-a7bf-074772a17fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:19.595639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781eeb88-4658-457b-a7bf-074772a17fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:19.595913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781eeb88-4658-457b-a7bf-074772a17fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:19.596419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781eeb88-4658-457b-a7bf-074772a17fc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:19.596904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781eeb88-4658-457b-a7bf-074772a17fc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:19.597204 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781eeb88-4658-457b-a7bf-074772a17fc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:19.598627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781eeb88-4658-457b-a7bf-074772a17fc4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:19.608433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 175/360] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:19.610720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781eeb88-4658-457b-a7bf-074772a17fc4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:19.627852 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:19.703154 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69fb78-020d-4b1f-a9b4-a46c5afc3a68 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:19.719832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781eeb88-4658-457b-a7bf-074772a17fc4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:19.751294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48daf7-cfcd-49c7-ae77-d9023466b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:19.752688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48daf7-cfcd-49c7-ae77-d9023466b28a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:19.753191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48daf7-cfcd-49c7-ae77-d9023466b28a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:19.753928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48daf7-cfcd-49c7-ae77-d9023466b28a None admin] PATH_INFO: `/v3/users/89c8946b6e5a491fa22cef216d804913` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:19.755701 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48daf7-cfcd-49c7-ae77-d9023466b28a None admin] RBAC: Authorizing `identity:get_user(user_id=89c8946b6e5a491fa22cef216d804913)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:19.757407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48daf7-cfcd-49c7-ae77-d9023466b28a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:19.759224 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 186/361] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:40:19 2022] GET /identity/v3/users/89c8946b6e5a491fa22cef216d804913 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:19.760694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9af02-cbd6-49cf-b2f8-9eef6c3b0779 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:19.761730 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9af02-cbd6-49cf-b2f8-9eef6c3b0779 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:19.762217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9af02-cbd6-49cf-b2f8-9eef6c3b0779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:19.766146 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c900b-6da4-461b-9b36-663b3604494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:19.766699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c900b-6da4-461b-9b36-663b3604494c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:19.767007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c900b-6da4-461b-9b36-663b3604494c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:19.767277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c900b-6da4-461b-9b36-663b3604494c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:19.768010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c900b-6da4-461b-9b36-663b3604494c None admin] RBAC: Adding query filter params (group.id=673236c8ef914f5d9fe82e0e9e3482a5, role.id=5e35afebe51a448a9ee3ed338209d739, scope.project.id=97e41b93d02a4c21aed2b712c418d461) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:19.768312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c900b-6da4-461b-9b36-663b3604494c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:19.769901 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c900b-6da4-461b-9b36-663b3604494c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:19.774876 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:19.778606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 176/362] 10.222.0.33 () {56 vars in 1376 bytes} [Sun Sep 11 00:40:19 2022] GET /identity/v3/role_assignments?group.id=673236c8ef914f5d9fe82e0e9e3482a5&scope.project.id=97e41b93d02a4c21aed2b712c418d461&role.id=5e35afebe51a448a9ee3ed338209d739 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:19.779442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c900b-6da4-461b-9b36-663b3604494c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:19.800595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-bdb9af02-cbd6-49cf-b2f8-9eef6c3b0779 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:19.801820 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bdb9af02-cbd6-49cf-b2f8-9eef6c3b0779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:19.910787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 187/363] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:19.912515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9af02-cbd6-49cf-b2f8-9eef6c3b0779 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:19.924283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:19.949724 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c900b-6da4-461b-9b36-663b3604494c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:19.992113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e4ee2-ca79-4249-98a8-69e0c4fd3db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:19.992735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e4ee2-ca79-4249-98a8-69e0c4fd3db2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:19.993011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e4ee2-ca79-4249-98a8-69e0c4fd3db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:19.993280 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e4ee2-ca79-4249-98a8-69e0c4fd3db2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:20.079602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e4ee2-ca79-4249-98a8-69e0c4fd3db2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:20.081052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e4ee2-ca79-4249-98a8-69e0c4fd3db2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:20.104311 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9af02-cbd6-49cf-b2f8-9eef6c3b0779 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:20.168658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97125f94-01c7-4f8a-8829-37796e5b92b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:20.169303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97125f94-01c7-4f8a-8829-37796e5b92b9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:20.169582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97125f94-01c7-4f8a-8829-37796e5b92b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:20.169853 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97125f94-01c7-4f8a-8829-37796e5b92b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:20.173622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:20.190941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97125f94-01c7-4f8a-8829-37796e5b92b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-97125f94-01c7-4f8a-8829-37796e5b92b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:20.198879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:20.199787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:20.200573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:20.200573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:20.200573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:20.200573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:20.200573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:20.200573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:20.200573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:20.200573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:20.200573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:20.200573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:20.200573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:20.200573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:20.200573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 188/364] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:40:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:20.201249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97125f94-01c7-4f8a-8829-37796e5b92b9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:20.242897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:20.282827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 177/365] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:20.284144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e4ee2-ca79-4249-98a8-69e0c4fd3db2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:20.348810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97125f94-01c7-4f8a-8829-37796e5b92b9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:20.388658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139e8db-c959-4632-ac35-93c0ca52553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:20.389270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139e8db-c959-4632-ac35-93c0ca52553a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:20.389544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139e8db-c959-4632-ac35-93c0ca52553a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:20.389810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139e8db-c959-4632-ac35-93c0ca52553a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:20.390532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139e8db-c959-4632-ac35-93c0ca52553a None admin] RBAC: Adding query filter params (role.id=ec07f55a1c534d79af2517e37b41fc75, user.id=89c8946b6e5a491fa22cef216d804913, scope.system=all) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:20.390864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139e8db-c959-4632-ac35-93c0ca52553a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:20.392306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139e8db-c959-4632-ac35-93c0ca52553a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:20.404434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 189/366] 10.222.0.33 () {56 vars in 1308 bytes} [Sun Sep 11 00:40:20 2022] GET /identity/v3/role_assignments?user.id=89c8946b6e5a491fa22cef216d804913&scope.system=all&role.id=ec07f55a1c534d79af2517e37b41fc75 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:20.405437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139e8db-c959-4632-ac35-93c0ca52553a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:20.413369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e4ee2-ca79-4249-98a8-69e0c4fd3db2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:20.467957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882096f2-a88e-477d-8dff-b44a430339dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:20.468684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:20.470570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882096f2-a88e-477d-8dff-b44a430339dd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:20.472421 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882096f2-a88e-477d-8dff-b44a430339dd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:20.472936 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882096f2-a88e-477d-8dff-b44a430339dd None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:20.474334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882096f2-a88e-477d-8dff-b44a430339dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:20.474872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882096f2-a88e-477d-8dff-b44a430339dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:20.476678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882096f2-a88e-477d-8dff-b44a430339dd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:20.492845 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 178/367] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:20.494067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882096f2-a88e-477d-8dff-b44a430339dd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:20.531447 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139e8db-c959-4632-ac35-93c0ca52553a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:20.555705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:20.572439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d88f6-82c3-4750-898e-9148b416b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:20.573985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d88f6-82c3-4750-898e-9148b416b743 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:20.573985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d88f6-82c3-4750-898e-9148b416b743 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:20.573985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d88f6-82c3-4750-898e-9148b416b743 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:20.593835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d88f6-82c3-4750-898e-9148b416b743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-194d88f6-82c3-4750-898e-9148b416b743 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:20.600465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:20.601391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:20.602172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:20.602172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:20.602172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:20.602172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:20.602172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:20.602172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:20.602172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:20.602172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:20.602172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:20.602172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:20.602172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:40:20.602172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:20.604118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 190/368] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:40:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:20.606939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d88f6-82c3-4750-898e-9148b416b743 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:20.642403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882096f2-a88e-477d-8dff-b44a430339dd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:20.693296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d03fcc-b386-40a6-803f-34123f352124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:20.693941 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03fcc-b386-40a6-803f-34123f352124 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:20.694218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03fcc-b386-40a6-803f-34123f352124 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:20.694488 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03fcc-b386-40a6-803f-34123f352124 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:20.695754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d03fcc-b386-40a6-803f-34123f352124 None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:20.697848 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d03fcc-b386-40a6-803f-34123f352124 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:20.700819 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 179/369] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:20 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:20.703669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d03fcc-b386-40a6-803f-34123f352124 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:20.753563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d88f6-82c3-4750-898e-9148b416b743 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:20.768873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:20.793638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b42a0a-2277-474f-bbba-8896542a9bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:20.794258 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42a0a-2277-474f-bbba-8896542a9bec None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:20.794543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42a0a-2277-474f-bbba-8896542a9bec None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:20.794836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42a0a-2277-474f-bbba-8896542a9bec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:20.825876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d03fcc-b386-40a6-803f-34123f352124 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:20.840634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:20.875447 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b42a0a-2277-474f-bbba-8896542a9bec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:20.875622 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56826a9-52fb-4020-a081-0b41b1cad44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:20.876330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56826a9-52fb-4020-a081-0b41b1cad44e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:20.876668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56826a9-52fb-4020-a081-0b41b1cad44e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:20.877003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56826a9-52fb-4020-a081-0b41b1cad44e None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:20.877746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56826a9-52fb-4020-a081-0b41b1cad44e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:20.878110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56826a9-52fb-4020-a081-0b41b1cad44e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:20.878212 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b42a0a-2277-474f-bbba-8896542a9bec None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:20.879743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56826a9-52fb-4020-a081-0b41b1cad44e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:20.890192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 180/370] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:20.891217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56826a9-52fb-4020-a081-0b41b1cad44e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:20.988756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 191/371] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:20.991334 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b42a0a-2277-474f-bbba-8896542a9bec None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:21.005862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56826a9-52fb-4020-a081-0b41b1cad44e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:21.010695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:21.045347 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cbd8c-c4c9-4714-89af-2ecbdc5504ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:21.046037 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cbd8c-c4c9-4714-89af-2ecbdc5504ff None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:21.046314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cbd8c-c4c9-4714-89af-2ecbdc5504ff None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:21.046637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cbd8c-c4c9-4714-89af-2ecbdc5504ff None admin] PATH_INFO: `/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:21.047935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cbd8c-c4c9-4714-89af-2ecbdc5504ff None admin] RBAC: Authorizing `identity:get_group(group_id=673236c8ef914f5d9fe82e0e9e3482a5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:21.049520 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cbd8c-c4c9-4714-89af-2ecbdc5504ff None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:21.052226 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 181/372] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:20 2022] GET /identity/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:21.053045 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cbd8c-c4c9-4714-89af-2ecbdc5504ff None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:21.101697 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:21.114577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b42a0a-2277-474f-bbba-8896542a9bec None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:21.153537 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5ae47-228b-4609-a50d-d94a9e202fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:21.154489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5ae47-228b-4609-a50d-d94a9e202fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:21.155008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5ae47-228b-4609-a50d-d94a9e202fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:21.155475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5ae47-228b-4609-a50d-d94a9e202fe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:21.185435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cbd8c-c4c9-4714-89af-2ecbdc5504ff None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:21.224606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149810c-2404-4731-98dd-be9233cacf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:21.225245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149810c-2404-4731-98dd-be9233cacf0f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:21.225520 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149810c-2404-4731-98dd-be9233cacf0f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:21.225787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149810c-2404-4731-98dd-be9233cacf0f None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:21.227029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149810c-2404-4731-98dd-be9233cacf0f None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:21.228457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149810c-2404-4731-98dd-be9233cacf0f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:21.230945 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 182/373] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:21 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:21.231694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149810c-2404-4731-98dd-be9233cacf0f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:21.237623 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5ae47-228b-4609-a50d-d94a9e202fe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:21.239402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5ae47-228b-4609-a50d-d94a9e202fe2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:21.253794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:21.343201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149810c-2404-4731-98dd-be9233cacf0f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:21.345347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 192/374] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:21.346450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5ae47-228b-4609-a50d-d94a9e202fe2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:21.350747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:21.382478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb07b8-4258-4147-b817-1ebc4058ba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:21.383112 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb07b8-4258-4147-b817-1ebc4058ba7e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:21.383386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb07b8-4258-4147-b817-1ebc4058ba7e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:21.383654 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb07b8-4258-4147-b817-1ebc4058ba7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:21.384373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb07b8-4258-4147-b817-1ebc4058ba7e None admin] RBAC: Adding query filter params (group.id=673236c8ef914f5d9fe82e0e9e3482a5, role.id=f5585030f686473c89e1de214b25b6ff, scope.project.id=c1020531a2814c51b1db55f62f23ea32) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:21.384675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb07b8-4258-4147-b817-1ebc4058ba7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:21.386102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb07b8-4258-4147-b817-1ebc4058ba7e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:21.393160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 183/375] 10.222.0.33 () {56 vars in 1376 bytes} [Sun Sep 11 00:40:21 2022] GET /identity/v3/role_assignments?group.id=673236c8ef914f5d9fe82e0e9e3482a5&scope.project.id=c1020531a2814c51b1db55f62f23ea32&role.id=f5585030f686473c89e1de214b25b6ff => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:21.393975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb07b8-4258-4147-b817-1ebc4058ba7e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:21.456590 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5ae47-228b-4609-a50d-d94a9e202fe2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:21.472080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:21.499527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a951b-5abe-4416-ba97-f3920423d17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:21.501097 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a951b-5abe-4416-ba97-f3920423d17e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:21.501911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a951b-5abe-4416-ba97-f3920423d17e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:21.502461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a951b-5abe-4416-ba97-f3920423d17e None admin] PATH_INFO: `/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:21.503961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a951b-5abe-4416-ba97-f3920423d17e None admin] RBAC: Authorizing `identity:get_group(group_id=673236c8ef914f5d9fe82e0e9e3482a5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:21.505624 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a951b-5abe-4416-ba97-f3920423d17e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:21.507443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 193/376] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:21 2022] GET /identity/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:21.513404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a951b-5abe-4416-ba97-f3920423d17e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:21.532947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb07b8-4258-4147-b817-1ebc4058ba7e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:21.576146 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312fe7e-5e02-4d13-8e1b-7bc1804240a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:21.576791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312fe7e-5e02-4d13-8e1b-7bc1804240a5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:21.577065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312fe7e-5e02-4d13-8e1b-7bc1804240a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:21.577334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312fe7e-5e02-4d13-8e1b-7bc1804240a5 None admin] PATH_INFO: `/v3/projects/a604dda8f82546e29f08510ef905d15b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:21.578446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312fe7e-5e02-4d13-8e1b-7bc1804240a5 None admin] RBAC: Authorizing `identity:get_project(project_id=a604dda8f82546e29f08510ef905d15b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:21.580033 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312fe7e-5e02-4d13-8e1b-7bc1804240a5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:21.582054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 184/377] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:21 2022] GET /identity/v3/projects/a604dda8f82546e29f08510ef905d15b => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:21.591200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312fe7e-5e02-4d13-8e1b-7bc1804240a5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:21.650387 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:21.685121 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a951b-5abe-4416-ba97-f3920423d17e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:21.739402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080135b-0cfa-4bb1-b64a-df6d39976817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:21.740268 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080135b-0cfa-4bb1-b64a-df6d39976817 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:21.740687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080135b-0cfa-4bb1-b64a-df6d39976817 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:21.741093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080135b-0cfa-4bb1-b64a-df6d39976817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:21.741956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080135b-0cfa-4bb1-b64a-df6d39976817 None admin] RBAC: Adding query filter params (group.id=673236c8ef914f5d9fe82e0e9e3482a5, role.id=5e35afebe51a448a9ee3ed338209d739, scope.project.id=c1020531a2814c51b1db55f62f23ea32) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:21.742417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080135b-0cfa-4bb1-b64a-df6d39976817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:21.744152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080135b-0cfa-4bb1-b64a-df6d39976817 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:21.755398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 194/378] 10.222.0.33 () {56 vars in 1376 bytes} [Sun Sep 11 00:40:21 2022] GET /identity/v3/role_assignments?group.id=673236c8ef914f5d9fe82e0e9e3482a5&scope.project.id=c1020531a2814c51b1db55f62f23ea32&role.id=5e35afebe51a448a9ee3ed338209d739 => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:21.770748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312fe7e-5e02-4d13-8e1b-7bc1804240a5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:21.819219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c7f1e-fe15-417c-8a37-158a4a09562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:21.819891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c7f1e-fe15-417c-8a37-158a4a09562b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:21.820168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c7f1e-fe15-417c-8a37-158a4a09562b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:21.820440 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c7f1e-fe15-417c-8a37-158a4a09562b None admin] PATH_INFO: `/v3/groups/940ce76f9385401a9cabeb218acca161` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:21.831590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c7f1e-fe15-417c-8a37-158a4a09562b None admin] RBAC: Authorizing `identity:get_group(group_id=940ce76f9385401a9cabeb218acca161)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:21.833125 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c7f1e-fe15-417c-8a37-158a4a09562b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:21.836234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 185/379] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:21 2022] GET /identity/v3/groups/940ce76f9385401a9cabeb218acca161 => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:21.841635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080135b-0cfa-4bb1-b64a-df6d39976817 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:21.905882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:21.966750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e831-4297-4407-8cca-38f53eab377e None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:21.967267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e831-4297-4407-8cca-38f53eab377e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:21.967662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e831-4297-4407-8cca-38f53eab377e None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:21.969163 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 186/380] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:40:21.974287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec72b2-981e-4b49-8ead-3f145adc6f14 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:21.974564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec72b2-981e-4b49-8ead-3f145adc6f14 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:21.974866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec72b2-981e-4b49-8ead-3f145adc6f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:21.979638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080135b-0cfa-4bb1-b64a-df6d39976817 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:21.996379 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-25ec72b2-981e-4b49-8ead-3f145adc6f14 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:21.997882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-25ec72b2-981e-4b49-8ead-3f145adc6f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:22.023289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a009f86-14e7-41d1-81ef-77547ac8e225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:22.024577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009f86-14e7-41d1-81ef-77547ac8e225 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:22.025049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009f86-14e7-41d1-81ef-77547ac8e225 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:22.025479 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009f86-14e7-41d1-81ef-77547ac8e225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:22.026339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a009f86-14e7-41d1-81ef-77547ac8e225 None admin] RBAC: Adding query filter params (group.id=940ce76f9385401a9cabeb218acca161, role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=a604dda8f82546e29f08510ef905d15b) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:22.029057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a009f86-14e7-41d1-81ef-77547ac8e225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:22.030757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a009f86-14e7-41d1-81ef-77547ac8e225 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:22.036930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 195/381] 10.222.0.33 () {56 vars in 1376 bytes} [Sun Sep 11 00:40:21 2022] GET /identity/v3/role_assignments?group.id=940ce76f9385401a9cabeb218acca161&scope.project.id=a604dda8f82546e29f08510ef905d15b&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:22.088363 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 187/382] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:22.366353 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a009f86-14e7-41d1-81ef-77547ac8e225 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:22.481981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a009f86-14e7-41d1-81ef-77547ac8e225 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:22.507612 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:22.530840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f228d-6717-46ba-a09f-518687a93ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:22.531495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f228d-6717-46ba-a09f-518687a93ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:22.531776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f228d-6717-46ba-a09f-518687a93ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:22.532046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f228d-6717-46ba-a09f-518687a93ec3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:22.547772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f228d-6717-46ba-a09f-518687a93ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-472f228d-6717-46ba-a09f-518687a93ec3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:22.553256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:22.554196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:22.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:22.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:22.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:22.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:22.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:22.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:22.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:22.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:22.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:22.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:22.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:22.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:22.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 196/383] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:22.560868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec72b2-981e-4b49-8ead-3f145adc6f14 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:22.635922 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:22.762873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec72b2-981e-4b49-8ead-3f145adc6f14 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:22.813776 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e646f-ff6a-4744-b55f-ec65872d629d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:22.814416 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e646f-ff6a-4744-b55f-ec65872d629d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:22.814698 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e646f-ff6a-4744-b55f-ec65872d629d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:22.815023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e646f-ff6a-4744-b55f-ec65872d629d None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:22.815707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e646f-ff6a-4744-b55f-ec65872d629d None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:22.816032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e646f-ff6a-4744-b55f-ec65872d629d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:22.817389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e646f-ff6a-4744-b55f-ec65872d629d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:22.831553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 188/384] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:22.837805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f228d-6717-46ba-a09f-518687a93ec3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:22.943184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac6269-3683-4bcc-a967-2623d34f5941 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:22.943693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac6269-3683-4bcc-a967-2623d34f5941 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:22.943693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac6269-3683-4bcc-a967-2623d34f5941 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:22.945839 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 189/385] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:22.964486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488140c-8ace-42e3-a1c0-66218eac6ab1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:22.965156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488140c-8ace-42e3-a1c0-66218eac6ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:22.965508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488140c-8ace-42e3-a1c0-66218eac6ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:22.984620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f228d-6717-46ba-a09f-518687a93ec3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:22.992873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4488140c-8ace-42e3-a1c0-66218eac6ab1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:22.994585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4488140c-8ace-42e3-a1c0-66218eac6ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:23.044803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211f515-952f-49f9-bbf6-4a77c607d19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:23.046839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211f515-952f-49f9-bbf6-4a77c607d19a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:23.047263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211f515-952f-49f9-bbf6-4a77c607d19a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:23.047676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211f515-952f-49f9-bbf6-4a77c607d19a None admin] PATH_INFO: `/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:23.048942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211f515-952f-49f9-bbf6-4a77c607d19a None admin] RBAC: Authorizing `identity:get_group(group_id=673236c8ef914f5d9fe82e0e9e3482a5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:23.050610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211f515-952f-49f9-bbf6-4a77c607d19a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:23.053077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 197/386] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:22 2022] GET /identity/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:23.057989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211f515-952f-49f9-bbf6-4a77c607d19a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:23.088291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 190/387] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:23.108076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:23.187072 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211f515-952f-49f9-bbf6-4a77c607d19a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:23.222857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb2815-bfb2-4b3d-80cc-c3cfe06f8153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:23.223746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb2815-bfb2-4b3d-80cc-c3cfe06f8153 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:23.224167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb2815-bfb2-4b3d-80cc-c3cfe06f8153 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:23.224576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb2815-bfb2-4b3d-80cc-c3cfe06f8153 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:23.225847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb2815-bfb2-4b3d-80cc-c3cfe06f8153 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:23.227447 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb2815-bfb2-4b3d-80cc-c3cfe06f8153 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:23.229200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 198/388] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:23 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:23.235138 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488140c-8ace-42e3-a1c0-66218eac6ab1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:23.270430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:23.353338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488140c-8ace-42e3-a1c0-66218eac6ab1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:23.391613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0a52-7ee3-4bf2-9ab3-52c4f68b1497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:23.392658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0a52-7ee3-4bf2-9ab3-52c4f68b1497 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:23.393139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0a52-7ee3-4bf2-9ab3-52c4f68b1497 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:23.393606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0a52-7ee3-4bf2-9ab3-52c4f68b1497 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461/groups/673236c8ef914f5d9fe82e0e9e3482a5/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:23.395750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee0a52-7ee3-4bf2-9ab3-52c4f68b1497 None admin] RBAC: Authorizing `identity:create_grant(project_id=97e41b93d02a4c21aed2b712c418d461, group_id=673236c8ef914f5d9fe82e0e9e3482a5, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:23.397394 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee0a52-7ee3-4bf2-9ab3-52c4f68b1497 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:23.414841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 191/389] 10.222.0.33 () {58 vars in 1442 bytes} [Sun Sep 11 00:40:23 2022] PUT /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461/groups/673236c8ef914f5d9fe82e0e9e3482a5/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:40:23.503467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb2815-bfb2-4b3d-80cc-c3cfe06f8153 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:23.636112 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb2815-bfb2-4b3d-80cc-c3cfe06f8153 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:23.642327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:23.690148 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa83544-51d3-4f78-b223-f22667436906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:23.691164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa83544-51d3-4f78-b223-f22667436906 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:23.691681 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa83544-51d3-4f78-b223-f22667436906 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:23.692180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa83544-51d3-4f78-b223-f22667436906 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:23.707968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa83544-51d3-4f78-b223-f22667436906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-dfa83544-51d3-4f78-b223-f22667436906 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:23.713409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:23.714323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:23.715511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:23.715511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:23.715511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:23.715511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:23.715511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:23.715511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:23.715511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:23.715511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:23.715511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:23.715511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:23.715511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:23.715511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:23.718158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 199/390] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:40:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:23.724195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0a52-7ee3-4bf2-9ab3-52c4f68b1497 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:23.827002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:23.850014 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0a52-7ee3-4bf2-9ab3-52c4f68b1497 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:23.893375 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78804307-9ba1-41c5-9eaa-3a7d300af0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:23.893991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804307-9ba1-41c5-9eaa-3a7d300af0aa None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:23.894269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804307-9ba1-41c5-9eaa-3a7d300af0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:23.894534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804307-9ba1-41c5-9eaa-3a7d300af0aa None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:23.895237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78804307-9ba1-41c5-9eaa-3a7d300af0aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:23.895542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78804307-9ba1-41c5-9eaa-3a7d300af0aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:23.896907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78804307-9ba1-41c5-9eaa-3a7d300af0aa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:23.910782 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 192/391] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:23.916317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa83544-51d3-4f78-b223-f22667436906 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:24.051686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa83544-51d3-4f78-b223-f22667436906 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:24.087147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f980d7-9662-443a-9c4a-cffa415bd01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:24.087737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f980d7-9662-443a-9c4a-cffa415bd01b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:24.088016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f980d7-9662-443a-9c4a-cffa415bd01b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:24.088289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f980d7-9662-443a-9c4a-cffa415bd01b None admin] PATH_INFO: `/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:24.089388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f980d7-9662-443a-9c4a-cffa415bd01b None admin] RBAC: Authorizing `identity:get_group(group_id=673236c8ef914f5d9fe82e0e9e3482a5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:24.091399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f980d7-9662-443a-9c4a-cffa415bd01b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:24.093287 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 200/392] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:23 2022] GET /identity/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:24.098756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78804307-9ba1-41c5-9eaa-3a7d300af0aa None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:24.214367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78804307-9ba1-41c5-9eaa-3a7d300af0aa None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:24.256323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a0d4b-f776-462e-bafc-76ba069479e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:24.256976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a0d4b-f776-462e-bafc-76ba069479e3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:24.257252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a0d4b-f776-462e-bafc-76ba069479e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:24.257516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a0d4b-f776-462e-bafc-76ba069479e3 None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:24.258695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a0d4b-f776-462e-bafc-76ba069479e3 None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:24.260266 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a0d4b-f776-462e-bafc-76ba069479e3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:24.263008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 193/393] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:24 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:24.269099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f980d7-9662-443a-9c4a-cffa415bd01b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:24.303827 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:24.376495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f980d7-9662-443a-9c4a-cffa415bd01b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:24.381123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fadebb-07a5-4d2c-9baa-d86d7dac080e None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:24.381399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fadebb-07a5-4d2c-9baa-d86d7dac080e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:24.381728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fadebb-07a5-4d2c-9baa-d86d7dac080e None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:24.384634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 194/394] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:24.397694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36820a3-98ad-482a-880e-33db12776458 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:24.397983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36820a3-98ad-482a-880e-33db12776458 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:24.398230 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36820a3-98ad-482a-880e-33db12776458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:24.424003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a36820a3-98ad-482a-880e-33db12776458 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:24.425782 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a36820a3-98ad-482a-880e-33db12776458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:24.436929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b17f3-2a70-4856-917d-8dcd04f1029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:24.437911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b17f3-2a70-4856-917d-8dcd04f1029f None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:24.438322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b17f3-2a70-4856-917d-8dcd04f1029f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:24.438741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:24.439573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b17f3-2a70-4856-917d-8dcd04f1029f None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461/groups/673236c8ef914f5d9fe82e0e9e3482a5/roles/5e35afebe51a448a9ee3ed338209d739` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:24.447478 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b17f3-2a70-4856-917d-8dcd04f1029f None admin] RBAC: Authorizing `identity:create_grant(project_id=97e41b93d02a4c21aed2b712c418d461, group_id=673236c8ef914f5d9fe82e0e9e3482a5, role_id=5e35afebe51a448a9ee3ed338209d739)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:24.449686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b17f3-2a70-4856-917d-8dcd04f1029f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:24.471309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 201/395] 10.222.0.33 () {58 vars in 1442 bytes} [Sun Sep 11 00:40:24 2022] PUT /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461/groups/673236c8ef914f5d9fe82e0e9e3482a5/roles/5e35afebe51a448a9ee3ed338209d739 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:40:24.517435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 195/396] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:24.882707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b17f3-2a70-4856-917d-8dcd04f1029f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:24.962057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a8eac-f072-4938-9393-3c98c3f8fcb1 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:24.962404 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a8eac-f072-4938-9393-3c98c3f8fcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:24.962604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a8eac-f072-4938-9393-3c98c3f8fcb1 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:24.965429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 196/397] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:24.969870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcde0e-34f7-4dad-b059-6372fbc4e41d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:24.970156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcde0e-34f7-4dad-b059-6372fbc4e41d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:24.970426 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcde0e-34f7-4dad-b059-6372fbc4e41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:24.981818 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:24.990540 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bcdcde0e-34f7-4dad-b059-6372fbc4e41d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:24.991100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b17f3-2a70-4856-917d-8dcd04f1029f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:24.992067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bcdcde0e-34f7-4dad-b059-6372fbc4e41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:25.059680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fda2a6-7ca4-4508-bdf5-aca4a28a9659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:25.060352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fda2a6-7ca4-4508-bdf5-aca4a28a9659 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:25.060608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fda2a6-7ca4-4508-bdf5-aca4a28a9659 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:25.060873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fda2a6-7ca4-4508-bdf5-aca4a28a9659 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:25.087761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fda2a6-7ca4-4508-bdf5-aca4a28a9659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-42fda2a6-7ca4-4508-bdf5-aca4a28a9659 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:25.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:25.096571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:25.097354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:25.097354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:25.097354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:25.097354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:25.097354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:25.097354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:25.097354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:25.097354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:25.097354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:25.097354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:25.097354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:25.097354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:25.099997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 202/398] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:25.106779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fda2a6-7ca4-4508-bdf5-aca4a28a9659 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:25.117042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 197/399] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:25.185649 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755c5e6-2672-4581-a6b5-7cf40944cad6 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:25.186554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755c5e6-2672-4581-a6b5-7cf40944cad6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:25.187061 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755c5e6-2672-4581-a6b5-7cf40944cad6 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:25.188827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 198/400] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:25.193527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdee71-f8e3-4bc8-92f6-f1fe4a7e7e52 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:25.193866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdee71-f8e3-4bc8-92f6-f1fe4a7e7e52 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:25.194073 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdee71-f8e3-4bc8-92f6-f1fe4a7e7e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:25.220787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-abfdee71-f8e3-4bc8-92f6-f1fe4a7e7e52 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:25.221977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-abfdee71-f8e3-4bc8-92f6-f1fe4a7e7e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:25.275214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fda2a6-7ca4-4508-bdf5-aca4a28a9659 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:25.342455 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2035e1b-9409-455b-bde3-093c90e54754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:25.343619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2035e1b-9409-455b-bde3-093c90e54754 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:25.344833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2035e1b-9409-455b-bde3-093c90e54754 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:25.345826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2035e1b-9409-455b-bde3-093c90e54754 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:25.346882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2035e1b-9409-455b-bde3-093c90e54754 None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:25.348530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2035e1b-9409-455b-bde3-093c90e54754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:25.350090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2035e1b-9409-455b-bde3-093c90e54754 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:25.353646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 199/401] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:25.361771 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 203/402] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:25.367401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdee71-f8e3-4bc8-92f6-f1fe4a7e7e52 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:25.371052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:25.443889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2035e1b-9409-455b-bde3-093c90e54754 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:25.461290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:25.500237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdee71-f8e3-4bc8-92f6-f1fe4a7e7e52 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:25.573415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585fa35-16c8-4050-b789-a4806cbab38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:25.574056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585fa35-16c8-4050-b789-a4806cbab38e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:25.574381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585fa35-16c8-4050-b789-a4806cbab38e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:25.575182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585fa35-16c8-4050-b789-a4806cbab38e None admin] PATH_INFO: `/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:25.577771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585fa35-16c8-4050-b789-a4806cbab38e None admin] RBAC: Authorizing `identity:get_group(group_id=673236c8ef914f5d9fe82e0e9e3482a5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:25.579250 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585fa35-16c8-4050-b789-a4806cbab38e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:25.586375 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 200/403] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:25 2022] GET /identity/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:25.587253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585fa35-16c8-4050-b789-a4806cbab38e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:25.620865 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2035e1b-9409-455b-bde3-093c90e54754 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:25.679852 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:25.697106 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03e17b-2c56-45a5-bf1c-cb5bae9335b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:25.698893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03e17b-2c56-45a5-bf1c-cb5bae9335b7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:25.699174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03e17b-2c56-45a5-bf1c-cb5bae9335b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:25.699509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03e17b-2c56-45a5-bf1c-cb5bae9335b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:25.722215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03e17b-2c56-45a5-bf1c-cb5bae9335b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-8f03e17b-2c56-45a5-bf1c-cb5bae9335b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:25.727576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:25.728460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:25.729241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:25.729241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:25.729241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:25.729241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:25.729241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:25.729241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:25.729241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:25.729241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:25.729241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:25.729241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:25.729241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:25.729241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:25.730341 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 204/404] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:40:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:25.731242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03e17b-2c56-45a5-bf1c-cb5bae9335b7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:25.740815 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585fa35-16c8-4050-b789-a4806cbab38e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:25.787721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a55617-a701-4916-9504-2caed6edf4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:25.787721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a55617-a701-4916-9504-2caed6edf4bc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:25.787721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a55617-a701-4916-9504-2caed6edf4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:25.789897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a55617-a701-4916-9504-2caed6edf4bc None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:25.791162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a55617-a701-4916-9504-2caed6edf4bc None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:25.793178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a55617-a701-4916-9504-2caed6edf4bc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:25.795591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 201/405] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:25 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:25.796977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a55617-a701-4916-9504-2caed6edf4bc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:25.824265 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:25.856733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03e17b-2c56-45a5-bf1c-cb5bae9335b7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:25.901649 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092cb35-8a39-4bcd-85ff-45fe0dcc88f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:25.902371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092cb35-8a39-4bcd-85ff-45fe0dcc88f6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:25.903016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092cb35-8a39-4bcd-85ff-45fe0dcc88f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:25.903367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092cb35-8a39-4bcd-85ff-45fe0dcc88f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:25.915629 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092cb35-8a39-4bcd-85ff-45fe0dcc88f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-9092cb35-8a39-4bcd-85ff-45fe0dcc88f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:25.924004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:25.925945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:25.927855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:25.927855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:25.927855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:25.927855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:25.927855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:25.927855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:25.927855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:25.927855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:25.927855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:25.927855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:25.927855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:40:25.927855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:25.929251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a55617-a701-4916-9504-2caed6edf4bc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:25.929407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 205/406] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:40:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:25.929407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092cb35-8a39-4bcd-85ff-45fe0dcc88f6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:25.966952 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ea136-92ce-4b2b-90c6-c63daf651ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:25.967558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ea136-92ce-4b2b-90c6-c63daf651ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:25.967830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ea136-92ce-4b2b-90c6-c63daf651ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:25.968096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ea136-92ce-4b2b-90c6-c63daf651ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:25.968744 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ea136-92ce-4b2b-90c6-c63daf651ea0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:25.969041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ea136-92ce-4b2b-90c6-c63daf651ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:25.970401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ea136-92ce-4b2b-90c6-c63daf651ea0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:25.978557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 202/407] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:25.979393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ea136-92ce-4b2b-90c6-c63daf651ea0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:25.982790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:26.052077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092cb35-8a39-4bcd-85ff-45fe0dcc88f6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:26.101067 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405483b-53a3-4aeb-94d3-fbe900df6382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:26.102039 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405483b-53a3-4aeb-94d3-fbe900df6382 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:26.102322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405483b-53a3-4aeb-94d3-fbe900df6382 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:26.102887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405483b-53a3-4aeb-94d3-fbe900df6382 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32/groups/673236c8ef914f5d9fe82e0e9e3482a5/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:26.106292 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405483b-53a3-4aeb-94d3-fbe900df6382 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1020531a2814c51b1db55f62f23ea32, group_id=673236c8ef914f5d9fe82e0e9e3482a5, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:26.108869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405483b-53a3-4aeb-94d3-fbe900df6382 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:26.112513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:26.114755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ea136-92ce-4b2b-90c6-c63daf651ea0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:26.132650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 206/408] 10.222.0.33 () {58 vars in 1442 bytes} [Sun Sep 11 00:40:25 2022] PUT /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32/groups/673236c8ef914f5d9fe82e0e9e3482a5/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:40:26.134110 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405483b-53a3-4aeb-94d3-fbe900df6382 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:26.164413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b340d-75ef-4054-8208-e996a36e765a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:26.165098 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b340d-75ef-4054-8208-e996a36e765a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:26.165560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b340d-75ef-4054-8208-e996a36e765a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:26.166169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b340d-75ef-4054-8208-e996a36e765a None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:26.167673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b340d-75ef-4054-8208-e996a36e765a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:26.169498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b340d-75ef-4054-8208-e996a36e765a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:26.173009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b340d-75ef-4054-8208-e996a36e765a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:26.192730 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 203/409] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:26.200767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b340d-75ef-4054-8208-e996a36e765a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:26.299901 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:26.301202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405483b-53a3-4aeb-94d3-fbe900df6382 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:26.344633 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebb5fe-6c6b-45ac-9116-dce42d957663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:26.345274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebb5fe-6c6b-45ac-9116-dce42d957663 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:26.345556 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebb5fe-6c6b-45ac-9116-dce42d957663 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:26.345831 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebb5fe-6c6b-45ac-9116-dce42d957663 None admin] PATH_INFO: `/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:26.347077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebb5fe-6c6b-45ac-9116-dce42d957663 None admin] RBAC: Authorizing `identity:get_group(group_id=673236c8ef914f5d9fe82e0e9e3482a5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:26.348834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebb5fe-6c6b-45ac-9116-dce42d957663 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:26.350407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 207/410] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:26 2022] GET /identity/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:26.355871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b598065-6e68-4e54-9240-c453b9f7b9a5 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:26.356179 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b598065-6e68-4e54-9240-c453b9f7b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:26.356456 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b598065-6e68-4e54-9240-c453b9f7b9a5 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:26.357457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b340d-75ef-4054-8208-e996a36e765a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:26.362672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 208/411] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:26.362672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b598065-6e68-4e54-9240-c453b9f7b9a5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:26.404951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb422a9-c74d-4c42-aaf2-5ccb810920f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:26.405674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb422a9-c74d-4c42-aaf2-5ccb810920f7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:26.405956 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb422a9-c74d-4c42-aaf2-5ccb810920f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:26.406228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb422a9-c74d-4c42-aaf2-5ccb810920f7 None admin] PATH_INFO: `/v3/groups/940ce76f9385401a9cabeb218acca161` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:26.407425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb422a9-c74d-4c42-aaf2-5ccb810920f7 None admin] RBAC: Authorizing `identity:get_group(group_id=940ce76f9385401a9cabeb218acca161)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:26.408861 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb422a9-c74d-4c42-aaf2-5ccb810920f7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:26.411372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 204/412] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:26 2022] GET /identity/v3/groups/940ce76f9385401a9cabeb218acca161 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:26.413087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d07ad-fdc6-4bb6-a360-da5e3ebe813c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:26.413378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d07ad-fdc6-4bb6-a360-da5e3ebe813c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:26.413652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d07ad-fdc6-4bb6-a360-da5e3ebe813c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:26.439474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ac0d07ad-fdc6-4bb6-a360-da5e3ebe813c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:26.440653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ac0d07ad-fdc6-4bb6-a360-da5e3ebe813c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:26.451204 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:26.505371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b598065-6e68-4e54-9240-c453b9f7b9a5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:26.522865 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 205/413] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:26.523811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d07ad-fdc6-4bb6-a360-da5e3ebe813c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:26.553024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe2d91-b18e-4691-954a-2cbcca99b6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:26.553592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe2d91-b18e-4691-954a-2cbcca99b6fa None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:26.555062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe2d91-b18e-4691-954a-2cbcca99b6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:26.555348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe2d91-b18e-4691-954a-2cbcca99b6fa None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:26.559049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe2d91-b18e-4691-954a-2cbcca99b6fa None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:26.560957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe2d91-b18e-4691-954a-2cbcca99b6fa None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:26.565733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 209/414] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:26 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:26.572345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe2d91-b18e-4691-954a-2cbcca99b6fa None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:26.635554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:26.709534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d07ad-fdc6-4bb6-a360-da5e3ebe813c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:26.756643 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe2d91-b18e-4691-954a-2cbcca99b6fa None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:26.774691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54712b5-479e-4214-8d42-1accea40b351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:26.775353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54712b5-479e-4214-8d42-1accea40b351 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:26.775626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54712b5-479e-4214-8d42-1accea40b351 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:26.775895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54712b5-479e-4214-8d42-1accea40b351 None admin] PATH_INFO: `/v3/projects/a604dda8f82546e29f08510ef905d15b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:26.777131 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54712b5-479e-4214-8d42-1accea40b351 None admin] RBAC: Authorizing `identity:get_project(project_id=a604dda8f82546e29f08510ef905d15b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:26.780033 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54712b5-479e-4214-8d42-1accea40b351 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:26.781648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 206/415] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:26 2022] GET /identity/v3/projects/a604dda8f82546e29f08510ef905d15b => generated 344 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:26.787445 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54712b5-479e-4214-8d42-1accea40b351 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:26.812172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:26.820814 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e0fba-8c2b-4658-9c16-a2df28853131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:26.821482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0fba-8c2b-4658-9c16-a2df28853131 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:26.821759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0fba-8c2b-4658-9c16-a2df28853131 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:26.822082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0fba-8c2b-4658-9c16-a2df28853131 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32/groups/673236c8ef914f5d9fe82e0e9e3482a5/roles/5e35afebe51a448a9ee3ed338209d739` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:26.828388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e0fba-8c2b-4658-9c16-a2df28853131 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1020531a2814c51b1db55f62f23ea32, group_id=673236c8ef914f5d9fe82e0e9e3482a5, role_id=5e35afebe51a448a9ee3ed338209d739)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:26.829888 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e0fba-8c2b-4658-9c16-a2df28853131 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:26.850973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 210/416] 10.222.0.33 () {58 vars in 1442 bytes} [Sun Sep 11 00:40:26 2022] PUT /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32/groups/673236c8ef914f5d9fe82e0e9e3482a5/roles/5e35afebe51a448a9ee3ed338209d739 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:40:26.909501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e0fba-8c2b-4658-9c16-a2df28853131 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:26.948893 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54712b5-479e-4214-8d42-1accea40b351 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:27.006330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:27.018876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eac5a8-d345-4aca-9550-6e1b4565eabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:27.019803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eac5a8-d345-4aca-9550-6e1b4565eabf None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:27.020130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eac5a8-d345-4aca-9550-6e1b4565eabf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:27.020685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eac5a8-d345-4aca-9550-6e1b4565eabf None admin] PATH_INFO: `/v3/projects/a604dda8f82546e29f08510ef905d15b/groups/940ce76f9385401a9cabeb218acca161/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:27.024305 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eac5a8-d345-4aca-9550-6e1b4565eabf None admin] RBAC: Authorizing `identity:create_grant(project_id=a604dda8f82546e29f08510ef905d15b, group_id=940ce76f9385401a9cabeb218acca161, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:27.028489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eac5a8-d345-4aca-9550-6e1b4565eabf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:27.055361 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 207/417] 10.222.0.33 () {58 vars in 1442 bytes} [Sun Sep 11 00:40:26 2022] PUT /identity/v3/projects/a604dda8f82546e29f08510ef905d15b/groups/940ce76f9385401a9cabeb218acca161/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:40:27.079584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e0fba-8c2b-4658-9c16-a2df28853131 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:27.129608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0efa0-60fa-4268-9e78-dd830921fe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:27.130430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0efa0-60fa-4268-9e78-dd830921fe1a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:27.130624 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0efa0-60fa-4268-9e78-dd830921fe1a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:27.130930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0efa0-60fa-4268-9e78-dd830921fe1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:27.146962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0efa0-60fa-4268-9e78-dd830921fe1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-99c0efa0-60fa-4268-9e78-dd830921fe1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:27.152815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:27.153856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:27.154675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:27.154675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:27.154675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:27.154675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:27.154675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:27.154675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:27.154675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:27.154675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:27.154675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:27.154675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:27.154675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:27.154675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:27.158871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 211/418] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:27.160493 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eac5a8-d345-4aca-9550-6e1b4565eabf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:27.201605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673af3f8-d5c4-4ca1-9fdc-bffcd0ec087f None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:27.201936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673af3f8-d5c4-4ca1-9fdc-bffcd0ec087f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:27.202140 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673af3f8-d5c4-4ca1-9fdc-bffcd0ec087f None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:27.203642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 212/419] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:40:27.209412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62515c8-054c-436b-95d1-4523c4aacfe1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:27.209699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62515c8-054c-436b-95d1-4523c4aacfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:27.209998 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62515c8-054c-436b-95d1-4523c4aacfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:27.244348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c62515c8-054c-436b-95d1-4523c4aacfe1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:27.245573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c62515c8-054c-436b-95d1-4523c4aacfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:27.329174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:27.332039 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eac5a8-d345-4aca-9550-6e1b4565eabf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:27.366242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 213/420] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:27.386161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a12491-a894-444c-a9ec-924b77db54ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:27.386792 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a12491-a894-444c-a9ec-924b77db54ef None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:27.387642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a12491-a894-444c-a9ec-924b77db54ef None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:27.387964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a12491-a894-444c-a9ec-924b77db54ef None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:27.388706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a12491-a894-444c-a9ec-924b77db54ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:27.389054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a12491-a894-444c-a9ec-924b77db54ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:27.390435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a12491-a894-444c-a9ec-924b77db54ef None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:27.399335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 208/421] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:27.405717 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62515c8-054c-436b-95d1-4523c4aacfe1 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:27.515858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62515c8-054c-436b-95d1-4523c4aacfe1 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:27.551101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43a9c9-ed04-4f8e-8160-4fe9e7451275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:27.551767 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43a9c9-ed04-4f8e-8160-4fe9e7451275 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:27.552043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43a9c9-ed04-4f8e-8160-4fe9e7451275 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:27.552308 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43a9c9-ed04-4f8e-8160-4fe9e7451275 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:27.607214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:27.624217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43a9c9-ed04-4f8e-8160-4fe9e7451275 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:27.625720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43a9c9-ed04-4f8e-8160-4fe9e7451275 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:27.729330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 214/422] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:27.735348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a12491-a894-444c-a9ec-924b77db54ef None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:27.748297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43a9c9-ed04-4f8e-8160-4fe9e7451275 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:27.800004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:27.859441 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a12491-a894-444c-a9ec-924b77db54ef None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:27.902120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db36e3-aa58-4d8f-aaea-8363eee0b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:27.903356 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db36e3-aa58-4d8f-aaea-8363eee0b1dc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:27.903606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db36e3-aa58-4d8f-aaea-8363eee0b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:27.903873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db36e3-aa58-4d8f-aaea-8363eee0b1dc None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:27.908038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db36e3-aa58-4d8f-aaea-8363eee0b1dc None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:27.909472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db36e3-aa58-4d8f-aaea-8363eee0b1dc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:27.911117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 209/423] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:27 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:27.916733 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db36e3-aa58-4d8f-aaea-8363eee0b1dc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:27.939681 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:27.951990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43a9c9-ed04-4f8e-8160-4fe9e7451275 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:27.988252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b7cff-7d5f-4845-8c2b-6a1dc46eb98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:27.989288 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b7cff-7d5f-4845-8c2b-6a1dc46eb98c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:27.989714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b7cff-7d5f-4845-8c2b-6a1dc46eb98c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:27.990126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b7cff-7d5f-4845-8c2b-6a1dc46eb98c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:28.001797 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b7cff-7d5f-4845-8c2b-6a1dc46eb98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-7a8b7cff-7d5f-4845-8c2b-6a1dc46eb98c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:28.007263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:28.008371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:28.009402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:28.009402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:28.009402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:28.009402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:28.009402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:28.009402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:28.009402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:28.009402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:28.009402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:28.009402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:28.009402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:28.009402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:28.011611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 215/424] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:40:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:28.022038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b7cff-7d5f-4845-8c2b-6a1dc46eb98c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:28.147979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b7cff-7d5f-4845-8c2b-6a1dc46eb98c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:28.159658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db36e3-aa58-4d8f-aaea-8363eee0b1dc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:28.192775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fa9f7-51dd-4d6f-8a1c-13915e15daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:28.193619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fa9f7-51dd-4d6f-8a1c-13915e15daf6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:28.194037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fa9f7-51dd-4d6f-8a1c-13915e15daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:28.194476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:28.194591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fa9f7-51dd-4d6f-8a1c-13915e15daf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:28.195384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fa9f7-51dd-4d6f-8a1c-13915e15daf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:28.195811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fa9f7-51dd-4d6f-8a1c-13915e15daf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:28.197317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fa9f7-51dd-4d6f-8a1c-13915e15daf6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:28.206289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 216/425] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:28.212000 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fa9f7-51dd-4d6f-8a1c-13915e15daf6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:28.214931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:28.223421 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97f459-2682-461f-bab3-ca33db259194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:28.226317 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97f459-2682-461f-bab3-ca33db259194 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:28.226827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97f459-2682-461f-bab3-ca33db259194 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:28.228899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97f459-2682-461f-bab3-ca33db259194 None admin] PATH_INFO: `/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:28.231788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97f459-2682-461f-bab3-ca33db259194 None admin] RBAC: Authorizing `identity:get_group(group_id=673236c8ef914f5d9fe82e0e9e3482a5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:28.235482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97f459-2682-461f-bab3-ca33db259194 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:28.247535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 210/426] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:27 2022] GET /identity/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5 => generated 226 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:28.248361 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97f459-2682-461f-bab3-ca33db259194 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:28.380435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fa9f7-51dd-4d6f-8a1c-13915e15daf6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:28.435001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97f459-2682-461f-bab3-ca33db259194 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:28.442773 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d98d-8fee-4021-af26-b1eea44275d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:28.442773 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d98d-8fee-4021-af26-b1eea44275d0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:28.442773 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d98d-8fee-4021-af26-b1eea44275d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:28.442773 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d98d-8fee-4021-af26-b1eea44275d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:28.498355 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7975f-4938-4002-8729-70e8830ef2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:28.499905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7975f-4938-4002-8729-70e8830ef2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:28.501425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7975f-4938-4002-8729-70e8830ef2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:28.502594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7975f-4938-4002-8729-70e8830ef2b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:28.503571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7975f-4938-4002-8729-70e8830ef2b6 None admin] RBAC: Adding query filter params (group.id=673236c8ef914f5d9fe82e0e9e3482a5, role.id=f5585030f686473c89e1de214b25b6ff, scope.project.id=97e41b93d02a4c21aed2b712c418d461) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:28.504235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7975f-4938-4002-8729-70e8830ef2b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:28.506757 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7975f-4938-4002-8729-70e8830ef2b6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:28.517809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 211/427] 10.222.0.33 () {56 vars in 1376 bytes} [Sun Sep 11 00:40:28 2022] GET /identity/v3/role_assignments?group.id=673236c8ef914f5d9fe82e0e9e3482a5&scope.project.id=97e41b93d02a4c21aed2b712c418d461&role.id=f5585030f686473c89e1de214b25b6ff => generated 611 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:28.582759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65d98d-8fee-4021-af26-b1eea44275d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:28.584271 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65d98d-8fee-4021-af26-b1eea44275d0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:28.586672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:28.622294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac87761-4699-41c0-9b02-be90f7e6ab99 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:28.622624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac87761-4699-41c0-9b02-be90f7e6ab99 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:28.622876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac87761-4699-41c0-9b02-be90f7e6ab99 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:28.624420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 212/428] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:28.632148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab1379-a72c-4750-86f4-da10f781a95b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:28.633017 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab1379-a72c-4750-86f4-da10f781a95b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:28.633514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab1379-a72c-4750-86f4-da10f781a95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:28.657436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-59ab1379-a72c-4750-86f4-da10f781a95b None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:28.659850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-59ab1379-a72c-4750-86f4-da10f781a95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:28.739769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:28.748594 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 217/429] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:28.756003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d98d-8fee-4021-af26-b1eea44275d0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:28.763965 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 213/430] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:28.861652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d98d-8fee-4021-af26-b1eea44275d0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:28.863176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:28.905258 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b8cf5-3274-4b8b-8413-8a222401652e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:28.905895 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b8cf5-3274-4b8b-8413-8a222401652e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:28.906172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b8cf5-3274-4b8b-8413-8a222401652e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:28.906438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b8cf5-3274-4b8b-8413-8a222401652e None admin] PATH_INFO: `/v3/projects/97e41b93d02a4c21aed2b712c418d461` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:28.908168 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b8cf5-3274-4b8b-8413-8a222401652e None admin] RBAC: Authorizing `identity:get_project(project_id=97e41b93d02a4c21aed2b712c418d461)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:28.909585 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b8cf5-3274-4b8b-8413-8a222401652e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:28.911521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 218/431] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:28 2022] GET /identity/v3/projects/97e41b93d02a4c21aed2b712c418d461 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:28.917223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab1379-a72c-4750-86f4-da10f781a95b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:29.033503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab1379-a72c-4750-86f4-da10f781a95b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:29.058852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b8cf5-3274-4b8b-8413-8a222401652e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:29.072407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249df2-06c0-420c-88eb-7792b47a1993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:29.073377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249df2-06c0-420c-88eb-7792b47a1993 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:29.073871 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249df2-06c0-420c-88eb-7792b47a1993 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:29.074397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249df2-06c0-420c-88eb-7792b47a1993 None admin] PATH_INFO: `/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:29.075919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc249df2-06c0-420c-88eb-7792b47a1993 None admin] RBAC: Authorizing `identity:get_group(group_id=673236c8ef914f5d9fe82e0e9e3482a5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:29.077564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc249df2-06c0-420c-88eb-7792b47a1993 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:29.079714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 214/432] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:28 2022] GET /identity/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:29.087192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249df2-06c0-420c-88eb-7792b47a1993 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:29.157633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:29.200779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b8cf5-3274-4b8b-8413-8a222401652e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:29.216261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249df2-06c0-420c-88eb-7792b47a1993 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:29.246550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927a4ce-ddc1-4d27-91ed-52d87886cf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:29.248108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a4ce-ddc1-4d27-91ed-52d87886cf16 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:29.248623 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a4ce-ddc1-4d27-91ed-52d87886cf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:29.249184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a4ce-ddc1-4d27-91ed-52d87886cf16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:29.258249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af571c7-9462-44be-b63f-f9e4c76f46ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:29.259243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af571c7-9462-44be-b63f-f9e4c76f46ed None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:29.259718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af571c7-9462-44be-b63f-f9e4c76f46ed None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:29.260191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af571c7-9462-44be-b63f-f9e4c76f46ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:29.261111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af571c7-9462-44be-b63f-f9e4c76f46ed None admin] RBAC: Adding query filter params (group.id=673236c8ef914f5d9fe82e0e9e3482a5, role.id=5e35afebe51a448a9ee3ed338209d739, scope.project.id=97e41b93d02a4c21aed2b712c418d461) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:29.261605 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af571c7-9462-44be-b63f-f9e4c76f46ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:29.263395 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927a4ce-ddc1-4d27-91ed-52d87886cf16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:29.265088 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af571c7-9462-44be-b63f-f9e4c76f46ed None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-3927a4ce-ddc1-4d27-91ed-52d87886cf16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:29.268576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:29.269449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:29.270330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:29.270330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:29.270330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:29.270330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:29.270330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:29.270330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:29.270330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:29.270330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:29.270330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:29.270330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:29.270330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:40:29.270330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:29.274668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 215/434] 10.222.0.33 () {56 vars in 1376 bytes} [Sun Sep 11 00:40:29 2022] GET /identity/v3/role_assignments?group.id=673236c8ef914f5d9fe82e0e9e3482a5&scope.project.id=97e41b93d02a4c21aed2b712c418d461&role.id=5e35afebe51a448a9ee3ed338209d739 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:29.274807 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 219/434] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:29.278108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927a4ce-ddc1-4d27-91ed-52d87886cf16 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:29.319135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:29.400631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927a4ce-ddc1-4d27-91ed-52d87886cf16 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:29.440029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38bc0b-0440-4987-abef-182e8b770d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:29.440661 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38bc0b-0440-4987-abef-182e8b770d7a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:29.440932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38bc0b-0440-4987-abef-182e8b770d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:29.441194 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38bc0b-0440-4987-abef-182e8b770d7a None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:29.441885 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38bc0b-0440-4987-abef-182e8b770d7a None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:29.442184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38bc0b-0440-4987-abef-182e8b770d7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:29.443700 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38bc0b-0440-4987-abef-182e8b770d7a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:29.454793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 220/435] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:40:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:29.463938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af571c7-9462-44be-b63f-f9e4c76f46ed None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:29.563454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793934-eb46-46af-a018-0756daaded3b None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:29.563787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793934-eb46-46af-a018-0756daaded3b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:29.564057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793934-eb46-46af-a018-0756daaded3b None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:29.565644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 221/436] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:29.572614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56073887-9e46-49c0-9f9a-968f174d9a01 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:29.572614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56073887-9e46-49c0-9f9a-968f174d9a01 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:29.572614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56073887-9e46-49c0-9f9a-968f174d9a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:29.583062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af571c7-9462-44be-b63f-f9e4c76f46ed None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:29.602076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-56073887-9e46-49c0-9f9a-968f174d9a01 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:29.602631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-56073887-9e46-49c0-9f9a-968f174d9a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:29.603786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:29.629561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5bfa9-53f6-4ac8-874d-d7afcd3881b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:29.630769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5bfa9-53f6-4ac8-874d-d7afcd3881b7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:29.630769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5bfa9-53f6-4ac8-874d-d7afcd3881b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:29.631072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5bfa9-53f6-4ac8-874d-d7afcd3881b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:29.695922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 222/437] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:29.719031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5bfa9-53f6-4ac8-874d-d7afcd3881b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:29.720491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5bfa9-53f6-4ac8-874d-d7afcd3881b7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:29.804450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf440d-25ea-474a-bccc-f8461beb7560 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:29.805089 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf440d-25ea-474a-bccc-f8461beb7560 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:29.805442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf440d-25ea-474a-bccc-f8461beb7560 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:29.807804 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 223/438] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:29.814529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ab59-c978-4b2f-a436-e9b3f5a67c06 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:29.815117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ab59-c978-4b2f-a436-e9b3f5a67c06 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:29.815583 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ab59-c978-4b2f-a436-e9b3f5a67c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:29.830120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 216/439] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:29.831564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5bfa9-53f6-4ac8-874d-d7afcd3881b7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:29.842273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2a39ab59-c978-4b2f-a436-e9b3f5a67c06 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:29.844391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2a39ab59-c978-4b2f-a436-e9b3f5a67c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:29.850031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:29.867152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:29.921574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 224/440] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:29.946216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5bfa9-53f6-4ac8-874d-d7afcd3881b7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:29.973551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39ab59-c978-4b2f-a436-e9b3f5a67c06 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:29.980706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1000e0-8836-41c1-b95d-4f3c39de48c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:29.981900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1000e0-8836-41c1-b95d-4f3c39de48c7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:29.982196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1000e0-8836-41c1-b95d-4f3c39de48c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:29.982463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1000e0-8836-41c1-b95d-4f3c39de48c7 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:29.983590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1000e0-8836-41c1-b95d-4f3c39de48c7 None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:29.985011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1000e0-8836-41c1-b95d-4f3c39de48c7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:29.990761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 217/441] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:29 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:29.991989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1000e0-8836-41c1-b95d-4f3c39de48c7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:30.074057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:30.079615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39ab59-c978-4b2f-a436-e9b3f5a67c06 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:30.094872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1000e0-8836-41c1-b95d-4f3c39de48c7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:30.116144 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a962f-c0e9-4771-ad4c-485740b2653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:30.116769 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a962f-c0e9-4771-ad4c-485740b2653e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:30.117041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a962f-c0e9-4771-ad4c-485740b2653e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:30.117308 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a962f-c0e9-4771-ad4c-485740b2653e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:30.127347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a962f-c0e9-4771-ad4c-485740b2653e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:30.130028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccb04f-7a83-4775-8183-0ef43c754380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:30.130655 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccb04f-7a83-4775-8183-0ef43c754380 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:30.130964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccb04f-7a83-4775-8183-0ef43c754380 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:30.131233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccb04f-7a83-4775-8183-0ef43c754380 None admin] PATH_INFO: `/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b16a962f-c0e9-4771-ad4c-485740b2653e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:30.132055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:30.132936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:30.135621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:30.135621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:30.135621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:30.135621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:30.135621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:30.135621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:30.135621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:30.135621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:30.135621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:30.135621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:30.135621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:30.135621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:30.136264 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccb04f-7a83-4775-8183-0ef43c754380 None admin] RBAC: Authorizing `identity:get_group(group_id=673236c8ef914f5d9fe82e0e9e3482a5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:30.136336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 225/442] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:40:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:30.136400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccb04f-7a83-4775-8183-0ef43c754380 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:30.136400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 218/443] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:29 2022] GET /identity/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:30.139611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a962f-c0e9-4771-ad4c-485740b2653e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:30.144544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccb04f-7a83-4775-8183-0ef43c754380 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:30.155572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:30.243997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a962f-c0e9-4771-ad4c-485740b2653e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:30.246698 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccb04f-7a83-4775-8183-0ef43c754380 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:30.278420 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c13c58-5337-444e-b9ce-6b14e04e8fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:30.279041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c13c58-5337-444e-b9ce-6b14e04e8fee None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:30.279312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c13c58-5337-444e-b9ce-6b14e04e8fee None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:30.279573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c13c58-5337-444e-b9ce-6b14e04e8fee None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:30.280219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c13c58-5337-444e-b9ce-6b14e04e8fee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:30.280511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c13c58-5337-444e-b9ce-6b14e04e8fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:30.281461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d21af-e534-4e1e-8d1f-2a6932c9e163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:30.281849 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c13c58-5337-444e-b9ce-6b14e04e8fee None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:30.282060 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d21af-e534-4e1e-8d1f-2a6932c9e163 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:30.282342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d21af-e534-4e1e-8d1f-2a6932c9e163 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:30.282615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d21af-e534-4e1e-8d1f-2a6932c9e163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:30.283367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d21af-e534-4e1e-8d1f-2a6932c9e163 None admin] RBAC: Adding query filter params (group.id=673236c8ef914f5d9fe82e0e9e3482a5, role.id=f5585030f686473c89e1de214b25b6ff, scope.project.id=c1020531a2814c51b1db55f62f23ea32) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:30.283681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d21af-e534-4e1e-8d1f-2a6932c9e163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:30.285102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d21af-e534-4e1e-8d1f-2a6932c9e163 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:30.289903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 226/444] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:30.290715 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 219/445] 10.222.0.33 () {56 vars in 1376 bytes} [Sun Sep 11 00:40:30 2022] GET /identity/v3/role_assignments?group.id=673236c8ef914f5d9fe82e0e9e3482a5&scope.project.id=c1020531a2814c51b1db55f62f23ea32&role.id=f5585030f686473c89e1de214b25b6ff => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:30.291628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c13c58-5337-444e-b9ce-6b14e04e8fee None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:30.295705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d21af-e534-4e1e-8d1f-2a6932c9e163 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:30.314142 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:30.388823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:30.416233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d21af-e534-4e1e-8d1f-2a6932c9e163 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:30.418555 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c13c58-5337-444e-b9ce-6b14e04e8fee None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:30.457263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcb81a-d7b6-4da9-bf6d-1f9a495809b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:30.457892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcb81a-d7b6-4da9-bf6d-1f9a495809b1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:30.458170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcb81a-d7b6-4da9-bf6d-1f9a495809b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:30.458442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcb81a-d7b6-4da9-bf6d-1f9a495809b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:30.469384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7c5c6-1e23-4edb-ac54-ea3f165f2cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:30.469883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcb81a-d7b6-4da9-bf6d-1f9a495809b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:30.469978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7c5c6-1e23-4edb-ac54-ea3f165f2cff None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:30.470249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7c5c6-1e23-4edb-ac54-ea3f165f2cff None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:30.470514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7c5c6-1e23-4edb-ac54-ea3f165f2cff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-74fcb81a-d7b6-4da9-bf6d-1f9a495809b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:30.475203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:30.476080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:30.476869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:30.476869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:30.476869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:30.476869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:30.476869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:30.476869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:30.476869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:30.476869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:30.476869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:30.476869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:30.476869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:40:30.476869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:30.476869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 227/446] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:40:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:30.482199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcb81a-d7b6-4da9-bf6d-1f9a495809b1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:30.560961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7c5c6-1e23-4edb-ac54-ea3f165f2cff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:30.562431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7c5c6-1e23-4edb-ac54-ea3f165f2cff None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:30.579182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:30.597473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcb81a-d7b6-4da9-bf6d-1f9a495809b1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:30.638256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcf9dd-2be0-4e01-94b0-789c2ade6f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:30.639049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcf9dd-2be0-4e01-94b0-789c2ade6f2a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:30.640182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcf9dd-2be0-4e01-94b0-789c2ade6f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:30.640182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcf9dd-2be0-4e01-94b0-789c2ade6f2a None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:30.640352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcf9dd-2be0-4e01-94b0-789c2ade6f2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:30.640593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcf9dd-2be0-4e01-94b0-789c2ade6f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:30.641962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcf9dd-2be0-4e01-94b0-789c2ade6f2a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:30.644410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:30.652033 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 228/447] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:30.658436 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcf9dd-2be0-4e01-94b0-789c2ade6f2a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:30.683660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 220/448] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:40:30.690050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7c5c6-1e23-4edb-ac54-ea3f165f2cff None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:30.760360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcf9dd-2be0-4e01-94b0-789c2ade6f2a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:30.788017 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7c5c6-1e23-4edb-ac54-ea3f165f2cff None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:30.792875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae9116-f1f7-4672-9e25-421036fbd200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:30.793464 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae9116-f1f7-4672-9e25-421036fbd200 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:30.793737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae9116-f1f7-4672-9e25-421036fbd200 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:30.794029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae9116-f1f7-4672-9e25-421036fbd200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:30.802777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:30.823962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693c689-8181-46da-997e-a031409ce196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:30.824589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693c689-8181-46da-997e-a031409ce196 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:30.824865 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693c689-8181-46da-997e-a031409ce196 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:30.825188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693c689-8181-46da-997e-a031409ce196 None admin] PATH_INFO: `/v3/projects/c1020531a2814c51b1db55f62f23ea32` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:30.826849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693c689-8181-46da-997e-a031409ce196 None admin] RBAC: Authorizing `identity:get_project(project_id=c1020531a2814c51b1db55f62f23ea32)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:30.828279 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693c689-8181-46da-997e-a031409ce196 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:30.829898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 221/449] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:30 2022] GET /identity/v3/projects/c1020531a2814c51b1db55f62f23ea32 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:30.835280 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693c689-8181-46da-997e-a031409ce196 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:30.856227 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:30.863858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae9116-f1f7-4672-9e25-421036fbd200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:30.865303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae9116-f1f7-4672-9e25-421036fbd200 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:30.931926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693c689-8181-46da-997e-a031409ce196 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:30.960923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 229/450] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:40:30.964217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61a5e6-ccd1-4c09-bcb3-c0ddf087f108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:30.964838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61a5e6-ccd1-4c09-bcb3-c0ddf087f108 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:30.965112 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61a5e6-ccd1-4c09-bcb3-c0ddf087f108 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:30.965378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61a5e6-ccd1-4c09-bcb3-c0ddf087f108 None admin] PATH_INFO: `/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:30.967303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61a5e6-ccd1-4c09-bcb3-c0ddf087f108 None admin] RBAC: Authorizing `identity:get_group(group_id=673236c8ef914f5d9fe82e0e9e3482a5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:30.968754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61a5e6-ccd1-4c09-bcb3-c0ddf087f108 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:30.970287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 222/451] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:30 2022] GET /identity/v3/groups/673236c8ef914f5d9fe82e0e9e3482a5 => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:30.974074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae9116-f1f7-4672-9e25-421036fbd200 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:30.975688 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61a5e6-ccd1-4c09-bcb3-c0ddf087f108 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:31.023807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:31.073562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61a5e6-ccd1-4c09-bcb3-c0ddf087f108 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:31.076584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:31.082475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae9116-f1f7-4672-9e25-421036fbd200 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:31.107042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa7869-91d2-43fd-88ad-77b79c6a535c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:31.107734 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa7869-91d2-43fd-88ad-77b79c6a535c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:31.108016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa7869-91d2-43fd-88ad-77b79c6a535c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:31.108290 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa7869-91d2-43fd-88ad-77b79c6a535c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:31.109007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa7869-91d2-43fd-88ad-77b79c6a535c None admin] RBAC: Adding query filter params (group.id=673236c8ef914f5d9fe82e0e9e3482a5, role.id=5e35afebe51a448a9ee3ed338209d739, scope.project.id=c1020531a2814c51b1db55f62f23ea32) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:31.109313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa7869-91d2-43fd-88ad-77b79c6a535c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:31.110822 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa7869-91d2-43fd-88ad-77b79c6a535c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:31.115209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134fc34-3571-4421-89ad-38b4a28cedf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:31.115817 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134fc34-3571-4421-89ad-38b4a28cedf1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:31.116087 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134fc34-3571-4421-89ad-38b4a28cedf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:31.116351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134fc34-3571-4421-89ad-38b4a28cedf1 None admin] PATH_INFO: `/v3/projects/a604dda8f82546e29f08510ef905d15b` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:31.116550 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 223/452] 10.222.0.33 () {56 vars in 1376 bytes} [Sun Sep 11 00:40:30 2022] GET /identity/v3/role_assignments?group.id=673236c8ef914f5d9fe82e0e9e3482a5&scope.project.id=c1020531a2814c51b1db55f62f23ea32&role.id=5e35afebe51a448a9ee3ed338209d739 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:31.117450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134fc34-3571-4421-89ad-38b4a28cedf1 None admin] RBAC: Authorizing `identity:get_project(project_id=a604dda8f82546e29f08510ef905d15b)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:31.118902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134fc34-3571-4421-89ad-38b4a28cedf1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:31.120512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 230/453] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:40:30 2022] GET /identity/v3/projects/a604dda8f82546e29f08510ef905d15b => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:31.126866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa7869-91d2-43fd-88ad-77b79c6a535c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:31.239447 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa7869-91d2-43fd-88ad-77b79c6a535c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:31.254486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:31.274836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f1415-5830-4d2e-a700-4e13b584d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:31.275478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f1415-5830-4d2e-a700-4e13b584d603 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:31.275749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f1415-5830-4d2e-a700-4e13b584d603 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:31.276012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f1415-5830-4d2e-a700-4e13b584d603 None admin] PATH_INFO: `/v3/groups/940ce76f9385401a9cabeb218acca161` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:31.277110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f1415-5830-4d2e-a700-4e13b584d603 None admin] RBAC: Authorizing `identity:get_group(group_id=940ce76f9385401a9cabeb218acca161)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:31.278550 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f1415-5830-4d2e-a700-4e13b584d603 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:31.280118 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 224/454] 10.222.0.33 () {56 vars in 1180 bytes} [Sun Sep 11 00:40:31 2022] GET /identity/v3/groups/940ce76f9385401a9cabeb218acca161 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:31.285954 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134fc34-3571-4421-89ad-38b4a28cedf1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:31.386919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134fc34-3571-4421-89ad-38b4a28cedf1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:31.421487 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a34a05-7708-4876-9ce3-9f812af20e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:31.422099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a34a05-7708-4876-9ce3-9f812af20e56 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:31.422377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a34a05-7708-4876-9ce3-9f812af20e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:31.422647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a34a05-7708-4876-9ce3-9f812af20e56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:31.423404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a34a05-7708-4876-9ce3-9f812af20e56 None admin] RBAC: Adding query filter params (group.id=940ce76f9385401a9cabeb218acca161, role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=a604dda8f82546e29f08510ef905d15b) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:31.423708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a34a05-7708-4876-9ce3-9f812af20e56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:31.425131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a34a05-7708-4876-9ce3-9f812af20e56 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:31.431446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 231/455] 10.222.0.33 () {56 vars in 1376 bytes} [Sun Sep 11 00:40:31 2022] GET /identity/v3/role_assignments?group.id=940ce76f9385401a9cabeb218acca161&scope.project.id=a604dda8f82546e29f08510ef905d15b&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:33.984989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a878fe-eddc-477e-97ad-2a1432cec688 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:33.985507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a878fe-eddc-477e-97ad-2a1432cec688 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:33.985507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a878fe-eddc-477e-97ad-2a1432cec688 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:33.987263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 225/456] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:33.992143 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deda4c9-6fd8-49bd-9a63-4f7048baba5a None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:33.992578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deda4c9-6fd8-49bd-9a63-4f7048baba5a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:33.992750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deda4c9-6fd8-49bd-9a63-4f7048baba5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:34.019688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-1deda4c9-6fd8-49bd-9a63-4f7048baba5a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:34.020864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1deda4c9-6fd8-49bd-9a63-4f7048baba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:34.048417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:34.104348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 232/457] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:34.426485 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbcf9a-cfea-4d73-a34c-502ed4d31265 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:34.426794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbcf9a-cfea-4d73-a34c-502ed4d31265 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:34.427074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbcf9a-cfea-4d73-a34c-502ed4d31265 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:34.428687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 226/458] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:34.434186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bdafc-a588-4aa8-8103-35aeccce4566 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:34.434469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bdafc-a588-4aa8-8103-35aeccce4566 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:34.434759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bdafc-a588-4aa8-8103-35aeccce4566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:34.462957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9e3bdafc-a588-4aa8-8103-35aeccce4566 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:34.464139 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9e3bdafc-a588-4aa8-8103-35aeccce4566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:34.491855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beb854-6c63-4432-b233-9923242f83f2 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:34.492459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beb854-6c63-4432-b233-9923242f83f2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:34.492930 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beb854-6c63-4432-b233-9923242f83f2 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:34.498753 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 227/459] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:34.500279 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa628db9-8d75-4d67-b7a4-e565e451f986 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:34.500793 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa628db9-8d75-4d67-b7a4-e565e451f986 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:34.501307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa628db9-8d75-4d67-b7a4-e565e451f986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:34.535750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-aa628db9-8d75-4d67-b7a4-e565e451f986 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:34.537280 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-aa628db9-8d75-4d67-b7a4-e565e451f986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:34.538932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 233/460] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:34.568605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bdafc-a588-4aa8-8103-35aeccce4566 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:34.614384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 228/461] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:34.673633 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:34.686030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bdafc-a588-4aa8-8103-35aeccce4566 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:34.720598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d94b1-e9f3-412c-a224-85c52a678e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:34.721214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d94b1-e9f3-412c-a224-85c52a678e34 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:34.721489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d94b1-e9f3-412c-a224-85c52a678e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:34.721755 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d94b1-e9f3-412c-a224-85c52a678e34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:34.731769 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d94b1-e9f3-412c-a224-85c52a678e34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:34.733224 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d94b1-e9f3-412c-a224-85c52a678e34 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-e84d94b1-e9f3-412c-a224-85c52a678e34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:34.748355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:34.749274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:34.750183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:34.750183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:34.750183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:34.750183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 234/462] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:34.756786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa628db9-8d75-4d67-b7a4-e565e451f986 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:34.929600 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa628db9-8d75-4d67-b7a4-e565e451f986 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:34.951384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d94b1-e9f3-412c-a224-85c52a678e34 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:34.952379 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:34.975690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad24d59-ae0d-4116-a227-f81fd0b8cc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:34.976306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad24d59-ae0d-4116-a227-f81fd0b8cc3f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:34.976581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad24d59-ae0d-4116-a227-f81fd0b8cc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:34.976847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad24d59-ae0d-4116-a227-f81fd0b8cc3f None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:34.977493 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad24d59-ae0d-4116-a227-f81fd0b8cc3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:34.977889 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad24d59-ae0d-4116-a227-f81fd0b8cc3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:34.979402 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad24d59-ae0d-4116-a227-f81fd0b8cc3f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:34.998135 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 229/463] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:34.999452 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c60fe-96b9-4f49-b0a7-2302d2f6aacd None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:34.999737 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c60fe-96b9-4f49-b0a7-2302d2f6aacd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:35.000005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c60fe-96b9-4f49-b0a7-2302d2f6aacd None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:35.001207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 230/464] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:35.001892 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c60fe-96b9-4f49-b0a7-2302d2f6aacd None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:35.076754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d94b1-e9f3-412c-a224-85c52a678e34 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:35.107606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c60fe-96b9-4f49-b0a7-2302d2f6aacd None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:35.113645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00071e34-5be0-4af2-aa31-8548489c5961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:35.114272 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00071e34-5be0-4af2-aa31-8548489c5961 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:35.114552 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00071e34-5be0-4af2-aa31-8548489c5961 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:35.115271 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00071e34-5be0-4af2-aa31-8548489c5961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:35.125309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:35.128434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00071e34-5be0-4af2-aa31-8548489c5961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:35.130368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00071e34-5be0-4af2-aa31-8548489c5961 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:35.142495 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a7645-ec5b-468a-8e75-76c4c55841b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:35.143164 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a7645-ec5b-468a-8e75-76c4c55841b5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:35.143439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a7645-ec5b-468a-8e75-76c4c55841b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:35.143703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a7645-ec5b-468a-8e75-76c4c55841b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-00071e34-5be0-4af2-aa31-8548489c5961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:35.146301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:35.147234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:35.148100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:35.148100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:35.148100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:35.148100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 235/465] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:35.148855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00071e34-5be0-4af2-aa31-8548489c5961 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:35.159839 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a7645-ec5b-468a-8e75-76c4c55841b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:35.164348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a7645-ec5b-468a-8e75-76c4c55841b5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ea5a7645-ec5b-468a-8e75-76c4c55841b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:35.181179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:35.182289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:35.183169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:35.183169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:35.183169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:35.183169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 231/466] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:35.183743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d736-be36-461a-8ee0-8be29543d97c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:35.183743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d736-be36-461a-8ee0-8be29543d97c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:35.183982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d736-be36-461a-8ee0-8be29543d97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:35.203531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8a80d736-be36-461a-8ee0-8be29543d97c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:35.204628 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8a80d736-be36-461a-8ee0-8be29543d97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:35.224531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:35.259841 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00071e34-5be0-4af2-aa31-8548489c5961 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:35.276199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 232/467] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:35.277253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d736-be36-461a-8ee0-8be29543d97c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:35.301302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a618407-e9f5-42fc-b23f-3da440d362a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:35.301904 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a618407-e9f5-42fc-b23f-3da440d362a7 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:35.302180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a618407-e9f5-42fc-b23f-3da440d362a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:35.302459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a618407-e9f5-42fc-b23f-3da440d362a7 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:35.303244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a618407-e9f5-42fc-b23f-3da440d362a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:35.304672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a618407-e9f5-42fc-b23f-3da440d362a7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:35.338697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 236/468] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:40:35 2022] POST /identity/v3/users => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:40:35.339560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a618407-e9f5-42fc-b23f-3da440d362a7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:35.400869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:35.469345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d736-be36-461a-8ee0-8be29543d97c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:35.503683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a618407-e9f5-42fc-b23f-3da440d362a7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:35.517899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3d69d-100b-4737-9087-88dce8a77ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:35.518655 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3d69d-100b-4737-9087-88dce8a77ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:35.519043 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3d69d-100b-4737-9087-88dce8a77ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:35.519376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3d69d-100b-4737-9087-88dce8a77ba6 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:35.520187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3d69d-100b-4737-9087-88dce8a77ba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:35.520550 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3d69d-100b-4737-9087-88dce8a77ba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:35.522171 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3d69d-100b-4737-9087-88dce8a77ba6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:35.536621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 233/469] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:35.537915 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7267b58-65bb-4660-9518-a2d0f11eb383 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:35.538198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7267b58-65bb-4660-9518-a2d0f11eb383 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:35.538468 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7267b58-65bb-4660-9518-a2d0f11eb383 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:35.539915 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 234/470] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:35.544934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7267b58-65bb-4660-9518-a2d0f11eb383 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:35.547092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e1bca-ce8f-44bd-a2ec-c0c45f4d2bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:35.547819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e1bca-ce8f-44bd-a2ec-c0c45f4d2bba None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:35.548190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e1bca-ce8f-44bd-a2ec-c0c45f4d2bba None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:35.548554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e1bca-ce8f-44bd-a2ec-c0c45f4d2bba None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:35.549320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e1bca-ce8f-44bd-a2ec-c0c45f4d2bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:35.549710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e1bca-ce8f-44bd-a2ec-c0c45f4d2bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:35.551228 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e1bca-ce8f-44bd-a2ec-c0c45f4d2bba None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:35.562996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:35.568262 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 237/471] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:35.568508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fb818-d5e3-4704-affc-d868c5504d76 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:35.569008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fb818-d5e3-4704-affc-d868c5504d76 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:35.569401 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fb818-d5e3-4704-affc-d868c5504d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:35.590707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-598fb818-d5e3-4704-affc-d868c5504d76 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:35.592715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-598fb818-d5e3-4704-affc-d868c5504d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:35.673745 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7267b58-65bb-4660-9518-a2d0f11eb383 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:35.686834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 238/472] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:35.687727 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fb818-d5e3-4704-affc-d868c5504d76 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:35.714570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b469af-17c9-460e-af9a-75a291c68448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:35.715566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b469af-17c9-460e-af9a-75a291c68448 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:35.716035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b469af-17c9-460e-af9a-75a291c68448 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:35.716528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b469af-17c9-460e-af9a-75a291c68448 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:35.717683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b469af-17c9-460e-af9a-75a291c68448 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:35.719329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b469af-17c9-460e-af9a-75a291c68448 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:35.729879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:35.748528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 235/473] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:40:35 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:40:35.750357 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b469af-17c9-460e-af9a-75a291c68448 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:35.803412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fb818-d5e3-4704-affc-d868c5504d76 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:35.841898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a3fab-abe1-4f21-8355-a033a51f561f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:35.842970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a3fab-abe1-4f21-8355-a033a51f561f None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:35.843315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a3fab-abe1-4f21-8355-a033a51f561f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:35.843644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a3fab-abe1-4f21-8355-a033a51f561f None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:35.844359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a3fab-abe1-4f21-8355-a033a51f561f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:35.846084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a3fab-abe1-4f21-8355-a033a51f561f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:35.849087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:35.897948 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 239/474] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:40:35 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:40:35.909161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b469af-17c9-460e-af9a-75a291c68448 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:35.957431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c401ca8-b194-48f4-af96-6c7a0e05a630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:35.958105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c401ca8-b194-48f4-af96-6c7a0e05a630 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:35.958386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c401ca8-b194-48f4-af96-6c7a0e05a630 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:35.958660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c401ca8-b194-48f4-af96-6c7a0e05a630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:35.973886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c401ca8-b194-48f4-af96-6c7a0e05a630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:35.975560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c401ca8-b194-48f4-af96-6c7a0e05a630 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1c401ca8-b194-48f4-af96-6c7a0e05a630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:35.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:35.994001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:35.994901 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:35.994901 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:35.994901 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:35.995502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 236/475] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:36.002103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a3fab-abe1-4f21-8355-a033a51f561f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:36.002372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c401ca8-b194-48f4-af96-6c7a0e05a630 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:36.134560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c401ca8-b194-48f4-af96-6c7a0e05a630 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:36.160418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:36.169200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:36.169698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a3fab-abe1-4f21-8355-a033a51f561f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:36.187641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77c798-734b-4108-96da-9fea98240110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:36.188546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77c798-734b-4108-96da-9fea98240110 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:36.188817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77c798-734b-4108-96da-9fea98240110 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:36.189088 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77c798-734b-4108-96da-9fea98240110 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:36.189934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77c798-734b-4108-96da-9fea98240110 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:36.192059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77c798-734b-4108-96da-9fea98240110 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:36.207583 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.sql.core [None req-cb77c798-734b-4108-96da-9fea98240110 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 00:40:36.207583 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 00:40:36.207583 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [parameters: {'id': 'f3a7c486e6034e3ab9afa7766d51eef6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 00:40:36.207583 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 00:40:36.213073 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cbf7c-daf2-4f65-b268-1144b2d948f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:36.213757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cbf7c-daf2-4f65-b268-1144b2d948f9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:36.214103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cbf7c-daf2-4f65-b268-1144b2d948f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:36.214437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cbf7c-daf2-4f65-b268-1144b2d948f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:36.215206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cbf7c-daf2-4f65-b268-1144b2d948f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:36.215574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cbf7c-daf2-4f65-b268-1144b2d948f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:36.217793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cbf7c-daf2-4f65-b268-1144b2d948f9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:36.230989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 240/476] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-cb77c798-734b-4108-96da-9fea98240110 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Sep 11 00:40:36.231436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return ref.to_dict() Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:40:36.233076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application yield resource Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise self.value Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application session.commit() Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 00:40:36.236612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.flush() Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application compat.raise_( Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 00:40:36.237489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:40:36.238350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:40:36.242541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [parameters: {'id': 'f3a7c486e6034e3ab9afa7766d51eef6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:36.244642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 00:40:36.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:36.248611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 237/477] 10.222.0.33 () {60 vars in 1131 bytes} [Sun Sep 11 00:40:36 2022] POST /identity/v3/roles => generated 144 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:36.248755 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cbf7c-daf2-4f65-b268-1144b2d948f9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:36.250622 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77c798-734b-4108-96da-9fea98240110 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:36.364995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77c798-734b-4108-96da-9fea98240110 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:36.376097 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cbf7c-daf2-4f65-b268-1144b2d948f9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:36.406998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387a078-1d35-465c-a382-a339de9684fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:36.407975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387a078-1d35-465c-a382-a339de9684fd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:36.408448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387a078-1d35-465c-a382-a339de9684fd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:36.408910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387a078-1d35-465c-a382-a339de9684fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:36.424571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387a078-1d35-465c-a382-a339de9684fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:36.428196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2956718-9dd2-47f0-9fcc-ba02f5d969c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4387a078-1d35-465c-a382-a339de9684fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:36.431870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:36.432758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:36.433543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:36.433543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:36.433543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:36.433543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:36.433543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:36.433543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:36.433543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:36.433543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:36.433543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:36.433543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:36.433543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:40:36.433543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:36.433543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 238/478] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:40:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:36.437765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2956718-9dd2-47f0-9fcc-ba02f5d969c3 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:36.438301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2956718-9dd2-47f0-9fcc-ba02f5d969c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:36.438639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387a078-1d35-465c-a382-a339de9684fd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:36.438996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2956718-9dd2-47f0-9fcc-ba02f5d969c3 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:36.440345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2956718-9dd2-47f0-9fcc-ba02f5d969c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:36.443108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2956718-9dd2-47f0-9fcc-ba02f5d969c3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:36.493483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 241/479] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:40:36 2022] POST /identity/v3/users => generated 249 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:40:36.495158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:36.558481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387a078-1d35-465c-a382-a339de9684fd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:36.596775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ad28d-1217-4720-bdeb-94b74d1363bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:36.597390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ad28d-1217-4720-bdeb-94b74d1363bd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:36.597667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ad28d-1217-4720-bdeb-94b74d1363bd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:36.597942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ad28d-1217-4720-bdeb-94b74d1363bd None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:36.598710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ad28d-1217-4720-bdeb-94b74d1363bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:36.599034 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ad28d-1217-4720-bdeb-94b74d1363bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:36.600424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ad28d-1217-4720-bdeb-94b74d1363bd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:36.614769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 239/480] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:37.994907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283f2c3-1712-4012-8e8b-57cf926d64e3 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:37.995910 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283f2c3-1712-4012-8e8b-57cf926d64e3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:37.996406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283f2c3-1712-4012-8e8b-57cf926d64e3 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:37.997909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 242/481] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:38.003502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64850b-28dc-466e-a48f-2dfd65c0b006 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:38.003910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64850b-28dc-466e-a48f-2dfd65c0b006 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:38.004082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64850b-28dc-466e-a48f-2dfd65c0b006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:38.031033 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1e64850b-28dc-466e-a48f-2dfd65c0b006 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:38.032288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1e64850b-28dc-466e-a48f-2dfd65c0b006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:38.115164 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 240/482] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:38.449673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283f2c3-1712-4012-8e8b-57cf926d64e3 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:38.463260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:38.576438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283f2c3-1712-4012-8e8b-57cf926d64e3 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:38.628811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7434a8-d01d-4418-9b37-b22e083fd30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:38.629450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7434a8-d01d-4418-9b37-b22e083fd30e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:38.629732 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7434a8-d01d-4418-9b37-b22e083fd30e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:38.630005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7434a8-d01d-4418-9b37-b22e083fd30e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:38.647770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7434a8-d01d-4418-9b37-b22e083fd30e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-de7434a8-d01d-4418-9b37-b22e083fd30e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:38.652662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:38.653516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:38.654306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:38.654306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:38.654306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:38.654306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:38.654306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:38.654306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:38.654306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:38.654306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:38.654306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:38.654306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:38.654306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:38.654306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:38.654306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 243/483] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:38.661536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64850b-28dc-466e-a48f-2dfd65c0b006 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:38.722654 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:38.817910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64850b-28dc-466e-a48f-2dfd65c0b006 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:38.870212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d50d00-4869-46ca-9d66-d34026188f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:38.870847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d50d00-4869-46ca-9d66-d34026188f79 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:38.871125 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d50d00-4869-46ca-9d66-d34026188f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:38.871393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d50d00-4869-46ca-9d66-d34026188f79 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:38.872055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d50d00-4869-46ca-9d66-d34026188f79 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:38.872354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d50d00-4869-46ca-9d66-d34026188f79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:38.873774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d50d00-4869-46ca-9d66-d34026188f79 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:38.876110 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f539f-b15b-4899-8f38-49dc52af4a8f None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:38.876396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f539f-b15b-4899-8f38-49dc52af4a8f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:38.876670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f539f-b15b-4899-8f38-49dc52af4a8f None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:38.878305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 244/484] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:38.883220 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3094-cc5e-44a9-bcde-1f0becd65e5c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:38.883501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3094-cc5e-44a9-bcde-1f0becd65e5c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:38.883776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3094-cc5e-44a9-bcde-1f0becd65e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:38.886574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 241/485] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:38.897384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d50d00-4869-46ca-9d66-d34026188f79 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:38.917833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b9ec3094-cc5e-44a9-bcde-1f0becd65e5c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:38.919048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b9ec3094-cc5e-44a9-bcde-1f0becd65e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:39.000687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:39.008871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 245/486] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:39.012103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe471-0242-4178-910b-c1f013448fb4 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:39.012383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe471-0242-4178-910b-c1f013448fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:39.012656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe471-0242-4178-910b-c1f013448fb4 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:39.014915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 246/487] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:39.021802 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435c151-d355-4c48-a7be-4bae3ae155ea None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:39.022113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435c151-d355-4c48-a7be-4bae3ae155ea None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:39.022340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435c151-d355-4c48-a7be-4bae3ae155ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:39.047563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b435c151-d355-4c48-a7be-4bae3ae155ea None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:39.051434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b435c151-d355-4c48-a7be-4bae3ae155ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:39.052971 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:39.058848 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d50d00-4869-46ca-9d66-d34026188f79 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:39.130735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90389800-ae3b-446b-90d7-641511d2e726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:39.131396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90389800-ae3b-446b-90d7-641511d2e726 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:39.131676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90389800-ae3b-446b-90d7-641511d2e726 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:39.131948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90389800-ae3b-446b-90d7-641511d2e726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:39.144660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90389800-ae3b-446b-90d7-641511d2e726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:39.146360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90389800-ae3b-446b-90d7-641511d2e726 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-90389800-ae3b-446b-90d7-641511d2e726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:39.162090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:39.163062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:39.163910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:39.163910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:39.163910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:39.163910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 242/488] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:39.164133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 247/489] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:39.166761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af79107-8d08-4706-a296-4acbfb00ecf0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:39.166761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af79107-8d08-4706-a296-4acbfb00ecf0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:39.166761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af79107-8d08-4706-a296-4acbfb00ecf0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:39.169557 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435c151-d355-4c48-a7be-4bae3ae155ea None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:39.171096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 243/490] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:39.172724 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e89b5-238a-468c-9383-347fa2f744b1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:39.173088 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e89b5-238a-468c-9383-347fa2f744b1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:39.173363 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e89b5-238a-468c-9383-347fa2f744b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:39.193601 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ca8e89b5-238a-468c-9383-347fa2f744b1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:39.195348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ca8e89b5-238a-468c-9383-347fa2f744b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:39.278168 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435c151-d355-4c48-a7be-4bae3ae155ea None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:39.286810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 244/491] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:39.310581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:39.314614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f9ce6-8084-4c88-87f1-7f1dfddea67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:39.315286 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f9ce6-8084-4c88-87f1-7f1dfddea67d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:39.315792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f9ce6-8084-4c88-87f1-7f1dfddea67d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:39.316066 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f9ce6-8084-4c88-87f1-7f1dfddea67d None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:39.316758 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f9ce6-8084-4c88-87f1-7f1dfddea67d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:39.317188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f9ce6-8084-4c88-87f1-7f1dfddea67d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:39.318626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f9ce6-8084-4c88-87f1-7f1dfddea67d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:39.329677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e89b5-238a-468c-9383-347fa2f744b1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:39.335765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 248/492] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:39.341159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f9ce6-8084-4c88-87f1-7f1dfddea67d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:39.417382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:39.446840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e89b5-238a-468c-9383-347fa2f744b1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:39.473357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f9ce6-8084-4c88-87f1-7f1dfddea67d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:39.508162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57255858-7278-497a-8db1-54877434d746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:39.509115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57255858-7278-497a-8db1-54877434d746 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:39.509618 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57255858-7278-497a-8db1-54877434d746 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:39.510091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57255858-7278-497a-8db1-54877434d746 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:39.528540 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57255858-7278-497a-8db1-54877434d746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-57255858-7278-497a-8db1-54877434d746 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:39.533778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:39.534684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:39.535499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:39.535499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:39.535499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:39.535499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:39.535499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:39.535499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:39.535499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:39.535499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:39.535499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:39.535499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:39.535499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:39.535499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:39.538026 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 245/493] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:39.542264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd43756-c692-492f-bff0-de2ebdeaf139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:39.542264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd43756-c692-492f-bff0-de2ebdeaf139 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:39.542264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd43756-c692-492f-bff0-de2ebdeaf139 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:39.542264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd43756-c692-492f-bff0-de2ebdeaf139 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:39.543339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57255858-7278-497a-8db1-54877434d746 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:39.550577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd43756-c692-492f-bff0-de2ebdeaf139 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:39.552276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd43756-c692-492f-bff0-de2ebdeaf139 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-7cd43756-c692-492f-bff0-de2ebdeaf139 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:39.567152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:39.568085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:39.569094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:39.569094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:39.569094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:39.569094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:39.569094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:39.569094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:39.569094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:39.569094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:39.569094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:40:39.569094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:39.571884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 249/494] 10.222.0.33 () {56 vars in 1093 bytes} [Sun Sep 11 00:40:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:39.572887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd43756-c692-492f-bff0-de2ebdeaf139 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:39.631586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:39.671141 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57255858-7278-497a-8db1-54877434d746 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:39.692684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd43756-c692-492f-bff0-de2ebdeaf139 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:39.709030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c6e61-192d-4483-897d-9982b8a4f68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:39.709657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c6e61-192d-4483-897d-9982b8a4f68e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:39.709934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c6e61-192d-4483-897d-9982b8a4f68e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:39.710205 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c6e61-192d-4483-897d-9982b8a4f68e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:39.721361 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c6e61-192d-4483-897d-9982b8a4f68e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-508c6e61-192d-4483-897d-9982b8a4f68e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:39.726639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:39.727587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:39.728389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:39.728389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:39.728389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:39.728389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:39.728389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:39.728389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:39.728389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:39.728389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:39.728389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:39.728389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:39.728389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:39.728389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:39.728389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 246/495] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:39.731675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c6e61-192d-4483-897d-9982b8a4f68e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:39.734797 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:39.737148 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9988531-a8fd-41fe-8b76-42de9327bfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:39.737753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9988531-a8fd-41fe-8b76-42de9327bfb3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:39.738028 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9988531-a8fd-41fe-8b76-42de9327bfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:39.738336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9988531-a8fd-41fe-8b76-42de9327bfb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:39.738977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9988531-a8fd-41fe-8b76-42de9327bfb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:39.739277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9988531-a8fd-41fe-8b76-42de9327bfb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:39.740643 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9988531-a8fd-41fe-8b76-42de9327bfb3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:39.754014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 250/496] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:39.754014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9988531-a8fd-41fe-8b76-42de9327bfb3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:39.833278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c6e61-192d-4483-897d-9982b8a4f68e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:39.852281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9988531-a8fd-41fe-8b76-42de9327bfb3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:39.864800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:39.869778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd3d25-2a4a-4e28-b2c8-975d696eefe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:39.870372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd3d25-2a4a-4e28-b2c8-975d696eefe3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:39.870640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd3d25-2a4a-4e28-b2c8-975d696eefe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:39.870928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd3d25-2a4a-4e28-b2c8-975d696eefe3 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:39.871638 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd3d25-2a4a-4e28-b2c8-975d696eefe3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:39.871938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd3d25-2a4a-4e28-b2c8-975d696eefe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:39.873886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd3d25-2a4a-4e28-b2c8-975d696eefe3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:39.885901 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d47492-c0cf-40d3-9695-0160018e9082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:39.886515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d47492-c0cf-40d3-9695-0160018e9082 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:39.886831 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d47492-c0cf-40d3-9695-0160018e9082 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:39.887102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d47492-c0cf-40d3-9695-0160018e9082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:39.897382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d47492-c0cf-40d3-9695-0160018e9082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:39.898843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d47492-c0cf-40d3-9695-0160018e9082 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:39.909288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 247/497] 10.222.0.33 () {56 vars in 1133 bytes} [Sun Sep 11 00:40:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:39.910094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd3d25-2a4a-4e28-b2c8-975d696eefe3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-53d47492-c0cf-40d3-9695-0160018e9082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:39.913141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:39.914099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:39.919864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:39.919864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:39.919864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:39.919864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 251/498] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:39.919864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d47492-c0cf-40d3-9695-0160018e9082 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:39.974863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:40.013771 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d47492-c0cf-40d3-9695-0160018e9082 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:40.015325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd3d25-2a4a-4e28-b2c8-975d696eefe3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:40.048586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00b0f6-8c59-45f8-a6f6-e761eadb3cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:40.048760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdceece-3847-4c47-9147-82404eb93305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:40.049243 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00b0f6-8c59-45f8-a6f6-e761eadb3cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:40.049367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdceece-3847-4c47-9147-82404eb93305 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:40.049537 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00b0f6-8c59-45f8-a6f6-e761eadb3cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:40.049630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdceece-3847-4c47-9147-82404eb93305 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:40.049795 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00b0f6-8c59-45f8-a6f6-e761eadb3cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:40.049961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdceece-3847-4c47-9147-82404eb93305 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:40.050675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdceece-3847-4c47-9147-82404eb93305 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:40.051009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdceece-3847-4c47-9147-82404eb93305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:40.052447 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdceece-3847-4c47-9147-82404eb93305 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:40.060244 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 248/499] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:40.060788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00b0f6-8c59-45f8-a6f6-e761eadb3cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:40.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344995d8-dd07-4bfc-877e-ed2c01ca39b5 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:40.062282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344995d8-dd07-4bfc-877e-ed2c01ca39b5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:40.062373 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00b0f6-8c59-45f8-a6f6-e761eadb3cc2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:40.062547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344995d8-dd07-4bfc-877e-ed2c01ca39b5 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:40.063761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 249/500] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:40.064436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344995d8-dd07-4bfc-877e-ed2c01ca39b5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-dd00b0f6-8c59-45f8-a6f6-e761eadb3cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:40.079946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:40.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:40.082119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:40.082119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:40.082119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:40.082119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 252/501] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:40.082119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00b0f6-8c59-45f8-a6f6-e761eadb3cc2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:40.101083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:40.166895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344995d8-dd07-4bfc-877e-ed2c01ca39b5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:40.182489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00b0f6-8c59-45f8-a6f6-e761eadb3cc2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:40.188927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:40.200591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28719cb-dafe-4fe2-a11a-efa8d4456b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:40.201220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28719cb-dafe-4fe2-a11a-efa8d4456b2b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:40.201501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28719cb-dafe-4fe2-a11a-efa8d4456b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:40.202313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28719cb-dafe-4fe2-a11a-efa8d4456b2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:40.214980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26dd87-3443-46e0-a6c0-3d21835f0cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:40.215562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26dd87-3443-46e0-a6c0-3d21835f0cda None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:40.215834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26dd87-3443-46e0-a6c0-3d21835f0cda None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:40.216096 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26dd87-3443-46e0-a6c0-3d21835f0cda None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:40.216717 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26dd87-3443-46e0-a6c0-3d21835f0cda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:40.217012 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26dd87-3443-46e0-a6c0-3d21835f0cda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:40.218715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26dd87-3443-46e0-a6c0-3d21835f0cda None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:40.230058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 253/502] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:40.230958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26dd87-3443-46e0-a6c0-3d21835f0cda None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:40.276102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28719cb-dafe-4fe2-a11a-efa8d4456b2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:40.277539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28719cb-dafe-4fe2-a11a-efa8d4456b2b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:40.304101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:40.328384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26dd87-3443-46e0-a6c0-3d21835f0cda None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:40.361829 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c8b8b-35e4-47cc-b227-e646d013427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:40.362371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c8b8b-35e4-47cc-b227-e646d013427f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:40.362648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c8b8b-35e4-47cc-b227-e646d013427f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:40.362943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c8b8b-35e4-47cc-b227-e646d013427f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:40.372559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c8b8b-35e4-47cc-b227-e646d013427f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:40.374543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c8b8b-35e4-47cc-b227-e646d013427f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:40.374805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 250/503] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:40.376048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fab4a-ec63-48c0-bf2c-0a1c5668972f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:40.376324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fab4a-ec63-48c0-bf2c-0a1c5668972f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:40.376591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fab4a-ec63-48c0-bf2c-0a1c5668972f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-884c8b8b-35e4-47cc-b227-e646d013427f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:40.392520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:40.393651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:40.394466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:40.394466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:40.394466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:40.394466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 254/504] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:40.394466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c8b8b-35e4-47cc-b227-e646d013427f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:40.399450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fb3fab4a-ec63-48c0-bf2c-0a1c5668972f None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:40.400646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fb3fab4a-ec63-48c0-bf2c-0a1c5668972f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:40.416963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:40.470300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 251/505] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:40.471154 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fab4a-ec63-48c0-bf2c-0a1c5668972f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:40.501773 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c8b8b-35e4-47cc-b227-e646d013427f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:40.528891 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:40.539347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41adde-da1d-4396-b53e-60159632aeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:40.540254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41adde-da1d-4396-b53e-60159632aeca None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:40.540676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41adde-da1d-4396-b53e-60159632aeca None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:40.541209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41adde-da1d-4396-b53e-60159632aeca None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:40.542762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41adde-da1d-4396-b53e-60159632aeca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:40.543212 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41adde-da1d-4396-b53e-60159632aeca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:40.544723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41adde-da1d-4396-b53e-60159632aeca None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:40.559317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 255/506] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:40.560614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41adde-da1d-4396-b53e-60159632aeca None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:40.571477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fab4a-ec63-48c0-bf2c-0a1c5668972f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:40.607684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ec3a8-7ff8-457b-b8a0-c2c8ae3ccb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:40.608389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ec3a8-7ff8-457b-b8a0-c2c8ae3ccb5f None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:40.608659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ec3a8-7ff8-457b-b8a0-c2c8ae3ccb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:40.609083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ec3a8-7ff8-457b-b8a0-c2c8ae3ccb5f None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:40.609552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ec3a8-7ff8-457b-b8a0-c2c8ae3ccb5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:40.611006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ec3a8-7ff8-457b-b8a0-c2c8ae3ccb5f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:40.643228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 252/507] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:40:40 2022] POST /identity/v3/users => generated 247 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:40:40.645140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ec3a8-7ff8-457b-b8a0-c2c8ae3ccb5f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:40.659888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:40.674300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41adde-da1d-4396-b53e-60159632aeca None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:40.712053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f15cac-f3c9-4e16-86ac-869e9f4c81a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:40.712693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f15cac-f3c9-4e16-86ac-869e9f4c81a8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:40.712969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f15cac-f3c9-4e16-86ac-869e9f4c81a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:40.713236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f15cac-f3c9-4e16-86ac-869e9f4c81a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:40.725411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f15cac-f3c9-4e16-86ac-869e9f4c81a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:40.726927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f15cac-f3c9-4e16-86ac-869e9f4c81a8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-88f15cac-f3c9-4e16-86ac-869e9f4c81a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:40.743181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:40.744149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:40.744984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:40.744984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:40.744984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:40.744984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 256/508] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:40.745197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f15cac-f3c9-4e16-86ac-869e9f4c81a8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:40.767766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ec3a8-7ff8-457b-b8a0-c2c8ae3ccb5f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:40.794286 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:40.804772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd7d71-af38-462c-bf3f-057e9f7e5506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:40.805390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd7d71-af38-462c-bf3f-057e9f7e5506 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:40.805655 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd7d71-af38-462c-bf3f-057e9f7e5506 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:40.805926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd7d71-af38-462c-bf3f-057e9f7e5506 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:40.806566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd7d71-af38-462c-bf3f-057e9f7e5506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:40.806892 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd7d71-af38-462c-bf3f-057e9f7e5506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:40.808287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd7d71-af38-462c-bf3f-057e9f7e5506 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:40.820369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 253/509] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:40.821203 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd7d71-af38-462c-bf3f-057e9f7e5506 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:40.862829 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f15cac-f3c9-4e16-86ac-869e9f4c81a8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:40.898229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ad5f2-09e1-43d7-87e4-775b8de534db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:40.900625 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad5f2-09e1-43d7-87e4-775b8de534db None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:40.900625 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad5f2-09e1-43d7-87e4-775b8de534db None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:40.900625 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad5f2-09e1-43d7-87e4-775b8de534db None admin] PATH_INFO: `/v3/users/glance` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:40.906380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:40.907269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ad5f2-09e1-43d7-87e4-775b8de534db None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:40.908639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ad5f2-09e1-43d7-87e4-775b8de534db None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-9e5ad5f2-09e1-43d7-87e4-775b8de534db None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:40.923232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:40.924170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:40.925084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:40.925084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:40.925084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:40.925084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:40.925084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:40.925084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:40.925084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:40.925084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:40.925084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:40:40.925084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:40.925084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 257/510] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:40.925084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ad5f2-09e1-43d7-87e4-775b8de534db None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:40.949062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd7d71-af38-462c-bf3f-057e9f7e5506 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:40.985424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6e2b4-8071-41dc-9ff5-67ac9cbd4956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:40.986309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6e2b4-8071-41dc-9ff5-67ac9cbd4956 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:40.986589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6e2b4-8071-41dc-9ff5-67ac9cbd4956 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:40.986883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6e2b4-8071-41dc-9ff5-67ac9cbd4956 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:40.997744 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6e2b4-8071-41dc-9ff5-67ac9cbd4956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-87f6e2b4-8071-41dc-9ff5-67ac9cbd4956 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:41.002772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:41.003659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:41.004446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:41.004446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:41.004446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:41.004446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:41.004446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:41.004446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:41.004446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:41.004446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:41.004446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:41.004446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:41.004446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:41.004446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:41.004446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 254/511] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:41.005094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6e2b4-8071-41dc-9ff5-67ac9cbd4956 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:41.037678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:41.041380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ad5f2-09e1-43d7-87e4-775b8de534db None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:41.081852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d15da-54b7-4b9a-93ff-a022ca1dc169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:41.082451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d15da-54b7-4b9a-93ff-a022ca1dc169 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:41.082757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d15da-54b7-4b9a-93ff-a022ca1dc169 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:41.083022 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d15da-54b7-4b9a-93ff-a022ca1dc169 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:41.083658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d15da-54b7-4b9a-93ff-a022ca1dc169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:41.083958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d15da-54b7-4b9a-93ff-a022ca1dc169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:41.085323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d15da-54b7-4b9a-93ff-a022ca1dc169 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:41.102311 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 258/512] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:41.102311 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d15da-54b7-4b9a-93ff-a022ca1dc169 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:41.126459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6e2b4-8071-41dc-9ff5-67ac9cbd4956 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:41.155944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:41.165112 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77992f7b-892c-4fe5-8675-4776546755d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:41.165744 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77992f7b-892c-4fe5-8675-4776546755d1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:41.166015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77992f7b-892c-4fe5-8675-4776546755d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:41.166284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77992f7b-892c-4fe5-8675-4776546755d1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:41.174817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77992f7b-892c-4fe5-8675-4776546755d1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:41.176294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77992f7b-892c-4fe5-8675-4776546755d1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-77992f7b-892c-4fe5-8675-4776546755d1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:41.189093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:41.189994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:41.191345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:41.191345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:41.191345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:41.191345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:41.191345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:41.191345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:41.191345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:41.191345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:41.191345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:40:41.191345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:41.194880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 255/513] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:41.195458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77992f7b-892c-4fe5-8675-4776546755d1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:41.211860 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d15da-54b7-4b9a-93ff-a022ca1dc169 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:41.247085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7290f4d-2b6c-4a1f-978f-02cfd14910e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:41.248240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7290f4d-2b6c-4a1f-978f-02cfd14910e0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:41.249207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7290f4d-2b6c-4a1f-978f-02cfd14910e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:41.249675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7290f4d-2b6c-4a1f-978f-02cfd14910e0 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:41.250691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7290f4d-2b6c-4a1f-978f-02cfd14910e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:41.251603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7290f4d-2b6c-4a1f-978f-02cfd14910e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:41.253193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7290f4d-2b6c-4a1f-978f-02cfd14910e0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:41.289481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 259/514] 10.222.0.33 () {56 vars in 1137 bytes} [Sun Sep 11 00:40:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:41.290690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7290f4d-2b6c-4a1f-978f-02cfd14910e0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:41.304615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77992f7b-892c-4fe5-8675-4776546755d1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:41.310108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:41.340279 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06e98-38d6-448d-937d-94ee3b6165af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:41.340880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06e98-38d6-448d-937d-94ee3b6165af None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:41.341166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06e98-38d6-448d-937d-94ee3b6165af None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:41.341416 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06e98-38d6-448d-937d-94ee3b6165af None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:41.342071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab06e98-38d6-448d-937d-94ee3b6165af None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:41.342386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab06e98-38d6-448d-937d-94ee3b6165af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:41.344563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab06e98-38d6-448d-937d-94ee3b6165af None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:41.359531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 256/515] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:41.359531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06e98-38d6-448d-937d-94ee3b6165af None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:41.405387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7290f4d-2b6c-4a1f-978f-02cfd14910e0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:41.417701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:41.452808 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428557bc-e89a-4edb-9bd0-710e6cda6f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:41.453709 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428557bc-e89a-4edb-9bd0-710e6cda6f28 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:41.453984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428557bc-e89a-4edb-9bd0-710e6cda6f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:41.454261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428557bc-e89a-4edb-9bd0-710e6cda6f28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:41.461447 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428557bc-e89a-4edb-9bd0-710e6cda6f28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:41.462925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428557bc-e89a-4edb-9bd0-710e6cda6f28 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-428557bc-e89a-4edb-9bd0-710e6cda6f28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:41.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:41.475916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:41.476793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:41.476793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:41.476793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:41.476793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:41.476793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:41.476793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:41.476793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:41.476793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:41.477215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06e98-38d6-448d-937d-94ee3b6165af None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:41.480902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 260/516] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:41.481672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428557bc-e89a-4edb-9bd0-710e6cda6f28 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:41.515307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1f17f-e141-4050-a006-b82b5c33ac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:41.515979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1f17f-e141-4050-a006-b82b5c33ac75 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:41.516259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1f17f-e141-4050-a006-b82b5c33ac75 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:41.516530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1f17f-e141-4050-a006-b82b5c33ac75 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:41.517253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1f17f-e141-4050-a006-b82b5c33ac75 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:41.517563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1f17f-e141-4050-a006-b82b5c33ac75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:41.519022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1f17f-e141-4050-a006-b82b5c33ac75 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:41.536381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 257/517] 10.222.0.33 () {56 vars in 1137 bytes} [Sun Sep 11 00:40:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:41.537067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1f17f-e141-4050-a006-b82b5c33ac75 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:41.568148 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:41.595543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428557bc-e89a-4edb-9bd0-710e6cda6f28 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:41.633108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58b953-2a65-48ca-a94a-6292546b120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:41.633867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b953-2a65-48ca-a94a-6292546b120f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:41.634146 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b953-2a65-48ca-a94a-6292546b120f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:41.634414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b953-2a65-48ca-a94a-6292546b120f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:41.642327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1f17f-e141-4050-a006-b82b5c33ac75 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:41.652135 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:41.678900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffac3e0-8b16-4492-b3bb-dc3822047db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:41.679490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac3e0-8b16-4492-b3bb-dc3822047db8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:41.679771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac3e0-8b16-4492-b3bb-dc3822047db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:41.680041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac3e0-8b16-4492-b3bb-dc3822047db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:41.692461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffac3e0-8b16-4492-b3bb-dc3822047db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:41.694857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffac3e0-8b16-4492-b3bb-dc3822047db8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:41.707239 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58b953-2a65-48ca-a94a-6292546b120f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:41.708668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58b953-2a65-48ca-a94a-6292546b120f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-dffac3e0-8b16-4492-b3bb-dc3822047db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:41.711193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:41.712242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:41.718882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:41.718882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:41.718882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:41.718882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 258/518] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:41.718882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffac3e0-8b16-4492-b3bb-dc3822047db8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:41.802229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:41.828303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 261/519] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:41.828936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58b953-2a65-48ca-a94a-6292546b120f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:41.834059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffac3e0-8b16-4492-b3bb-dc3822047db8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:41.870057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dfee6-3255-42a0-a86d-572d5aca7812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:41.870658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dfee6-3255-42a0-a86d-572d5aca7812 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:41.870976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dfee6-3255-42a0-a86d-572d5aca7812 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:41.871241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dfee6-3255-42a0-a86d-572d5aca7812 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:41.871925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704dfee6-3255-42a0-a86d-572d5aca7812 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:41.872221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704dfee6-3255-42a0-a86d-572d5aca7812 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:41.873651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704dfee6-3255-42a0-a86d-572d5aca7812 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:41.893181 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 259/520] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:41.894003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dfee6-3255-42a0-a86d-572d5aca7812 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:41.917186 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:41.946065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58b953-2a65-48ca-a94a-6292546b120f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:41.983723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c41b64-51ec-4d65-b9bd-a24f0c2c88a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:41.984330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c41b64-51ec-4d65-b9bd-a24f0c2c88a7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:41.984609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c41b64-51ec-4d65-b9bd-a24f0c2c88a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:41.984879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c41b64-51ec-4d65-b9bd-a24f0c2c88a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:42.003813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dfee6-3255-42a0-a86d-572d5aca7812 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:42.034429 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:42.042401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a37db8-d911-4778-93a1-820e001d8da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:42.043104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a37db8-d911-4778-93a1-820e001d8da1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:42.043301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a37db8-d911-4778-93a1-820e001d8da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:42.043562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a37db8-d911-4778-93a1-820e001d8da1 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:42.044193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a37db8-d911-4778-93a1-820e001d8da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:42.044490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a37db8-d911-4778-93a1-820e001d8da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:42.045884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a37db8-d911-4778-93a1-820e001d8da1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:42.058240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c41b64-51ec-4d65-b9bd-a24f0c2c88a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:42.059061 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 260/521] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:42.059871 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a37db8-d911-4778-93a1-820e001d8da1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:42.060680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c41b64-51ec-4d65-b9bd-a24f0c2c88a7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:42.146580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:42.166971 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a37db8-d911-4778-93a1-820e001d8da1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:42.168895 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 262/522] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:42.174355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c41b64-51ec-4d65-b9bd-a24f0c2c88a7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:42.201526 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26536e1-ff0a-4f5a-a720-eeeafad60793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:42.202131 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26536e1-ff0a-4f5a-a720-eeeafad60793 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:42.202403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26536e1-ff0a-4f5a-a720-eeeafad60793 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:42.202674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26536e1-ff0a-4f5a-a720-eeeafad60793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:42.213260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26536e1-ff0a-4f5a-a720-eeeafad60793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:42.214700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26536e1-ff0a-4f5a-a720-eeeafad60793 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c26536e1-ff0a-4f5a-a720-eeeafad60793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:42.229653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:42.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:42.231579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:42.231579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:42.231579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:42.231579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 261/523] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:42.231579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26536e1-ff0a-4f5a-a720-eeeafad60793 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:42.260377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:42.283901 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c41b64-51ec-4d65-b9bd-a24f0c2c88a7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:42.318400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643268ad-ee64-4f84-86de-42092f16c786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:42.319274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643268ad-ee64-4f84-86de-42092f16c786 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:42.319554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643268ad-ee64-4f84-86de-42092f16c786 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:42.319823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643268ad-ee64-4f84-86de-42092f16c786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:42.320535 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643268ad-ee64-4f84-86de-42092f16c786 None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=ab5f197fb09e422997434a1b2feb4567) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:42.320834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643268ad-ee64-4f84-86de-42092f16c786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:42.322245 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643268ad-ee64-4f84-86de-42092f16c786 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:42.334761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 263/524] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:42 2022] GET /identity/v3/role_assignments?user.id=ab5f197fb09e422997434a1b2feb4567&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:42.334761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643268ad-ee64-4f84-86de-42092f16c786 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:42.345276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26536e1-ff0a-4f5a-a720-eeeafad60793 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:42.381365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:42.389390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde7abe-4705-485d-a4cb-f0da1ad35832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:42.391194 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde7abe-4705-485d-a4cb-f0da1ad35832 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:42.391527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde7abe-4705-485d-a4cb-f0da1ad35832 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:42.391791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde7abe-4705-485d-a4cb-f0da1ad35832 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:42.403775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde7abe-4705-485d-a4cb-f0da1ad35832 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:42.406652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde7abe-4705-485d-a4cb-f0da1ad35832 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8dde7abe-4705-485d-a4cb-f0da1ad35832 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:42.422258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:42.423243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:42.424216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:42.424216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:42.424216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:42.424216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:42.424216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:42.424216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:42.424216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:42.424216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:42.424216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:40:42.424216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:42.424216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 262/525] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:42.424216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde7abe-4705-485d-a4cb-f0da1ad35832 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:42.480205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643268ad-ee64-4f84-86de-42092f16c786 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:42.528001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0384756-90ee-4ca8-a964-ecd3d42141b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:42.529461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0384756-90ee-4ca8-a964-ecd3d42141b6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:42.529936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0384756-90ee-4ca8-a964-ecd3d42141b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:42.530451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0384756-90ee-4ca8-a964-ecd3d42141b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:42.546272 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0384756-90ee-4ca8-a964-ecd3d42141b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:42.548099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0384756-90ee-4ca8-a964-ecd3d42141b6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:42.550243 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a0384756-90ee-4ca8-a964-ecd3d42141b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:42.565915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:42.566911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:42.567759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:42.567759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:42.567759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:42.567759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 264/526] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:42.568469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0384756-90ee-4ca8-a964-ecd3d42141b6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:42.570328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde7abe-4705-485d-a4cb-f0da1ad35832 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:42.616612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844916d-0219-441f-a1c9-6ddea515213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:42.617245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844916d-0219-441f-a1c9-6ddea515213e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:42.617751 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844916d-0219-441f-a1c9-6ddea515213e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:42.617857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844916d-0219-441f-a1c9-6ddea515213e None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:42.618407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844916d-0219-441f-a1c9-6ddea515213e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:42.618705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844916d-0219-441f-a1c9-6ddea515213e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:42.620178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844916d-0219-441f-a1c9-6ddea515213e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:42.634111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 263/527] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:42.635114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844916d-0219-441f-a1c9-6ddea515213e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:42.690588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0384756-90ee-4ca8-a964-ecd3d42141b6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:42.691476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:42.740737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8431f-113c-47ca-ab74-e520bacee5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:42.742412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8431f-113c-47ca-ab74-e520bacee5ca None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:42.742936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8431f-113c-47ca-ab74-e520bacee5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:42.743424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8431f-113c-47ca-ab74-e520bacee5ca None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:42.744144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844916d-0219-441f-a1c9-6ddea515213e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:42.744616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8431f-113c-47ca-ab74-e520bacee5ca None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:42.745119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8431f-113c-47ca-ab74-e520bacee5ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:42.748248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8431f-113c-47ca-ab74-e520bacee5ca None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:42.780666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 265/528] 10.222.0.33 () {56 vars in 1139 bytes} [Sun Sep 11 00:40:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:42.780666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8431f-113c-47ca-ab74-e520bacee5ca None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:42.794798 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e89b40-04ab-477c-9958-240a262e7a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:42.796224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e89b40-04ab-477c-9958-240a262e7a42 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:42.796996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e89b40-04ab-477c-9958-240a262e7a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:42.797461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e89b40-04ab-477c-9958-240a262e7a42 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:42.798550 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e89b40-04ab-477c-9958-240a262e7a42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:42.799566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e89b40-04ab-477c-9958-240a262e7a42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:42.801687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e89b40-04ab-477c-9958-240a262e7a42 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:42.818773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 264/529] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:42.820874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e89b40-04ab-477c-9958-240a262e7a42 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:42.839543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:42.890533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8431f-113c-47ca-ab74-e520bacee5ca None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:42.931338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55410caa-402c-476d-9a11-ee2b7ad234f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:42.931953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55410caa-402c-476d-9a11-ee2b7ad234f7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:42.932250 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55410caa-402c-476d-9a11-ee2b7ad234f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:42.932524 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55410caa-402c-476d-9a11-ee2b7ad234f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:42.939253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e89b40-04ab-477c-9958-240a262e7a42 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:42.940869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55410caa-402c-476d-9a11-ee2b7ad234f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:42.942301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55410caa-402c-476d-9a11-ee2b7ad234f7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:42.952860 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-55410caa-402c-476d-9a11-ee2b7ad234f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:42.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:42.954480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:42.955542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:42.955542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:42.955542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:42.955542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:42.955542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:42.955542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:42.955542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:42.955542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:42.955542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 266/530] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:42.955542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55410caa-402c-476d-9a11-ee2b7ad234f7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:42.982047 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f362fea-328f-4f2f-a42a-94c3974f3470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:42.983101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f362fea-328f-4f2f-a42a-94c3974f3470 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:42.983894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f362fea-328f-4f2f-a42a-94c3974f3470 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:42.984584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f362fea-328f-4f2f-a42a-94c3974f3470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:43.060478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f362fea-328f-4f2f-a42a-94c3974f3470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:43.062343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55410caa-402c-476d-9a11-ee2b7ad234f7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:43.062796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f362fea-328f-4f2f-a42a-94c3974f3470 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:43.076222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:43.099910 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8b4e5-9e7b-45fd-b661-66105c3744aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:43.100529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8b4e5-9e7b-45fd-b661-66105c3744aa None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:43.100802 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8b4e5-9e7b-45fd-b661-66105c3744aa None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:43.101068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8b4e5-9e7b-45fd-b661-66105c3744aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:43.108404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8b4e5-9e7b-45fd-b661-66105c3744aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:43.109869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8b4e5-9e7b-45fd-b661-66105c3744aa None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-20b8b4e5-9e7b-45fd-b661-66105c3744aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:43.120982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:43.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:43.122662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:43.122662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:43.122662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:43.122662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:43.122662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:43.122662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:43.122662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:43.122662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:43.122662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 267/531] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:43.123628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acca15-766a-4e52-977c-888219cbfbd5 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:43.123628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acca15-766a-4e52-977c-888219cbfbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:43.123776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acca15-766a-4e52-977c-888219cbfbd5 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:43.129078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 268/532] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:43.129078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acca15-766a-4e52-977c-888219cbfbd5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:43.177072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 265/533] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:43.177921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f362fea-328f-4f2f-a42a-94c3974f3470 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:43.193157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:43.241877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acca15-766a-4e52-977c-888219cbfbd5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:43.279749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb1a2d-92c9-4b2e-a488-36855d85ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:43.280583 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb1a2d-92c9-4b2e-a488-36855d85ca13 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:43.280865 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb1a2d-92c9-4b2e-a488-36855d85ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:43.281136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb1a2d-92c9-4b2e-a488-36855d85ca13 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:43.281990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb1a2d-92c9-4b2e-a488-36855d85ca13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:43.282599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb1a2d-92c9-4b2e-a488-36855d85ca13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:43.284323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb1a2d-92c9-4b2e-a488-36855d85ca13 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:43.284804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f362fea-328f-4f2f-a42a-94c3974f3470 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:43.302441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 269/534] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:43.303736 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678617-8e9c-4b2d-af00-88ac5af54b98 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:43.304018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678617-8e9c-4b2d-af00-88ac5af54b98 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:43.304295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678617-8e9c-4b2d-af00-88ac5af54b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:43.322202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-44678617-8e9c-4b2d-af00-88ac5af54b98 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:43.322362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88df03-efa8-4cab-8c60-bbd85d3bbe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:43.322833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88df03-efa8-4cab-8c60-bbd85d3bbe50 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:43.323106 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88df03-efa8-4cab-8c60-bbd85d3bbe50 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:43.323353 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-44678617-8e9c-4b2d-af00-88ac5af54b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:43.323451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88df03-efa8-4cab-8c60-bbd85d3bbe50 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:43.324035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88df03-efa8-4cab-8c60-bbd85d3bbe50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:43.324334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88df03-efa8-4cab-8c60-bbd85d3bbe50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:43.325748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88df03-efa8-4cab-8c60-bbd85d3bbe50 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:43.338971 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 266/535] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:43.339595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88df03-efa8-4cab-8c60-bbd85d3bbe50 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:43.356781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:43.410762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 270/536] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:43.410762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678617-8e9c-4b2d-af00-88ac5af54b98 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:43.426244 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:43.461641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88df03-efa8-4cab-8c60-bbd85d3bbe50 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:43.500881 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf0431-23f6-47f4-9f25-d5186bb76c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:43.502058 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf0431-23f6-47f4-9f25-d5186bb76c77 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:43.502452 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf0431-23f6-47f4-9f25-d5186bb76c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:43.503119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf0431-23f6-47f4-9f25-d5186bb76c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:43.519741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678617-8e9c-4b2d-af00-88ac5af54b98 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:43.520128 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf0431-23f6-47f4-9f25-d5186bb76c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:43.521938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf0431-23f6-47f4-9f25-d5186bb76c77 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-61bf0431-23f6-47f4-9f25-d5186bb76c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:43.541711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:43.542803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:43.543664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:43.543664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:43.543664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:43.543963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 267/537] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:43.544975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf0431-23f6-47f4-9f25-d5186bb76c77 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:43.568532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ccc5d-2f0b-41a2-bcfb-364d4c927559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:43.569875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ccc5d-2f0b-41a2-bcfb-364d4c927559 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:43.570221 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ccc5d-2f0b-41a2-bcfb-364d4c927559 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:43.570558 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ccc5d-2f0b-41a2-bcfb-364d4c927559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:43.571708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ccc5d-2f0b-41a2-bcfb-364d4c927559 None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=f0dfdb9054ac4fef97d8e30aa5a8bd66) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:43.572003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ccc5d-2f0b-41a2-bcfb-364d4c927559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:43.573572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ccc5d-2f0b-41a2-bcfb-364d4c927559 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:43.581005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 271/538] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:43 2022] GET /identity/v3/role_assignments?user.id=f0dfdb9054ac4fef97d8e30aa5a8bd66&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:43.581620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ccc5d-2f0b-41a2-bcfb-364d4c927559 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:43.616229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:43.657319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf0431-23f6-47f4-9f25-d5186bb76c77 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:43.687719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:43.722698 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126d295-1a5c-4b0e-8d15-b85d335c2554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:43.724269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126d295-1a5c-4b0e-8d15-b85d335c2554 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:43.725047 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126d295-1a5c-4b0e-8d15-b85d335c2554 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:43.725651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126d295-1a5c-4b0e-8d15-b85d335c2554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:43.726986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126d295-1a5c-4b0e-8d15-b85d335c2554 None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=7ecc9e16475344b78bb885437b5d6bec) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:43.728319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126d295-1a5c-4b0e-8d15-b85d335c2554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:43.730657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126d295-1a5c-4b0e-8d15-b85d335c2554 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:43.736980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ccc5d-2f0b-41a2-bcfb-364d4c927559 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:43.752913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 268/539] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:43 2022] GET /identity/v3/role_assignments?user.id=7ecc9e16475344b78bb885437b5d6bec&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:43.781465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126d295-1a5c-4b0e-8d15-b85d335c2554 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:43.803988 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b707ee-68d9-4500-834f-b1ecd035665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:43.805005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b707ee-68d9-4500-834f-b1ecd035665a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:43.805513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b707ee-68d9-4500-834f-b1ecd035665a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:43.805985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b707ee-68d9-4500-834f-b1ecd035665a None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:43.806925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b707ee-68d9-4500-834f-b1ecd035665a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:43.807459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b707ee-68d9-4500-834f-b1ecd035665a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:43.809036 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b707ee-68d9-4500-834f-b1ecd035665a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:43.827544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 272/540] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:43.833061 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b707ee-68d9-4500-834f-b1ecd035665a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:43.917136 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126d295-1a5c-4b0e-8d15-b85d335c2554 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:43.926851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:43.943072 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b707ee-68d9-4500-834f-b1ecd035665a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:43.994453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c8738-0895-47fc-a701-8137987d35b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:43.995117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c8738-0895-47fc-a701-8137987d35b1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:43.995396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c8738-0895-47fc-a701-8137987d35b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:43.995661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c8738-0895-47fc-a701-8137987d35b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:44.013154 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c8738-0895-47fc-a701-8137987d35b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-543c8738-0895-47fc-a701-8137987d35b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:44.018510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:44.019530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:44.020657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:44.020657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:44.020657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:44.020657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:44.020657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:44.020657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:44.020657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:44.020657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:44.020657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:44.020657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:44.020657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:44.020657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:44.020657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 269/541] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:44.021314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fcd7a-9021-4991-8981-2d849038def3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:44.021694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fcd7a-9021-4991-8981-2d849038def3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:44.021787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fcd7a-9021-4991-8981-2d849038def3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:44.022002 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fcd7a-9021-4991-8981-2d849038def3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:44.030191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c8738-0895-47fc-a701-8137987d35b1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:44.036925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fcd7a-9021-4991-8981-2d849038def3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:44.038376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fcd7a-9021-4991-8981-2d849038def3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-fd9fcd7a-9021-4991-8981-2d849038def3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:44.059149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:44.060525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:44.063704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:44.063704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:44.063704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:44.063704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:44.063704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:44.063704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:44.063704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:44.063704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:44.063704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 273/542] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:44.072047 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fcd7a-9021-4991-8981-2d849038def3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:44.143287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:44.225345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c8738-0895-47fc-a701-8137987d35b1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:44.236434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fcd7a-9021-4991-8981-2d849038def3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:44.288975 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d618-a482-438c-924a-3cc31e10abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:44.289580 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d618-a482-438c-924a-3cc31e10abf7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:44.289859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d618-a482-438c-924a-3cc31e10abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:44.290128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d618-a482-438c-924a-3cc31e10abf7 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:44.290850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516d618-a482-438c-924a-3cc31e10abf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:44.291156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516d618-a482-438c-924a-3cc31e10abf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:44.293238 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516d618-a482-438c-924a-3cc31e10abf7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:44.297103 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2138ed-e62a-437c-a90f-d40b245e0a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:44.297707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2138ed-e62a-437c-a90f-d40b245e0a15 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:44.297979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2138ed-e62a-437c-a90f-d40b245e0a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:44.298243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2138ed-e62a-437c-a90f-d40b245e0a15 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:44.298916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2138ed-e62a-437c-a90f-d40b245e0a15 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:44.299212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2138ed-e62a-437c-a90f-d40b245e0a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:44.300558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2138ed-e62a-437c-a90f-d40b245e0a15 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:44.315603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 270/543] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:44.318602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 274/544] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:44.321038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2138ed-e62a-437c-a90f-d40b245e0a15 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:44.324699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d618-a482-438c-924a-3cc31e10abf7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:44.338653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:44.472603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d618-a482-438c-924a-3cc31e10abf7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:44.515095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37207166-f300-42e4-8152-ba05e4c18012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:44.516138 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37207166-f300-42e4-8152-ba05e4c18012 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:44.516644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37207166-f300-42e4-8152-ba05e4c18012 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:44.517119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37207166-f300-42e4-8152-ba05e4c18012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:44.518104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37207166-f300-42e4-8152-ba05e4c18012 None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=c45d8e2b0b674e9a814167db4d78749e) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:44.518650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37207166-f300-42e4-8152-ba05e4c18012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:44.520527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37207166-f300-42e4-8152-ba05e4c18012 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:44.527601 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 275/545] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:44 2022] GET /identity/v3/role_assignments?user.id=c45d8e2b0b674e9a814167db4d78749e&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:44.545194 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2138ed-e62a-437c-a90f-d40b245e0a15 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:44.557491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:44.584589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b894d-2721-466a-9386-96876fba0e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:44.585241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b894d-2721-466a-9386-96876fba0e5b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:44.585516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b894d-2721-466a-9386-96876fba0e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:44.585784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b894d-2721-466a-9386-96876fba0e5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:44.598441 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b894d-2721-466a-9386-96876fba0e5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:44.600028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b894d-2721-466a-9386-96876fba0e5b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f70b894d-2721-466a-9386-96876fba0e5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:44.617494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:44.618466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:44.619548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:44.619548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:44.619548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:44.619548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 271/546] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:44.624894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37207166-f300-42e4-8152-ba05e4c18012 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:44.653200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97238c-388a-468e-95f9-cbe93c01b4e8 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:44.653534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97238c-388a-468e-95f9-cbe93c01b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:44.653747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97238c-388a-468e-95f9-cbe93c01b4e8 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:44.655566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 272/547] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:44.662759 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabc805-d6b1-41da-ae79-7d13e9106239 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:44.662759 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabc805-d6b1-41da-ae79-7d13e9106239 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:44.662759 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabc805-d6b1-41da-ae79-7d13e9106239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:44.700223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7dabc805-d6b1-41da-ae79-7d13e9106239 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:44.701549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7dabc805-d6b1-41da-ae79-7d13e9106239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:44.729116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:44.757303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37207166-f300-42e4-8152-ba05e4c18012 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:44.794106 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef1412-b57d-4abc-9204-e8a93868f1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:44.794713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef1412-b57d-4abc-9204-e8a93868f1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:44.795009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef1412-b57d-4abc-9204-e8a93868f1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:44.795276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef1412-b57d-4abc-9204-e8a93868f1b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:44.796624 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef1412-b57d-4abc-9204-e8a93868f1b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:44.796929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef1412-b57d-4abc-9204-e8a93868f1b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:44.798299 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef1412-b57d-4abc-9204-e8a93868f1b8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:44.811587 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 276/548] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:44.824108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef1412-b57d-4abc-9204-e8a93868f1b8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:44.851647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 273/549] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:44.981655 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef1412-b57d-4abc-9204-e8a93868f1b8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:45.018419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:45.027368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede97a44-6426-4cdd-9a0a-c88872a40a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:45.027997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede97a44-6426-4cdd-9a0a-c88872a40a03 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:45.028279 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede97a44-6426-4cdd-9a0a-c88872a40a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:45.028550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede97a44-6426-4cdd-9a0a-c88872a40a03 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:45.036533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede97a44-6426-4cdd-9a0a-c88872a40a03 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:45.038023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede97a44-6426-4cdd-9a0a-c88872a40a03 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-ede97a44-6426-4cdd-9a0a-c88872a40a03 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:45.051844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:45.053266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:45.054340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:45.054340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:45.054340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:45.054340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:45.054340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:45.054340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:45.054340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:45.054340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:45.054340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:40:45.054340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:45.054340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 277/550] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:40:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:45.061023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabc805-d6b1-41da-ae79-7d13e9106239 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:45.180725 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:45.194695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabc805-d6b1-41da-ae79-7d13e9106239 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:45.235816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3488a-1275-4b38-8da4-7de945dfe80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:45.236514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3488a-1275-4b38-8da4-7de945dfe80f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:45.236707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3488a-1275-4b38-8da4-7de945dfe80f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:45.236913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3488a-1275-4b38-8da4-7de945dfe80f None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:45.237637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3488a-1275-4b38-8da4-7de945dfe80f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:45.237938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3488a-1275-4b38-8da4-7de945dfe80f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:45.239388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3488a-1275-4b38-8da4-7de945dfe80f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:45.263386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 274/551] 10.222.0.33 () {56 vars in 1135 bytes} [Sun Sep 11 00:40:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:45.269167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede97a44-6426-4cdd-9a0a-c88872a40a03 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:45.389795 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede97a44-6426-4cdd-9a0a-c88872a40a03 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:45.427504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc234c90-e7b0-49e6-a3a2-6bfbc656c94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:45.427504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc234c90-e7b0-49e6-a3a2-6bfbc656c94d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:45.427504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc234c90-e7b0-49e6-a3a2-6bfbc656c94d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:45.427504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc234c90-e7b0-49e6-a3a2-6bfbc656c94d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:45.460324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3488a-1275-4b38-8da4-7de945dfe80f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:45.509265 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:45.531510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc234c90-e7b0-49e6-a3a2-6bfbc656c94d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:45.532964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc234c90-e7b0-49e6-a3a2-6bfbc656c94d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:45.602744 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3488a-1275-4b38-8da4-7de945dfe80f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:45.642142 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ebc5c-898a-4d7a-aa4f-dd7897043273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:45.643309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ebc5c-898a-4d7a-aa4f-dd7897043273 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:45.643891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ebc5c-898a-4d7a-aa4f-dd7897043273 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:45.644463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ebc5c-898a-4d7a-aa4f-dd7897043273 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:45.656273 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ebc5c-898a-4d7a-aa4f-dd7897043273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-624ebc5c-898a-4d7a-aa4f-dd7897043273 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:45.661535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:45.662558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:45.663419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:45.663419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:45.663419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:45.663419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:45.663419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:45.663419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:45.663419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:45.663419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:45.663419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:45.663419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:45.663419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:45.663419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:45.666086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 275/552] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:45.672567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ebc5c-898a-4d7a-aa4f-dd7897043273 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:45.711180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:45.785996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ebc5c-898a-4d7a-aa4f-dd7897043273 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:45.824574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1d2f4-97ea-48ce-9087-3fed455545f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:45.825548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1d2f4-97ea-48ce-9087-3fed455545f9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:45.826035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1d2f4-97ea-48ce-9087-3fed455545f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:45.826538 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1d2f4-97ea-48ce-9087-3fed455545f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:45.828107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1d2f4-97ea-48ce-9087-3fed455545f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:45.828612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1d2f4-97ea-48ce-9087-3fed455545f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:45.830211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1d2f4-97ea-48ce-9087-3fed455545f9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:45.837565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 278/553] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:45.839314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 276/554] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:45.842895 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc234c90-e7b0-49e6-a3a2-6bfbc656c94d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:45.846107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1d2f4-97ea-48ce-9087-3fed455545f9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:45.938978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:46.002655 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1d2f4-97ea-48ce-9087-3fed455545f9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:46.007064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:46.023323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc234c90-e7b0-49e6-a3a2-6bfbc656c94d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:46.080773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591157cd-7b1f-4ada-8f36-7fbffae70605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:46.081332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591157cd-7b1f-4ada-8f36-7fbffae70605 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:46.081600 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591157cd-7b1f-4ada-8f36-7fbffae70605 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:46.081867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591157cd-7b1f-4ada-8f36-7fbffae70605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:46.085686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9218dec-dc6b-4a04-8036-9cf231367eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:46.086326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9218dec-dc6b-4a04-8036-9cf231367eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:46.086597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9218dec-dc6b-4a04-8036-9cf231367eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:46.086887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9218dec-dc6b-4a04-8036-9cf231367eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:46.101924 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9218dec-dc6b-4a04-8036-9cf231367eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:46.103424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9218dec-dc6b-4a04-8036-9cf231367eb6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:46.107883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591157cd-7b1f-4ada-8f36-7fbffae70605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:46.111860 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591157cd-7b1f-4ada-8f36-7fbffae70605 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d9218dec-dc6b-4a04-8036-9cf231367eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:46.128960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:46.129914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:46.130810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:46.130810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:46.130810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:46.130810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 279/555] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:46.137822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9218dec-dc6b-4a04-8036-9cf231367eb6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-591157cd-7b1f-4ada-8f36-7fbffae70605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:46.141752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:46.143567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:46.145707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:46.145707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:46.145707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:46.145707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 277/556] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:46.151725 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591157cd-7b1f-4ada-8f36-7fbffae70605 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:46.278775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591157cd-7b1f-4ada-8f36-7fbffae70605 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:46.284484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9218dec-dc6b-4a04-8036-9cf231367eb6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:46.316674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b16441-c307-45e5-9579-969a4699aa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:46.317867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b16441-c307-45e5-9579-969a4699aa20 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:46.318377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b16441-c307-45e5-9579-969a4699aa20 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:46.318888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b16441-c307-45e5-9579-969a4699aa20 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:46.319766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b16441-c307-45e5-9579-969a4699aa20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:46.320282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b16441-c307-45e5-9579-969a4699aa20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:46.322053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b16441-c307-45e5-9579-969a4699aa20 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:46.324072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:46.326396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dcfd0-71d9-4cc5-8b20-951efbbd9521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:46.327055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dcfd0-71d9-4cc5-8b20-951efbbd9521 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:46.327869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dcfd0-71d9-4cc5-8b20-951efbbd9521 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:46.328135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dcfd0-71d9-4cc5-8b20-951efbbd9521 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:46.328796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dcfd0-71d9-4cc5-8b20-951efbbd9521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:46.329096 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dcfd0-71d9-4cc5-8b20-951efbbd9521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:46.330538 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dcfd0-71d9-4cc5-8b20-951efbbd9521 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:46.344613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 278/557] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:46.345597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 280/558] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:46.346519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dcfd0-71d9-4cc5-8b20-951efbbd9521 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:46.346784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02387c54-fa87-44d2-9368-7b2df9afc11b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:46.347265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02387c54-fa87-44d2-9368-7b2df9afc11b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:46.347741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02387c54-fa87-44d2-9368-7b2df9afc11b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:46.349202 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 279/559] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:46.350285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02387c54-fa87-44d2-9368-7b2df9afc11b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:46.353621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:46.461201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02387c54-fa87-44d2-9368-7b2df9afc11b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:46.472710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dcfd0-71d9-4cc5-8b20-951efbbd9521 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:46.498866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae9cbf-3766-4b66-97f7-db9037b4adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:46.500337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae9cbf-3766-4b66-97f7-db9037b4adba None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:46.500885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae9cbf-3766-4b66-97f7-db9037b4adba None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:46.501451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae9cbf-3766-4b66-97f7-db9037b4adba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:46.505993 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468c6ce-fe96-41ca-b195-0dc5ae416b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:46.506642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468c6ce-fe96-41ca-b195-0dc5ae416b37 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:46.506950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468c6ce-fe96-41ca-b195-0dc5ae416b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:46.507221 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468c6ce-fe96-41ca-b195-0dc5ae416b37 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:46.508558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae9cbf-3766-4b66-97f7-db9037b4adba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:46.510931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae9cbf-3766-4b66-97f7-db9037b4adba None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:46.514576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468c6ce-fe96-41ca-b195-0dc5ae416b37 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:46.516047 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468c6ce-fe96-41ca-b195-0dc5ae416b37 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a0ae9cbf-3766-4b66-97f7-db9037b4adba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:46.524201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:46.525082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:46.531547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:46.531547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:46.531547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:46.531547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:46.531547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:46.531547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:46.531547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:46.531547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:46.531547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 280/560] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:46.531547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5958c3a-0103-45a9-94f7-82812bc8c5cf None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:46.531547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5958c3a-0103-45a9-94f7-82812bc8c5cf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:46.532168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5958c3a-0103-45a9-94f7-82812bc8c5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b468c6ce-fe96-41ca-b195-0dc5ae416b37 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:46.532249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:46.533160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:46.535359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:46.535359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:46.535359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:46.535359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:46.535359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:46.535359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:46.535359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:46.535359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:46.535359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:40:46.535359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:46.535359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 281/561] 10.222.0.33 () {56 vars in 1093 bytes} [Sun Sep 11 00:40:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:46.535359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a368f0-1004-4700-83ce-ff036ebb64a7 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:46.535359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a368f0-1004-4700-83ce-ff036ebb64a7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:46.536294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a368f0-1004-4700-83ce-ff036ebb64a7 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:46.536294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 282/562] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:46.536294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a368f0-1004-4700-83ce-ff036ebb64a7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:46.552983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f5958c3a-0103-45a9-94f7-82812bc8c5cf None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:46.554308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f5958c3a-0103-45a9-94f7-82812bc8c5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:46.598712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:46.600693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:46.628140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 281/563] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:46.629211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5958c3a-0103-45a9-94f7-82812bc8c5cf None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:46.652797 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a368f0-1004-4700-83ce-ff036ebb64a7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:46.693790 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d7fb9-9fff-4f6e-9bdf-2723dae08c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:46.694485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7fb9-9fff-4f6e-9bdf-2723dae08c2e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:46.694858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7fb9-9fff-4f6e-9bdf-2723dae08c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:46.695384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7fb9-9fff-4f6e-9bdf-2723dae08c2e None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:46.696235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d7fb9-9fff-4f6e-9bdf-2723dae08c2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:46.696601 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d7fb9-9fff-4f6e-9bdf-2723dae08c2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:46.698386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d7fb9-9fff-4f6e-9bdf-2723dae08c2e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:46.714874 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 283/564] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:46.716350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bf828-899c-48da-b05d-234db0797750 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:46.716845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bf828-899c-48da-b05d-234db0797750 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:46.717323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bf828-899c-48da-b05d-234db0797750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:46.738117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-705bf828-899c-48da-b05d-234db0797750 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:46.739508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-705bf828-899c-48da-b05d-234db0797750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:46.771207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5958c3a-0103-45a9-94f7-82812bc8c5cf None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:46.816222 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b95927-f90d-431b-9ffa-0b7a040eff0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:46.817193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b95927-f90d-431b-9ffa-0b7a040eff0a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:46.817678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b95927-f90d-431b-9ffa-0b7a040eff0a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:46.818233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b95927-f90d-431b-9ffa-0b7a040eff0a None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:46.819307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b95927-f90d-431b-9ffa-0b7a040eff0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:46.819829 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b95927-f90d-431b-9ffa-0b7a040eff0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:46.821544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b95927-f90d-431b-9ffa-0b7a040eff0a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:46.823168 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 284/565] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:46.824312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bf828-899c-48da-b05d-234db0797750 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:46.857284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 282/566] 10.222.0.33 () {56 vars in 1133 bytes} [Sun Sep 11 00:40:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:46.863160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b95927-f90d-431b-9ffa-0b7a040eff0a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:46.888804 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:46.932032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:46.944202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bf828-899c-48da-b05d-234db0797750 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:46.984401 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eba46d-80db-47d4-8677-8964be6e2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:46.984992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba46d-80db-47d4-8677-8964be6e2fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:46.985263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba46d-80db-47d4-8677-8964be6e2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:46.985650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba46d-80db-47d4-8677-8964be6e2fc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:46.986452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eba46d-80db-47d4-8677-8964be6e2fc8 None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=e8baa8033f884cb6a7783f78c01a212e) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:46.986791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eba46d-80db-47d4-8677-8964be6e2fc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:46.988255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eba46d-80db-47d4-8677-8964be6e2fc8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:46.999365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 285/567] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:46 2022] GET /identity/v3/role_assignments?user.id=e8baa8033f884cb6a7783f78c01a212e&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:47.001067 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eba46d-80db-47d4-8677-8964be6e2fc8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:47.013692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b95927-f90d-431b-9ffa-0b7a040eff0a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:47.065735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda8d01-337e-4d74-a064-ab1fc6ddb697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:47.066708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda8d01-337e-4d74-a064-ab1fc6ddb697 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:47.067413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda8d01-337e-4d74-a064-ab1fc6ddb697 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:47.067865 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda8d01-337e-4d74-a064-ab1fc6ddb697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:47.083431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda8d01-337e-4d74-a064-ab1fc6ddb697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:47.085177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda8d01-337e-4d74-a064-ab1fc6ddb697 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-adda8d01-337e-4d74-a064-ab1fc6ddb697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:47.102536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:47.103804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:47.104906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:47.104906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:47.104906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:47.105976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 283/568] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:47.107490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03849ae-2237-4a2d-b4b0-28b075068482 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:47.107899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03849ae-2237-4a2d-b4b0-28b075068482 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:47.108276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03849ae-2237-4a2d-b4b0-28b075068482 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:47.113927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 284/569] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:47.115116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03849ae-2237-4a2d-b4b0-28b075068482 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:47.131641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eba46d-80db-47d4-8677-8964be6e2fc8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:47.150183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:47.171655 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec16ba2-c996-4ff8-961a-2560966f7fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:47.172287 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec16ba2-c996-4ff8-961a-2560966f7fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:47.172563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec16ba2-c996-4ff8-961a-2560966f7fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:47.173428 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec16ba2-c996-4ff8-961a-2560966f7fc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:47.187581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec16ba2-c996-4ff8-961a-2560966f7fc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-0ec16ba2-c996-4ff8-961a-2560966f7fc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:47.192782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:47.193813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:47.194896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:47.194896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:47.194896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:47.194896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:47.194896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:47.194896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:47.194896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:47.194896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:47.194896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:47.194896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:47.194896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:47.194896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:47.194896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 286/570] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:47.195749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98765-717b-4791-81b3-99cf819e25d2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:47.195749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98765-717b-4791-81b3-99cf819e25d2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:47.195749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98765-717b-4791-81b3-99cf819e25d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:47.213196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-34e98765-717b-4791-81b3-99cf819e25d2 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:47.214355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-34e98765-717b-4791-81b3-99cf819e25d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:47.215303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:47.233908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03849ae-2237-4a2d-b4b0-28b075068482 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:47.271808 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55e7b9-9f6b-43c0-bae8-a8687a29d896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:47.272573 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55e7b9-9f6b-43c0-bae8-a8687a29d896 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:47.272939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55e7b9-9f6b-43c0-bae8-a8687a29d896 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:47.273408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55e7b9-9f6b-43c0-bae8-a8687a29d896 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:47.274046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55e7b9-9f6b-43c0-bae8-a8687a29d896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:47.274474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55e7b9-9f6b-43c0-bae8-a8687a29d896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:47.275951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55e7b9-9f6b-43c0-bae8-a8687a29d896 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:47.285213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 287/571] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:47.286570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98765-717b-4791-81b3-99cf819e25d2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:47.293811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 285/572] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:47.293811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55e7b9-9f6b-43c0-bae8-a8687a29d896 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:47.412201 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98765-717b-4791-81b3-99cf819e25d2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:47.424234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:47.438833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55e7b9-9f6b-43c0-bae8-a8687a29d896 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:47.462236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bcac1-9d42-4898-ab91-6e5504b2843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:47.463763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bcac1-9d42-4898-ab91-6e5504b2843c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:47.464187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bcac1-9d42-4898-ab91-6e5504b2843c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:47.464891 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bcac1-9d42-4898-ab91-6e5504b2843c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:47.475602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11543dbc-d9ad-4f18-bd25-ce2c07bfbd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:47.476336 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11543dbc-d9ad-4f18-bd25-ce2c07bfbd85 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:47.476711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11543dbc-d9ad-4f18-bd25-ce2c07bfbd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:47.477078 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11543dbc-d9ad-4f18-bd25-ce2c07bfbd85 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:47.477908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11543dbc-d9ad-4f18-bd25-ce2c07bfbd85 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:47.478324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11543dbc-d9ad-4f18-bd25-ce2c07bfbd85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:47.478979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bcac1-9d42-4898-ab91-6e5504b2843c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:47.479877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11543dbc-d9ad-4f18-bd25-ce2c07bfbd85 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-af4bcac1-9d42-4898-ab91-6e5504b2843c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:47.484411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:47.485509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:47.486554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:47.486554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:47.486554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:47.486554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:47.486554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:47.486554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:47.486554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:47.486554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:47.486554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:47.486554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:47.486554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:47.486554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:47.488921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 288/573] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:47.489830 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bcac1-9d42-4898-ab91-6e5504b2843c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:47.496525 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 286/574] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:47.497450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11543dbc-d9ad-4f18-bd25-ce2c07bfbd85 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:47.507920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:47.612315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11543dbc-d9ad-4f18-bd25-ce2c07bfbd85 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:47.612520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bcac1-9d42-4898-ab91-6e5504b2843c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:47.646836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e6525-2b88-4859-8fb2-5c89904e553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:47.647439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e6525-2b88-4859-8fb2-5c89904e553c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:47.647712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e6525-2b88-4859-8fb2-5c89904e553c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:47.647977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e6525-2b88-4859-8fb2-5c89904e553c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:47.648621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e6525-2b88-4859-8fb2-5c89904e553c None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:47.648915 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e6525-2b88-4859-8fb2-5c89904e553c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:47.649915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97810e-db63-4788-929c-96ab07ead83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:47.650283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e6525-2b88-4859-8fb2-5c89904e553c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:47.650546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97810e-db63-4788-929c-96ab07ead83f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:47.651104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97810e-db63-4788-929c-96ab07ead83f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:47.651380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97810e-db63-4788-929c-96ab07ead83f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:47.658848 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 287/575] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:47.659640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e6525-2b88-4859-8fb2-5c89904e553c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:47.670044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97810e-db63-4788-929c-96ab07ead83f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:47.671922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97810e-db63-4788-929c-96ab07ead83f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-5b97810e-db63-4788-929c-96ab07ead83f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:47.685783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:47.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:47.687692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:47.687692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:47.687692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:47.687692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:47.687692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:47.687692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:47.687692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:47.687692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:47.687692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 289/576] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:47.687692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97810e-db63-4788-929c-96ab07ead83f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:47.718283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:47.736890 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:47.772811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e6525-2b88-4859-8fb2-5c89904e553c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:47.799616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97810e-db63-4788-929c-96ab07ead83f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:47.808644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cced2-4d22-44b3-9f75-5dfa8c00c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:47.809278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cced2-4d22-44b3-9f75-5dfa8c00c3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:47.809551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cced2-4d22-44b3-9f75-5dfa8c00c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:47.809817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cced2-4d22-44b3-9f75-5dfa8c00c3a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:47.821086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cced2-4d22-44b3-9f75-5dfa8c00c3a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:47.822523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cced2-4d22-44b3-9f75-5dfa8c00c3a6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:47.834612 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b8b9d-5e27-4e6c-bfc6-bd3777ab2cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:47.835253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b8b9d-5e27-4e6c-bfc6-bd3777ab2cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:47.835526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b8b9d-5e27-4e6c-bfc6-bd3777ab2cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:47.835790 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b8b9d-5e27-4e6c-bfc6-bd3777ab2cb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-245cced2-4d22-44b3-9f75-5dfa8c00c3a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:47.836597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:47.837513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:47.838384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:47.838384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:47.838384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:47.842318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 288/577] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:47.843520 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cced2-4d22-44b3-9f75-5dfa8c00c3a6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:47.848237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b8b9d-5e27-4e6c-bfc6-bd3777ab2cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-940b8b9d-5e27-4e6c-bfc6-bd3777ab2cb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:47.853009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:47.859474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 290/578] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:47.860375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b8b9d-5e27-4e6c-bfc6-bd3777ab2cb2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:47.947781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:47.950200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cced2-4d22-44b3-9f75-5dfa8c00c3a6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:47.965048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b8b9d-5e27-4e6c-bfc6-bd3777ab2cb2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:47.971804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:47.992008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721198de-d31c-4b71-b2d4-0b111b31c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:47.992630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721198de-d31c-4b71-b2d4-0b111b31c808 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:47.992904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721198de-d31c-4b71-b2d4-0b111b31c808 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:47.993222 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721198de-d31c-4b71-b2d4-0b111b31c808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:48.001638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9399ed1-d6a0-468e-aa08-b5f3deaf5c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:48.002225 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9399ed1-d6a0-468e-aa08-b5f3deaf5c96 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:48.002501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9399ed1-d6a0-468e-aa08-b5f3deaf5c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:48.002788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9399ed1-d6a0-468e-aa08-b5f3deaf5c96 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:48.003533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9399ed1-d6a0-468e-aa08-b5f3deaf5c96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:48.003836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9399ed1-d6a0-468e-aa08-b5f3deaf5c96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:48.004031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721198de-d31c-4b71-b2d4-0b111b31c808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:48.005239 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9399ed1-d6a0-468e-aa08-b5f3deaf5c96 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:48.005472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721198de-d31c-4b71-b2d4-0b111b31c808 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:48.021295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 291/579] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:48.021295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9399ed1-d6a0-468e-aa08-b5f3deaf5c96 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-721198de-d31c-4b71-b2d4-0b111b31c808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:48.021503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:48.022366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:48.023370 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:48.023370 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:48.023370 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:48.023370 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 289/580] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:48.023370 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721198de-d31c-4b71-b2d4-0b111b31c808 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:48.125183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721198de-d31c-4b71-b2d4-0b111b31c808 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:48.129037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9399ed1-d6a0-468e-aa08-b5f3deaf5c96 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:48.159062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a13f6-212c-4349-8397-7e715af1a5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:48.159671 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a13f6-212c-4349-8397-7e715af1a5cc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:48.159947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a13f6-212c-4349-8397-7e715af1a5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:48.160219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a13f6-212c-4349-8397-7e715af1a5cc None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:48.160914 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a13f6-212c-4349-8397-7e715af1a5cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:48.161176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a13f6-212c-4349-8397-7e715af1a5cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:48.162552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a13f6-212c-4349-8397-7e715af1a5cc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:48.163565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac55ce2-9285-40fb-9b0f-e78e5c327e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:48.164414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac55ce2-9285-40fb-9b0f-e78e5c327e8f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:48.164831 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac55ce2-9285-40fb-9b0f-e78e5c327e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:48.165099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac55ce2-9285-40fb-9b0f-e78e5c327e8f None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:48.165735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac55ce2-9285-40fb-9b0f-e78e5c327e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:48.166034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac55ce2-9285-40fb-9b0f-e78e5c327e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:48.167388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac55ce2-9285-40fb-9b0f-e78e5c327e8f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:48.171665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 290/581] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:48.172587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a13f6-212c-4349-8397-7e715af1a5cc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:48.181322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 292/582] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:48.182265 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac55ce2-9285-40fb-9b0f-e78e5c327e8f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:48.192011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:48.211182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:48.279992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a13f6-212c-4349-8397-7e715af1a5cc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:48.289927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac55ce2-9285-40fb-9b0f-e78e5c327e8f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:48.314621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70966b-b00e-4ea8-83f0-02b8e5c6edf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:48.315313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70966b-b00e-4ea8-83f0-02b8e5c6edf5 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:48.315602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70966b-b00e-4ea8-83f0-02b8e5c6edf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:48.315857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70966b-b00e-4ea8-83f0-02b8e5c6edf5 None admin] PATH_INFO: `/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/ab5f197fb09e422997434a1b2feb4567/roles/62da722185f844e3acdc4e690c9903b7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:48.328054 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64ba3d-3d91-4b61-b0cc-755e267d3546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:48.328919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64ba3d-3d91-4b61-b0cc-755e267d3546 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:48.329200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64ba3d-3d91-4b61-b0cc-755e267d3546 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:48.329470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64ba3d-3d91-4b61-b0cc-755e267d3546 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:48.330113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64ba3d-3d91-4b61-b0cc-755e267d3546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:48.330391 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70966b-b00e-4ea8-83f0-02b8e5c6edf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce5275375bc1421cb3fe6e27d5f685fe, user_id=ab5f197fb09e422997434a1b2feb4567, role_id=62da722185f844e3acdc4e690c9903b7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:48.330491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64ba3d-3d91-4b61-b0cc-755e267d3546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:48.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64ba3d-3d91-4b61-b0cc-755e267d3546 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:48.331885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70966b-b00e-4ea8-83f0-02b8e5c6edf5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:48.350773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 291/583] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:40:48 2022] PUT /identity/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/ab5f197fb09e422997434a1b2feb4567/roles/62da722185f844e3acdc4e690c9903b7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:40:48.351014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 293/584] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:48.351113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70966b-b00e-4ea8-83f0-02b8e5c6edf5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:48.351198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64ba3d-3d91-4b61-b0cc-755e267d3546 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:48.447295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:48.472210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:48.495105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70966b-b00e-4ea8-83f0-02b8e5c6edf5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:48.502163 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64ba3d-3d91-4b61-b0cc-755e267d3546 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:48.543800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689c5cc-a661-49f3-b112-8b44d55bdeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:48.544726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689c5cc-a661-49f3-b112-8b44d55bdeb8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:48.545151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689c5cc-a661-49f3-b112-8b44d55bdeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:48.545594 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689c5cc-a661-49f3-b112-8b44d55bdeb8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:48.546838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe9971-1614-445e-b717-01c708b76f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:48.547575 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9971-1614-445e-b717-01c708b76f53 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:48.547951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9971-1614-445e-b717-01c708b76f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:48.548498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9971-1614-445e-b717-01c708b76f53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:48.556699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689c5cc-a661-49f3-b112-8b44d55bdeb8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:48.558503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689c5cc-a661-49f3-b112-8b44d55bdeb8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:48.562986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe9971-1614-445e-b717-01c708b76f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:48.564490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe9971-1614-445e-b717-01c708b76f53 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-5689c5cc-a661-49f3-b112-8b44d55bdeb8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:48.573976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:48.575010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:48.576544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:48.576544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:48.576544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:48.576544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:48.576544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:48.576544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:48.576544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:48.576544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:48.576544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:40:48.576544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:48.576544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 294/585] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:48.577249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689c5cc-a661-49f3-b112-8b44d55bdeb8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e1fe9971-1614-445e-b717-01c708b76f53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:48.581591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:48.582580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:48.583552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:48.583552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:48.583552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:48.583552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 292/586] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:48.584916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe9971-1614-445e-b717-01c708b76f53 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:48.688586 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe9971-1614-445e-b717-01c708b76f53 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:48.714442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689c5cc-a661-49f3-b112-8b44d55bdeb8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:48.724975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93c910-748d-4f22-9025-c5bbc04c13d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:48.725633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93c910-748d-4f22-9025-c5bbc04c13d1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:48.725980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93c910-748d-4f22-9025-c5bbc04c13d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:48.726336 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93c910-748d-4f22-9025-c5bbc04c13d1 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:48.727223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93c910-748d-4f22-9025-c5bbc04c13d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:48.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93c910-748d-4f22-9025-c5bbc04c13d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:48.729136 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93c910-748d-4f22-9025-c5bbc04c13d1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:48.732768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:48.751787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:48.754463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 293/587] 10.222.0.33 () {56 vars in 1137 bytes} [Sun Sep 11 00:40:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:48.755501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93c910-748d-4f22-9025-c5bbc04c13d1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:48.765384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bede776-c26e-4814-9cf4-cb85690e93ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:48.766249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bede776-c26e-4814-9cf4-cb85690e93ef None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:48.766674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bede776-c26e-4814-9cf4-cb85690e93ef None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:48.767134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bede776-c26e-4814-9cf4-cb85690e93ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:48.778517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bede776-c26e-4814-9cf4-cb85690e93ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:48.781028 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bede776-c26e-4814-9cf4-cb85690e93ef None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-7bede776-c26e-4814-9cf4-cb85690e93ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:48.794845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:48.796098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:48.797273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:48.797273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:48.797273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:48.797273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:48.797273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:48.797273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:48.797273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:48.797273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:48.797273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:40:48.797273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:48.803606 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 295/588] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:48.804579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bede776-c26e-4814-9cf4-cb85690e93ef None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:48.891483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93c910-748d-4f22-9025-c5bbc04c13d1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:48.922678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bede776-c26e-4814-9cf4-cb85690e93ef None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:48.929523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10519c9-e0c5-4df7-b27a-a4ac1314e012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:48.930260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10519c9-e0c5-4df7-b27a-a4ac1314e012 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:48.930630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10519c9-e0c5-4df7-b27a-a4ac1314e012 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:48.931016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10519c9-e0c5-4df7-b27a-a4ac1314e012 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:48.932122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10519c9-e0c5-4df7-b27a-a4ac1314e012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:48.932122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10519c9-e0c5-4df7-b27a-a4ac1314e012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:48.933569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10519c9-e0c5-4df7-b27a-a4ac1314e012 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:48.945960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 294/589] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:48.947017 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10519c9-e0c5-4df7-b27a-a4ac1314e012 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:48.967582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af4b67-7631-45f7-a372-1e559f004b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:48.968766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af4b67-7631-45f7-a372-1e559f004b21 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:48.969214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af4b67-7631-45f7-a372-1e559f004b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:48.969959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af4b67-7631-45f7-a372-1e559f004b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:48.986944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af4b67-7631-45f7-a372-1e559f004b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:48.988594 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af4b67-7631-45f7-a372-1e559f004b21 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:49.009316 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-e1af4b67-7631-45f7-a372-1e559f004b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:49.010219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:49.012248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:49.013981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:49.013981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:49.013981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:49.015067 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 296/590] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:49.015993 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af4b67-7631-45f7-a372-1e559f004b21 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:49.064121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10519c9-e0c5-4df7-b27a-a4ac1314e012 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:49.069551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:49.105358 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61e687-5369-4584-b25c-f7f290ef2082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:49.106068 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e687-5369-4584-b25c-f7f290ef2082 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:49.107140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e687-5369-4584-b25c-f7f290ef2082 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:49.107627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e687-5369-4584-b25c-f7f290ef2082 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:49.108422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61e687-5369-4584-b25c-f7f290ef2082 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:49.108788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61e687-5369-4584-b25c-f7f290ef2082 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:49.110384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61e687-5369-4584-b25c-f7f290ef2082 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:49.134047 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 295/591] 10.222.0.33 () {56 vars in 1137 bytes} [Sun Sep 11 00:40:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:49.135055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61e687-5369-4584-b25c-f7f290ef2082 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:49.151450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af4b67-7631-45f7-a372-1e559f004b21 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:49.192752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057a20a-6542-4308-b651-7f90792131b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:49.193687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057a20a-6542-4308-b651-7f90792131b4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:49.193963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057a20a-6542-4308-b651-7f90792131b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:49.194230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057a20a-6542-4308-b651-7f90792131b4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:49.202188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057a20a-6542-4308-b651-7f90792131b4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:49.203639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057a20a-6542-4308-b651-7f90792131b4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-1057a20a-6542-4308-b651-7f90792131b4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:49.217109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:49.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:49.219722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:49.219722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:49.219722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:49.219722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:49.219722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:49.219722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:49.219722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:49.219722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:49.219722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:40:49.219722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:49.219722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 297/592] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:49.219722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057a20a-6542-4308-b651-7f90792131b4 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:49.254274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61e687-5369-4584-b25c-f7f290ef2082 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:49.268048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:49.292473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f78396-df62-4058-8fc9-06213adeecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:49.293072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f78396-df62-4058-8fc9-06213adeecd1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:49.293344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f78396-df62-4058-8fc9-06213adeecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:49.293609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f78396-df62-4058-8fc9-06213adeecd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:49.294801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f78396-df62-4058-8fc9-06213adeecd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:49.295098 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f78396-df62-4058-8fc9-06213adeecd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:49.296455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f78396-df62-4058-8fc9-06213adeecd1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:49.308558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 296/593] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:49.309998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff616f3-6bfa-4bc4-ba51-c75735369102 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:49.310287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff616f3-6bfa-4bc4-ba51-c75735369102 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:49.310555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff616f3-6bfa-4bc4-ba51-c75735369102 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:49.316302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 297/594] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:49.317292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff616f3-6bfa-4bc4-ba51-c75735369102 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:49.335224 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:49.340484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057a20a-6542-4308-b651-7f90792131b4 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:49.380621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c961282-eb4f-4721-a55f-8fb2c65a20ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:49.381242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c961282-eb4f-4721-a55f-8fb2c65a20ac None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:49.381689 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c961282-eb4f-4721-a55f-8fb2c65a20ac None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:49.381961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c961282-eb4f-4721-a55f-8fb2c65a20ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:49.394355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c961282-eb4f-4721-a55f-8fb2c65a20ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:49.396218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c961282-eb4f-4721-a55f-8fb2c65a20ac None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-5c961282-eb4f-4721-a55f-8fb2c65a20ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:49.412971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:49.413905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:49.420062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:49.420062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:49.420062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:49.420062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 298/595] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:49.420062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c961282-eb4f-4721-a55f-8fb2c65a20ac None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:49.437532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff616f3-6bfa-4bc4-ba51-c75735369102 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:49.472897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e07aa6-f503-48b4-916c-1f4f96ca2c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:49.473561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e07aa6-f503-48b4-916c-1f4f96ca2c04 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:49.473847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e07aa6-f503-48b4-916c-1f4f96ca2c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:49.474119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e07aa6-f503-48b4-916c-1f4f96ca2c04 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:49.475234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e07aa6-f503-48b4-916c-1f4f96ca2c04 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:49.475751 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e07aa6-f503-48b4-916c-1f4f96ca2c04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:49.476992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e07aa6-f503-48b4-916c-1f4f96ca2c04 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:49.499429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 298/596] 10.222.0.33 () {56 vars in 1139 bytes} [Sun Sep 11 00:40:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:49.499429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05028dcc-d5bb-434f-9aa7-5a6229f57de0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:49.499429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05028dcc-d5bb-434f-9aa7-5a6229f57de0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:49.499429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05028dcc-d5bb-434f-9aa7-5a6229f57de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:49.515184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-05028dcc-d5bb-434f-9aa7-5a6229f57de0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:49.516308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-05028dcc-d5bb-434f-9aa7-5a6229f57de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:49.526397 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c961282-eb4f-4721-a55f-8fb2c65a20ac None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:49.540174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:49.561903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46058d34-c2ca-4d68-ab84-1610ed52968d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:49.562517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46058d34-c2ca-4d68-ab84-1610ed52968d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:49.562824 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46058d34-c2ca-4d68-ab84-1610ed52968d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:49.563093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46058d34-c2ca-4d68-ab84-1610ed52968d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:49.569680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46058d34-c2ca-4d68-ab84-1610ed52968d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:49.571133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46058d34-c2ca-4d68-ab84-1610ed52968d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-46058d34-c2ca-4d68-ab84-1610ed52968d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:49.582396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:49.583329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:49.584254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:49.584254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:49.584254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:49.584254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:49.584254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:49.584254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:49.584254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:49.584254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:49.584254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 299/597] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:49.584734 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46058d34-c2ca-4d68-ab84-1610ed52968d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:49.594928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 299/598] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:49.594928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05028dcc-d5bb-434f-9aa7-5a6229f57de0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:49.599923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:49.704608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46058d34-c2ca-4d68-ab84-1610ed52968d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:49.712593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05028dcc-d5bb-434f-9aa7-5a6229f57de0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:49.744075 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ff7ea-6a9c-431c-9db1-3a969fb6eb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:49.744684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ff7ea-6a9c-431c-9db1-3a969fb6eb95 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:49.745290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ff7ea-6a9c-431c-9db1-3a969fb6eb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:49.745569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ff7ea-6a9c-431c-9db1-3a969fb6eb95 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:49.746500 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ff7ea-6a9c-431c-9db1-3a969fb6eb95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:49.747516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ff7ea-6a9c-431c-9db1-3a969fb6eb95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:49.748878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ff7ea-6a9c-431c-9db1-3a969fb6eb95 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:49.754333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39122561-9408-4a8f-8a1d-249eb0f58ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:49.755212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122561-9408-4a8f-8a1d-249eb0f58ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:49.755688 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122561-9408-4a8f-8a1d-249eb0f58ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:49.756716 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122561-9408-4a8f-8a1d-249eb0f58ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:49.761810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 300/599] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:49.763549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ff7ea-6a9c-431c-9db1-3a969fb6eb95 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:49.772625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39122561-9408-4a8f-8a1d-249eb0f58ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:49.774836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39122561-9408-4a8f-8a1d-249eb0f58ee7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-39122561-9408-4a8f-8a1d-249eb0f58ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:49.796072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:49.797016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:49.798055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:49.798055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:49.798055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:49.798055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 300/600] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:49.798055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39122561-9408-4a8f-8a1d-249eb0f58ee7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:49.819103 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:49.851531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:49.893554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ff7ea-6a9c-431c-9db1-3a969fb6eb95 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:49.909064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39122561-9408-4a8f-8a1d-249eb0f58ee7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:49.930412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110f281-6706-46b2-b65c-87d21e7ee508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:49.931496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110f281-6706-46b2-b65c-87d21e7ee508 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:49.932354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110f281-6706-46b2-b65c-87d21e7ee508 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:49.932783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110f281-6706-46b2-b65c-87d21e7ee508 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:49.933862 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110f281-6706-46b2-b65c-87d21e7ee508 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:49.934976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110f281-6706-46b2-b65c-87d21e7ee508 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:49.936684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110f281-6706-46b2-b65c-87d21e7ee508 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:49.943040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bce861-498c-4ab5-917e-6bb9c16fb730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:49.943665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bce861-498c-4ab5-917e-6bb9c16fb730 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:49.943941 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bce861-498c-4ab5-917e-6bb9c16fb730 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:49.944209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bce861-498c-4ab5-917e-6bb9c16fb730 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:49.950406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 301/601] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:49.950713 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bce861-498c-4ab5-917e-6bb9c16fb730 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:49.951531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110f281-6706-46b2-b65c-87d21e7ee508 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:49.952244 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bce861-498c-4ab5-917e-6bb9c16fb730 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-29bce861-498c-4ab5-917e-6bb9c16fb730 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:49.963739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:49.964875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:49.965895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:49.965895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:49.965895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:49.965895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:49.965895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:49.965895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:49.965895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:49.965895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:49.965895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 301/602] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:49.966670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bce861-498c-4ab5-917e-6bb9c16fb730 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:50.047391 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:50.065708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110f281-6706-46b2-b65c-87d21e7ee508 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:50.081368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bce861-498c-4ab5-917e-6bb9c16fb730 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:50.098009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:50.106560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed87a4c-8014-43b1-9efe-06f308e47587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:50.107301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed87a4c-8014-43b1-9efe-06f308e47587 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:50.107581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed87a4c-8014-43b1-9efe-06f308e47587 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:50.108096 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed87a4c-8014-43b1-9efe-06f308e47587 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:50.109145 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed87a4c-8014-43b1-9efe-06f308e47587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:50.109584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed87a4c-8014-43b1-9efe-06f308e47587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:50.111341 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed87a4c-8014-43b1-9efe-06f308e47587 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:50.116319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317df4dd-6fa0-486d-aa6e-c8c6da0bffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:50.116945 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317df4dd-6fa0-486d-aa6e-c8c6da0bffc9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:50.117221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317df4dd-6fa0-486d-aa6e-c8c6da0bffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:50.117489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317df4dd-6fa0-486d-aa6e-c8c6da0bffc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:50.128839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 302/603] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:50.129932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed87a4c-8014-43b1-9efe-06f308e47587 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:50.131687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317df4dd-6fa0-486d-aa6e-c8c6da0bffc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-317df4dd-6fa0-486d-aa6e-c8c6da0bffc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:50.137210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:50.138165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:50.139082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:50.139082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:50.139082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:50.139082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:50.139082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:50.139082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:50.139082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:50.139082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:50.139082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:50.139082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:50.139082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:50.139082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:50.139996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 302/604] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:50.142789 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317df4dd-6fa0-486d-aa6e-c8c6da0bffc9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:50.242064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed87a4c-8014-43b1-9efe-06f308e47587 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:50.245443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317df4dd-6fa0-486d-aa6e-c8c6da0bffc9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:50.276191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:50.276890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53a74f-d378-4760-b462-7432c8a27c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:50.278042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53a74f-d378-4760-b462-7432c8a27c24 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:50.278317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53a74f-d378-4760-b462-7432c8a27c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:50.278617 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53a74f-d378-4760-b462-7432c8a27c24 None admin] PATH_INFO: `/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/f0dfdb9054ac4fef97d8e30aa5a8bd66/roles/62da722185f844e3acdc4e690c9903b7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:50.282864 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9fce6-a215-4248-946f-f57e30e899e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:50.283469 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9fce6-a215-4248-946f-f57e30e899e3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:50.283743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9fce6-a215-4248-946f-f57e30e899e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:50.284006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9fce6-a215-4248-946f-f57e30e899e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:50.284689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9fce6-a215-4248-946f-f57e30e899e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:50.284991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9fce6-a215-4248-946f-f57e30e899e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:50.286424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9fce6-a215-4248-946f-f57e30e899e3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:50.294123 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53a74f-d378-4760-b462-7432c8a27c24 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce5275375bc1421cb3fe6e27d5f685fe, user_id=f0dfdb9054ac4fef97d8e30aa5a8bd66, role_id=62da722185f844e3acdc4e690c9903b7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:50.295543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53a74f-d378-4760-b462-7432c8a27c24 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:50.300160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 303/605] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:50.301014 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9fce6-a215-4248-946f-f57e30e899e3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:50.314365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 303/606] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:40:50 2022] PUT /identity/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/f0dfdb9054ac4fef97d8e30aa5a8bd66/roles/62da722185f844e3acdc4e690c9903b7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:40:50.315499 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53a74f-d378-4760-b462-7432c8a27c24 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:50.367520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:50.439868 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53a74f-d378-4760-b462-7432c8a27c24 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:50.445299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9fce6-a215-4248-946f-f57e30e899e3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:50.482255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de147e70-4a3a-4c1f-a071-badbbc6a7c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:50.483231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de147e70-4a3a-4c1f-a071-badbbc6a7c8c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:50.483526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de147e70-4a3a-4c1f-a071-badbbc6a7c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:50.483799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de147e70-4a3a-4c1f-a071-badbbc6a7c8c None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:50.484577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de147e70-4a3a-4c1f-a071-badbbc6a7c8c None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:50.484889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de147e70-4a3a-4c1f-a071-badbbc6a7c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:50.486638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de147e70-4a3a-4c1f-a071-badbbc6a7c8c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:50.497185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b0af-2eb0-4f3a-a8cc-3ea17fbe5c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:50.497584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 304/607] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:50.498213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de147e70-4a3a-4c1f-a071-badbbc6a7c8c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:50.498926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b0af-2eb0-4f3a-a8cc-3ea17fbe5c5f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:50.499416 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b0af-2eb0-4f3a-a8cc-3ea17fbe5c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:50.499880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b0af-2eb0-4f3a-a8cc-3ea17fbe5c5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:50.513299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428b0af-2eb0-4f3a-a8cc-3ea17fbe5c5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:50.516180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428b0af-2eb0-4f3a-a8cc-3ea17fbe5c5f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6428b0af-2eb0-4f3a-a8cc-3ea17fbe5c5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:50.535817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:50.536867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:50.537804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:50.537804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:50.537804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:50.537804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:50.537804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:50.537804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:50.537804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:50.537804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:50.540209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 304/608] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:50.541451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b0af-2eb0-4f3a-a8cc-3ea17fbe5c5f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:50.606381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:50.623319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de147e70-4a3a-4c1f-a071-badbbc6a7c8c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:50.625289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:50.662605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bd29b-32ed-4474-922d-7e5ad76229be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:50.663829 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bd29b-32ed-4474-922d-7e5ad76229be None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:50.664677 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bd29b-32ed-4474-922d-7e5ad76229be None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:50.665111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bd29b-32ed-4474-922d-7e5ad76229be None admin] PATH_INFO: `/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/7ecc9e16475344b78bb885437b5d6bec/roles/62da722185f844e3acdc4e690c9903b7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:50.673010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b0af-2eb0-4f3a-a8cc-3ea17fbe5c5f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:50.682880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bd29b-32ed-4474-922d-7e5ad76229be None admin] RBAC: Authorizing `identity:create_grant(project_id=ce5275375bc1421cb3fe6e27d5f685fe, user_id=7ecc9e16475344b78bb885437b5d6bec, role_id=62da722185f844e3acdc4e690c9903b7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:50.684659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bd29b-32ed-4474-922d-7e5ad76229be None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:50.709592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 305/609] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:40:50 2022] PUT /identity/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/7ecc9e16475344b78bb885437b5d6bec/roles/62da722185f844e3acdc4e690c9903b7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:40:50.709592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bd29b-32ed-4474-922d-7e5ad76229be None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:50.710038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6ae99-214e-4fe9-9b24-b4c099784d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:50.710634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6ae99-214e-4fe9-9b24-b4c099784d5f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:50.710946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6ae99-214e-4fe9-9b24-b4c099784d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:50.711266 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6ae99-214e-4fe9-9b24-b4c099784d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:50.724227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6ae99-214e-4fe9-9b24-b4c099784d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:50.725719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6ae99-214e-4fe9-9b24-b4c099784d5f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1cc6ae99-214e-4fe9-9b24-b4c099784d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:50.742559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:50.743621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:50.744505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:50.744505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:50.744505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:50.744505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 305/610] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:50.745161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a0dc4-e7b9-4a1a-910d-d83a2b282ebe None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:50.745161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a0dc4-e7b9-4a1a-910d-d83a2b282ebe None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:50.746755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a0dc4-e7b9-4a1a-910d-d83a2b282ebe None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:50.751579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 306/611] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:50.752412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a0dc4-e7b9-4a1a-910d-d83a2b282ebe None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:50.837727 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bd29b-32ed-4474-922d-7e5ad76229be None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:50.884842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcf4c2-8aed-43a7-8e05-dc19dcbdbf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:50.884842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcf4c2-8aed-43a7-8e05-dc19dcbdbf8c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:50.884842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcf4c2-8aed-43a7-8e05-dc19dcbdbf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:50.885460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcf4c2-8aed-43a7-8e05-dc19dcbdbf8c None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:50.887597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcf4c2-8aed-43a7-8e05-dc19dcbdbf8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:50.887597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcf4c2-8aed-43a7-8e05-dc19dcbdbf8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:50.887597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcf4c2-8aed-43a7-8e05-dc19dcbdbf8c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:50.901207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 306/612] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:50.902904 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423252fc-6fde-468c-bae6-f4c8cee0e229 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:50.903118 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a0dc4-e7b9-4a1a-910d-d83a2b282ebe None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:50.903609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423252fc-6fde-468c-bae6-f4c8cee0e229 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:50.904074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423252fc-6fde-468c-bae6-f4c8cee0e229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:50.906312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:50.925031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-423252fc-6fde-468c-bae6-f4c8cee0e229 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:50.926555 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-423252fc-6fde-468c-bae6-f4c8cee0e229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:50.934754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:50.945187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf221d9-5ef2-4a95-86df-5f114be4c76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:50.945795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf221d9-5ef2-4a95-86df-5f114be4c76f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:50.946066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf221d9-5ef2-4a95-86df-5f114be4c76f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:50.946329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf221d9-5ef2-4a95-86df-5f114be4c76f None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:50.947006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf221d9-5ef2-4a95-86df-5f114be4c76f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:50.947301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf221d9-5ef2-4a95-86df-5f114be4c76f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:50.948663 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf221d9-5ef2-4a95-86df-5f114be4c76f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:50.961191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 307/613] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:50.962040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf221d9-5ef2-4a95-86df-5f114be4c76f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:51.015666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 307/614] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:51.017176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423252fc-6fde-468c-bae6-f4c8cee0e229 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:51.105899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf221d9-5ef2-4a95-86df-5f114be4c76f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:51.176533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3a29e-5f4b-4699-92f7-6256c4ce6a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:51.177122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3a29e-5f4b-4699-92f7-6256c4ce6a1a None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:51.177397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3a29e-5f4b-4699-92f7-6256c4ce6a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:51.177665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3a29e-5f4b-4699-92f7-6256c4ce6a1a None admin] PATH_INFO: `/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/c45d8e2b0b674e9a814167db4d78749e/roles/62da722185f844e3acdc4e690c9903b7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:51.206958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3a29e-5f4b-4699-92f7-6256c4ce6a1a None admin] RBAC: Authorizing `identity:create_grant(project_id=ce5275375bc1421cb3fe6e27d5f685fe, user_id=c45d8e2b0b674e9a814167db4d78749e, role_id=62da722185f844e3acdc4e690c9903b7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:51.208423 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3a29e-5f4b-4699-92f7-6256c4ce6a1a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:51.220429 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423252fc-6fde-468c-bae6-f4c8cee0e229 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:51.233822 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 308/615] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:40:50 2022] PUT /identity/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/c45d8e2b0b674e9a814167db4d78749e/roles/62da722185f844e3acdc4e690c9903b7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:40:51.265996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5074e-54da-4c74-80b3-4a0d50dbcd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:51.266635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5074e-54da-4c74-80b3-4a0d50dbcd99 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:51.266971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5074e-54da-4c74-80b3-4a0d50dbcd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:51.267242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5074e-54da-4c74-80b3-4a0d50dbcd99 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:51.275091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5074e-54da-4c74-80b3-4a0d50dbcd99 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:51.276614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5074e-54da-4c74-80b3-4a0d50dbcd99 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-82c5074e-54da-4c74-80b3-4a0d50dbcd99 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:51.291135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:51.292186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:51.293735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:51.293735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:51.293735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:51.293735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:51.293735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:51.293735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:51.293735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:51.293735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:51.293735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:40:51.293735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:51.293735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 308/616] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:40:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:51.300490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3a29e-5f4b-4699-92f7-6256c4ce6a1a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:51.317824 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:51.378346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5074e-54da-4c74-80b3-4a0d50dbcd99 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:51.381759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:51.475244 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3a29e-5f4b-4699-92f7-6256c4ce6a1a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:51.528126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d4b90-5fa4-4a2f-a657-32675d9ba912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:51.528744 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d4b90-5fa4-4a2f-a657-32675d9ba912 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:51.529022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d4b90-5fa4-4a2f-a657-32675d9ba912 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:51.529345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d4b90-5fa4-4a2f-a657-32675d9ba912 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:51.530029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d4b90-5fa4-4a2f-a657-32675d9ba912 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:51.530332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d4b90-5fa4-4a2f-a657-32675d9ba912 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:51.532134 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d4b90-5fa4-4a2f-a657-32675d9ba912 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:51.548183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5074e-54da-4c74-80b3-4a0d50dbcd99 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:51.556198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 309/617] 10.222.0.33 () {56 vars in 1135 bytes} [Sun Sep 11 00:40:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:51.565829 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d4b90-5fa4-4a2f-a657-32675d9ba912 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:51.594075 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcf560-9031-45c9-ad2b-bb9f6b7a462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:51.595149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcf560-9031-45c9-ad2b-bb9f6b7a462d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:51.595623 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcf560-9031-45c9-ad2b-bb9f6b7a462d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:51.596084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcf560-9031-45c9-ad2b-bb9f6b7a462d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:51.607452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcf560-9031-45c9-ad2b-bb9f6b7a462d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-5fdcf560-9031-45c9-ad2b-bb9f6b7a462d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:51.613130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:51.614059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:51.615017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:51.615017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:51.615017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:51.615017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:51.615017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:51.615017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:51.615017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:51.615017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:51.615017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:51.615017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:51.615017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:51.615017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:51.617835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 309/618] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:51.625058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcf560-9031-45c9-ad2b-bb9f6b7a462d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:51.653208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:51.680436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d4b90-5fa4-4a2f-a657-32675d9ba912 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:51.702062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:51.717961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8563bda-a493-4d4d-8d29-4611fbc4a2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:51.718767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8563bda-a493-4d4d-8d29-4611fbc4a2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:51.718991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8563bda-a493-4d4d-8d29-4611fbc4a2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:51.719261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8563bda-a493-4d4d-8d29-4611fbc4a2b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:51.730294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8563bda-a493-4d4d-8d29-4611fbc4a2b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:51.731774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8563bda-a493-4d4d-8d29-4611fbc4a2b9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:51.746830 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcf560-9031-45c9-ad2b-bb9f6b7a462d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a8563bda-a493-4d4d-8d29-4611fbc4a2b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:51.747900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:51.748993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:51.749879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:51.749879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:51.749879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:51.749879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 310/619] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:51.758765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8563bda-a493-4d4d-8d29-4611fbc4a2b9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:51.803416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1161db-1638-4b35-8070-6ca05b50a1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:51.804453 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1161db-1638-4b35-8070-6ca05b50a1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:51.804959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1161db-1638-4b35-8070-6ca05b50a1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:51.805440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1161db-1638-4b35-8070-6ca05b50a1b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:51.806312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1161db-1638-4b35-8070-6ca05b50a1b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:51.806858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1161db-1638-4b35-8070-6ca05b50a1b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:51.808467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1161db-1638-4b35-8070-6ca05b50a1b3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:51.817947 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 310/620] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:51.823562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1161db-1638-4b35-8070-6ca05b50a1b3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:51.989105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8563bda-a493-4d4d-8d29-4611fbc4a2b9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:52.007994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1161db-1638-4b35-8070-6ca05b50a1b3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:52.013898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:52.026029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d0cb-8a96-4bdf-a9b2-e60782fe36e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:52.027246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d0cb-8a96-4bdf-a9b2-e60782fe36e9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:52.027561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d0cb-8a96-4bdf-a9b2-e60782fe36e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:52.027834 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d0cb-8a96-4bdf-a9b2-e60782fe36e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:52.028494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354d0cb-8a96-4bdf-a9b2-e60782fe36e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:52.028795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354d0cb-8a96-4bdf-a9b2-e60782fe36e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:52.030384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354d0cb-8a96-4bdf-a9b2-e60782fe36e9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:52.037225 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:52.045372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 311/621] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:40:52.049331 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bef0b-1b94-4988-8b1c-99fd775fddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:52.050028 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bef0b-1b94-4988-8b1c-99fd775fddca None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:52.050571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bef0b-1b94-4988-8b1c-99fd775fddca None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:52.050822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bef0b-1b94-4988-8b1c-99fd775fddca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:52.051756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d0cb-8a96-4bdf-a9b2-e60782fe36e9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:52.064588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bef0b-1b94-4988-8b1c-99fd775fddca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:52.066218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bef0b-1b94-4988-8b1c-99fd775fddca None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-866bef0b-1b94-4988-8b1c-99fd775fddca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:52.081693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:52.082892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:52.083954 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:52.083954 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:52.083954 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:52.084950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 311/622] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:52.091113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bef0b-1b94-4988-8b1c-99fd775fddca None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:52.201308 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bef0b-1b94-4988-8b1c-99fd775fddca None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:52.242207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57302013-9ff3-4d76-9ef4-414819078fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:52.242757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57302013-9ff3-4d76-9ef4-414819078fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:52.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57302013-9ff3-4d76-9ef4-414819078fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:52.243321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57302013-9ff3-4d76-9ef4-414819078fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:52.243970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57302013-9ff3-4d76-9ef4-414819078fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:52.244275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57302013-9ff3-4d76-9ef4-414819078fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:52.246182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57302013-9ff3-4d76-9ef4-414819078fb3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:52.259893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 312/623] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:52.267091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57302013-9ff3-4d76-9ef4-414819078fb3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:52.269831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d0cb-8a96-4bdf-a9b2-e60782fe36e9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:52.336719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eeb9e-544c-44d7-b843-d0e0775f1eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:52.337280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:52.337404 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eeb9e-544c-44d7-b843-d0e0775f1eec None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:52.337616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eeb9e-544c-44d7-b843-d0e0775f1eec None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:52.337883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eeb9e-544c-44d7-b843-d0e0775f1eec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:52.349285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eeb9e-544c-44d7-b843-d0e0775f1eec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:52.350780 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eeb9e-544c-44d7-b843-d0e0775f1eec None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b57eeb9e-544c-44d7-b843-d0e0775f1eec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:52.368351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:52.369535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:52.371252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:52.371252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:52.371252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:52.371252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:52.371252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:52.371252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:52.371252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:52.371252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:52.371809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 312/624] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:52.377746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eeb9e-544c-44d7-b843-d0e0775f1eec None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:52.448809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57302013-9ff3-4d76-9ef4-414819078fb3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:52.473289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:52.526550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d9e9e-88bc-4620-87cc-5b1a53cd47c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:52.529171 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d9e9e-88bc-4620-87cc-5b1a53cd47c5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:52.529857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d9e9e-88bc-4620-87cc-5b1a53cd47c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:52.531449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d9e9e-88bc-4620-87cc-5b1a53cd47c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:52.547280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d9e9e-88bc-4620-87cc-5b1a53cd47c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:52.549185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d9e9e-88bc-4620-87cc-5b1a53cd47c5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:52.571879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eeb9e-544c-44d7-b843-d0e0775f1eec None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-910d9e9e-88bc-4620-87cc-5b1a53cd47c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:52.572414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:52.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:52.574321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:52.574321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:52.574321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:52.574321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:52.574321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:52.574321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:52.574321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:52.574321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:52.574321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:40:52.574321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:52.577949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 313/625] 10.222.0.33 () {56 vars in 1093 bytes} [Sun Sep 11 00:40:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:52.583646 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d9e9e-88bc-4620-87cc-5b1a53cd47c5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:52.615588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab6778-ae97-4246-b5a2-cf56e8a0a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:52.616574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab6778-ae97-4246-b5a2-cf56e8a0a8fe None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:52.617157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab6778-ae97-4246-b5a2-cf56e8a0a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:52.617654 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab6778-ae97-4246-b5a2-cf56e8a0a8fe None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:52.618562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab6778-ae97-4246-b5a2-cf56e8a0a8fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:52.619093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab6778-ae97-4246-b5a2-cf56e8a0a8fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:52.621554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab6778-ae97-4246-b5a2-cf56e8a0a8fe None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:52.634347 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 313/626] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:52.640666 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab6778-ae97-4246-b5a2-cf56e8a0a8fe None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:52.737347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:52.744355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d9e9e-88bc-4620-87cc-5b1a53cd47c5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:52.791069 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32b34-8bbd-4e9c-b276-01430272f6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:52.792185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32b34-8bbd-4e9c-b276-01430272f6ed None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:52.792639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32b34-8bbd-4e9c-b276-01430272f6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:52.793079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32b34-8bbd-4e9c-b276-01430272f6ed None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:52.793994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba32b34-8bbd-4e9c-b276-01430272f6ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:52.794470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba32b34-8bbd-4e9c-b276-01430272f6ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:52.796114 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba32b34-8bbd-4e9c-b276-01430272f6ed None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:52.816196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 314/627] 10.222.0.33 () {56 vars in 1133 bytes} [Sun Sep 11 00:40:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:52.824391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32b34-8bbd-4e9c-b276-01430272f6ed None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:52.833680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab6778-ae97-4246-b5a2-cf56e8a0a8fe None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:52.841355 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:52.894206 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0f85b-a571-4421-86dc-30f861dfa4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:52.895344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f85b-a571-4421-86dc-30f861dfa4f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:52.895620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f85b-a571-4421-86dc-30f861dfa4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:52.895890 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f85b-a571-4421-86dc-30f861dfa4f6 None admin] PATH_INFO: `/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/e8baa8033f884cb6a7783f78c01a212e/roles/62da722185f844e3acdc4e690c9903b7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:52.914289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0f85b-a571-4421-86dc-30f861dfa4f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce5275375bc1421cb3fe6e27d5f685fe, user_id=e8baa8033f884cb6a7783f78c01a212e, role_id=62da722185f844e3acdc4e690c9903b7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:52.916718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0f85b-a571-4421-86dc-30f861dfa4f6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:52.934846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 314/628] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:40:52 2022] PUT /identity/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/e8baa8033f884cb6a7783f78c01a212e/roles/62da722185f844e3acdc4e690c9903b7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:40:52.936691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b565b35-4cea-4235-975b-f4a44f501cd7 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:52.937085 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b565b35-4cea-4235-975b-f4a44f501cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:52.937362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b565b35-4cea-4235-975b-f4a44f501cd7 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:52.942906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 315/629] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:52.945671 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1a9eb-6838-486b-af00-ca61ce7333fb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:52.945970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1a9eb-6838-486b-af00-ca61ce7333fb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:52.946239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1a9eb-6838-486b-af00-ca61ce7333fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:52.969796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8fb1a9eb-6838-486b-af00-ca61ce7333fb None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:52.971090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8fb1a9eb-6838-486b-af00-ca61ce7333fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:53.017043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32b34-8bbd-4e9c-b276-01430272f6ed None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:53.063150 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 316/630] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:53.110559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546f5d4-3759-4a5a-823d-10513de2919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:53.111206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f5d4-3759-4a5a-823d-10513de2919c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:53.111486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f5d4-3759-4a5a-823d-10513de2919c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:53.111757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f5d4-3759-4a5a-823d-10513de2919c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:53.149372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:53.215282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546f5d4-3759-4a5a-823d-10513de2919c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:53.216693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540deaa-f870-4447-b611-dd0b43eaec8e None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:53.216810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546f5d4-3759-4a5a-823d-10513de2919c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:53.216999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540deaa-f870-4447-b611-dd0b43eaec8e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:53.217251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540deaa-f870-4447-b611-dd0b43eaec8e None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:53.219245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 317/631] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:40:53.223918 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5b1ef-c712-4aca-ad09-53d691db2656 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:53.224199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5b1ef-c712-4aca-ad09-53d691db2656 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:53.224468 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5b1ef-c712-4aca-ad09-53d691db2656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:53.252716 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b7f5b1ef-c712-4aca-ad09-53d691db2656 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:53.253970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b7f5b1ef-c712-4aca-ad09-53d691db2656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:53.345438 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 318/632] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:40:53.380550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 315/633] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:53.386211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5b1ef-c712-4aca-ad09-53d691db2656 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:53.402931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:53.410105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546f5d4-3759-4a5a-823d-10513de2919c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:53.521932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:53.558877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5b1ef-c712-4aca-ad09-53d691db2656 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:53.596847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546f5d4-3759-4a5a-823d-10513de2919c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:53.628391 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0042bb-6790-4632-bc79-52ec94942a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:53.629359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0042bb-6790-4632-bc79-52ec94942a21 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:53.629619 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0042bb-6790-4632-bc79-52ec94942a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:53.629886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0042bb-6790-4632-bc79-52ec94942a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:53.649555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0042bb-6790-4632-bc79-52ec94942a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:53.651141 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0042bb-6790-4632-bc79-52ec94942a21 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6d0042bb-6790-4632-bc79-52ec94942a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:53.667293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:53.668283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:53.669159 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:53.669159 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:53.669159 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:53.669326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92ee3d-6e88-433a-826a-976457a362e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:53.669326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ee3d-6e88-433a-826a-976457a362e9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:53.669326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ee3d-6e88-433a-826a-976457a362e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:53.669569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ee3d-6e88-433a-826a-976457a362e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:53.673083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 319/634] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:53.674301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0042bb-6790-4632-bc79-52ec94942a21 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:53.694158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92ee3d-6e88-433a-826a-976457a362e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-0f92ee3d-6e88-433a-826a-976457a362e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:53.701743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:53.702674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:53.703564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:53.703564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:53.703564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:53.703564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:53.703564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:53.703564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:53.703564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:53.703564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:53.703564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:53.703564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:53.703564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:53.703564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:53.706167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 316/635] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:40:53.707229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92ee3d-6e88-433a-826a-976457a362e9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:53.752009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:53.788010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0042bb-6790-4632-bc79-52ec94942a21 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:53.826589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f0fc7-6661-4582-9129-d725125f7de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:53.827973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f0fc7-6661-4582-9129-d725125f7de1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:53.828321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f0fc7-6661-4582-9129-d725125f7de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:53.828863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f0fc7-6661-4582-9129-d725125f7de1 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:53.829534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f0fc7-6661-4582-9129-d725125f7de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:53.829835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f0fc7-6661-4582-9129-d725125f7de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:53.830965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92ee3d-6e88-433a-826a-976457a362e9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:53.831281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f0fc7-6661-4582-9129-d725125f7de1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:53.851254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:53.854850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 320/636] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:53.856678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f0fc7-6661-4582-9129-d725125f7de1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:53.881297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931232a-b664-44b5-8e3b-979c354369e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:53.881931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931232a-b664-44b5-8e3b-979c354369e2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:53.882217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931232a-b664-44b5-8e3b-979c354369e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:53.882669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931232a-b664-44b5-8e3b-979c354369e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:53.894507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931232a-b664-44b5-8e3b-979c354369e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d931232a-b664-44b5-8e3b-979c354369e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:53.900079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:53.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:53.901859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:53.901859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:53.901859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:53.901859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:53.901859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:53.901859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:53.901859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:53.901859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:53.901859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:53.901859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:53.901859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:53.901859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:53.901859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 317/637] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:53.903265 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931232a-b664-44b5-8e3b-979c354369e2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:53.990237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f0fc7-6661-4582-9129-d725125f7de1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:54.020589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:54.027736 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931232a-b664-44b5-8e3b-979c354369e2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:54.029727 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0072d-6558-4d18-8ec8-b408466dc96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:54.031138 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0072d-6558-4d18-8ec8-b408466dc96f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:54.031471 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0072d-6558-4d18-8ec8-b408466dc96f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:54.031749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0072d-6558-4d18-8ec8-b408466dc96f None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:54.032426 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0072d-6558-4d18-8ec8-b408466dc96f None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:54.032732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0072d-6558-4d18-8ec8-b408466dc96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:54.034113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0072d-6558-4d18-8ec8-b408466dc96f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:54.042328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 321/638] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:54.047503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0072d-6558-4d18-8ec8-b408466dc96f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:54.066639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a882c07-e366-43bd-9104-f57f594e87ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:54.067291 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a882c07-e366-43bd-9104-f57f594e87ca None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:54.067757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a882c07-e366-43bd-9104-f57f594e87ca None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:54.068031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a882c07-e366-43bd-9104-f57f594e87ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:54.075341 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a882c07-e366-43bd-9104-f57f594e87ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:54.076768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a882c07-e366-43bd-9104-f57f594e87ca None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-4a882c07-e366-43bd-9104-f57f594e87ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:54.090156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:54.091175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:54.092088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:54.092088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:54.092088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:54.092088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:54.092088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:54.092088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:54.092088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:54.092088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:54.093241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 318/639] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:54.094663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79e37f-ad21-4552-ab9b-60a97a613514 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:54.095054 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79e37f-ad21-4552-ab9b-60a97a613514 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:54.095425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79e37f-ad21-4552-ab9b-60a97a613514 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:54.097956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 319/640] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:54.097956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79e37f-ad21-4552-ab9b-60a97a613514 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:54.136863 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:54.161252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0072d-6558-4d18-8ec8-b408466dc96f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:54.194682 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645994d1-8f64-4e68-bab2-ebe57b5fef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:54.195474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645994d1-8f64-4e68-bab2-ebe57b5fef60 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:54.195747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645994d1-8f64-4e68-bab2-ebe57b5fef60 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:54.196013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645994d1-8f64-4e68-bab2-ebe57b5fef60 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:54.196700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645994d1-8f64-4e68-bab2-ebe57b5fef60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:54.197486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645994d1-8f64-4e68-bab2-ebe57b5fef60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:54.198865 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645994d1-8f64-4e68-bab2-ebe57b5fef60 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:54.211061 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 322/641] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:54.211061 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645994d1-8f64-4e68-bab2-ebe57b5fef60 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:54.212142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79e37f-ad21-4552-ab9b-60a97a613514 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:54.248928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8daf4-0876-4aa0-9a65-d0d84d6a7a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:54.249550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8daf4-0876-4aa0-9a65-d0d84d6a7a96 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:54.249825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8daf4-0876-4aa0-9a65-d0d84d6a7a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:54.250202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8daf4-0876-4aa0-9a65-d0d84d6a7a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:54.261542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:54.262459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8daf4-0876-4aa0-9a65-d0d84d6a7a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:54.263983 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8daf4-0876-4aa0-9a65-d0d84d6a7a96 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-02a8daf4-0876-4aa0-9a65-d0d84d6a7a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:54.279477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:54.280520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:54.281417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:54.281417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:54.281417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:54.281417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 320/642] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:54.282077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4df54b-5888-4e41-9d60-57181e0c8117 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:54.282077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4df54b-5888-4e41-9d60-57181e0c8117 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:54.282322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4df54b-5888-4e41-9d60-57181e0c8117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:54.305237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7c4df54b-5888-4e41-9d60-57181e0c8117 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:54.307168 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7c4df54b-5888-4e41-9d60-57181e0c8117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:54.325348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645994d1-8f64-4e68-bab2-ebe57b5fef60 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:54.362151 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea364a3-053c-4fda-a204-c42e3eaf3972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:54.362778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea364a3-053c-4fda-a204-c42e3eaf3972 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:54.363057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea364a3-053c-4fda-a204-c42e3eaf3972 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:54.363320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea364a3-053c-4fda-a204-c42e3eaf3972 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:54.363995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea364a3-053c-4fda-a204-c42e3eaf3972 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:54.364292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea364a3-053c-4fda-a204-c42e3eaf3972 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:54.365718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea364a3-053c-4fda-a204-c42e3eaf3972 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:54.378556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 323/643] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:54.379256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea364a3-053c-4fda-a204-c42e3eaf3972 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:54.398792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 321/644] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:54.398792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4df54b-5888-4e41-9d60-57181e0c8117 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:54.418036 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:54.515691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea364a3-053c-4fda-a204-c42e3eaf3972 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:54.527736 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:54.530563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4df54b-5888-4e41-9d60-57181e0c8117 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:54.555499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612890e2-1d08-4766-b6d6-02e2eed6bcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:54.556658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612890e2-1d08-4766-b6d6-02e2eed6bcfc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:54.556931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612890e2-1d08-4766-b6d6-02e2eed6bcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:54.557285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612890e2-1d08-4766-b6d6-02e2eed6bcfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:54.571193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612890e2-1d08-4766-b6d6-02e2eed6bcfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:54.572718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612890e2-1d08-4766-b6d6-02e2eed6bcfc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:54.575841 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55a18a-f8ff-46b8-8b1e-dab97ca1919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:54.576615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a18a-f8ff-46b8-8b1e-dab97ca1919a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:54.577035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a18a-f8ff-46b8-8b1e-dab97ca1919a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:54.577446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a18a-f8ff-46b8-8b1e-dab97ca1919a None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:54.578244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55a18a-f8ff-46b8-8b1e-dab97ca1919a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:54.578688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55a18a-f8ff-46b8-8b1e-dab97ca1919a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:54.580692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55a18a-f8ff-46b8-8b1e-dab97ca1919a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-612890e2-1d08-4766-b6d6-02e2eed6bcfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:54.589252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:54.590419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:54.591869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:54.591869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:54.591869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:54.591869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 324/645] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:54.591869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612890e2-1d08-4766-b6d6-02e2eed6bcfc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:54.598380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 322/646] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:54.599487 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55a18a-f8ff-46b8-8b1e-dab97ca1919a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:54.699444 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:54.720036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612890e2-1d08-4766-b6d6-02e2eed6bcfc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:54.724012 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55a18a-f8ff-46b8-8b1e-dab97ca1919a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:54.757242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae980cd-a3f5-4941-b37a-fbe1351579c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:54.757841 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae980cd-a3f5-4941-b37a-fbe1351579c0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:54.758113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae980cd-a3f5-4941-b37a-fbe1351579c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:54.758376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae980cd-a3f5-4941-b37a-fbe1351579c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:54.759060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae980cd-a3f5-4941-b37a-fbe1351579c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:54.759282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fae45-82fe-4de4-86cb-d8ad9e2e4057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:54.759396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae980cd-a3f5-4941-b37a-fbe1351579c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:54.759887 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fae45-82fe-4de4-86cb-d8ad9e2e4057 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:54.760166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fae45-82fe-4de4-86cb-d8ad9e2e4057 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:54.760438 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fae45-82fe-4de4-86cb-d8ad9e2e4057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:54.760692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae980cd-a3f5-4941-b37a-fbe1351579c0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:54.761153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fae45-82fe-4de4-86cb-d8ad9e2e4057 None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=ab5f197fb09e422997434a1b2feb4567) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:54.761459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fae45-82fe-4de4-86cb-d8ad9e2e4057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:54.762906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fae45-82fe-4de4-86cb-d8ad9e2e4057 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:54.768888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 325/647] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:54 2022] GET /identity/v3/role_assignments?user.id=ab5f197fb09e422997434a1b2feb4567&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:54.769510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fae45-82fe-4de4-86cb-d8ad9e2e4057 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:54.794017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 323/648] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:54.797796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae980cd-a3f5-4941-b37a-fbe1351579c0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:54.831122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:54.931508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fae45-82fe-4de4-86cb-d8ad9e2e4057 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:54.945121 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae980cd-a3f5-4941-b37a-fbe1351579c0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:54.982302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac5b85-8906-428a-9163-8d73b2eac3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:54.983163 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5b85-8906-428a-9163-8d73b2eac3fc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:54.983274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5b85-8906-428a-9163-8d73b2eac3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:54.983496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5b85-8906-428a-9163-8d73b2eac3fc None admin] PATH_INFO: `/v3/users/glance` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:54.991511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac5b85-8906-428a-9163-8d73b2eac3fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:54.993457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac5b85-8906-428a-9163-8d73b2eac3fc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:54.995005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f36a1-1a53-4f79-b19b-798f92aa9002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:54.995968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f36a1-1a53-4f79-b19b-798f92aa9002 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:54.995968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f36a1-1a53-4f79-b19b-798f92aa9002 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:54.995968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f36a1-1a53-4f79-b19b-798f92aa9002 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:55.001804 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-56ac5b85-8906-428a-9163-8d73b2eac3fc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:55.005531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:55.006482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:55.008036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:55.008036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:55.008036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:55.008036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:55.008036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:55.008036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:55.008036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:55.008036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:55.008036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:40:55.008036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:55.008036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 326/649] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:55.008727 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac5b85-8906-428a-9163-8d73b2eac3fc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:55.015508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f36a1-1a53-4f79-b19b-798f92aa9002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-430f36a1-1a53-4f79-b19b-798f92aa9002 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:55.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:55.021363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:55.022237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:55.022237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:55.022237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:55.022237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:55.022237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:55.022237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:55.022237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:55.022237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:55.022237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:55.022237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:55.022237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:55.022237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:55.022237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 324/650] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:55.024699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f36a1-1a53-4f79-b19b-798f92aa9002 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:55.114623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:55.138942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac5b85-8906-428a-9163-8d73b2eac3fc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:55.151192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f36a1-1a53-4f79-b19b-798f92aa9002 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:55.176443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137208d0-e674-4240-98f8-f7d25edabdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:55.176872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137208d0-e674-4240-98f8-f7d25edabdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:55.177154 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137208d0-e674-4240-98f8-f7d25edabdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:55.177425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137208d0-e674-4240-98f8-f7d25edabdc5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:55.186286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137208d0-e674-4240-98f8-f7d25edabdc5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:55.187998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137208d0-e674-4240-98f8-f7d25edabdc5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:55.189130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521acf5-e34f-49c0-a53d-cc9cf82522ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:55.189987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521acf5-e34f-49c0-a53d-cc9cf82522ca None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:55.190463 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521acf5-e34f-49c0-a53d-cc9cf82522ca None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:55.190969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521acf5-e34f-49c0-a53d-cc9cf82522ca None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:55.191888 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521acf5-e34f-49c0-a53d-cc9cf82522ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:55.192405 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521acf5-e34f-49c0-a53d-cc9cf82522ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:55.194003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521acf5-e34f-49c0-a53d-cc9cf82522ca None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-137208d0-e674-4240-98f8-f7d25edabdc5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:55.200167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:55.201133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:55.202057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:55.202057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:55.202057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:55.202057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:55.202057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:55.202057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:55.202057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:55.202057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:55.202057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:40:55.202057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:55.202057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 327/651] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:55.207386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137208d0-e674-4240-98f8-f7d25edabdc5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:55.216609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 325/652] 10.222.0.33 () {56 vars in 1137 bytes} [Sun Sep 11 00:40:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:55.217694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521acf5-e34f-49c0-a53d-cc9cf82522ca None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:55.278562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:55.327086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137208d0-e674-4240-98f8-f7d25edabdc5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:55.328511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521acf5-e34f-49c0-a53d-cc9cf82522ca None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:55.371235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce13e1-b7af-434e-ba6b-c3681a7b2e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:55.371728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec9226-8871-4f43-a559-9abe537c514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:55.372333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec9226-8871-4f43-a559-9abe537c514a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:55.372620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec9226-8871-4f43-a559-9abe537c514a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:55.372819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce13e1-b7af-434e-ba6b-c3681a7b2e5f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:55.372932 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec9226-8871-4f43-a559-9abe537c514a None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:55.373402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce13e1-b7af-434e-ba6b-c3681a7b2e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:55.373515 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec9226-8871-4f43-a559-9abe537c514a None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:55.373797 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec9226-8871-4f43-a559-9abe537c514a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:55.374063 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce13e1-b7af-434e-ba6b-c3681a7b2e5f None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:55.374958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce13e1-b7af-434e-ba6b-c3681a7b2e5f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:55.375204 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec9226-8871-4f43-a559-9abe537c514a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:55.375564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce13e1-b7af-434e-ba6b-c3681a7b2e5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:55.377110 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce13e1-b7af-434e-ba6b-c3681a7b2e5f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:55.389989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 328/653] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:55.389989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec9226-8871-4f43-a559-9abe537c514a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:55.404532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:55.405881 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 326/654] 10.222.0.33 () {56 vars in 1137 bytes} [Sun Sep 11 00:40:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:55.407074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce13e1-b7af-434e-ba6b-c3681a7b2e5f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:55.506650 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec9226-8871-4f43-a559-9abe537c514a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:55.518915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce13e1-b7af-434e-ba6b-c3681a7b2e5f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:55.535406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:55.542118 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbb545-2547-41f1-9926-c112be0e4ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:55.542851 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb545-2547-41f1-9926-c112be0e4ecb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:55.543195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb545-2547-41f1-9926-c112be0e4ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:55.543531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb545-2547-41f1-9926-c112be0e4ecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:55.560464 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27638b5-9d99-4897-a882-18703e432a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:55.561158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27638b5-9d99-4897-a882-18703e432a4e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:55.561601 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27638b5-9d99-4897-a882-18703e432a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:55.561935 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27638b5-9d99-4897-a882-18703e432a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:55.573254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27638b5-9d99-4897-a882-18703e432a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:55.575469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27638b5-9d99-4897-a882-18703e432a4e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-c27638b5-9d99-4897-a882-18703e432a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:55.592990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:55.594175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:55.595347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:55.595347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:55.595347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:55.600605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 327/655] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:55.600605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fae37-4b29-47df-8129-0d9a9b092a97 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:55.600605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fae37-4b29-47df-8129-0d9a9b092a97 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:55.600605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fae37-4b29-47df-8129-0d9a9b092a97 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:55.600605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 328/656] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:55.600605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fae37-4b29-47df-8129-0d9a9b092a97 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:55.621470 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbb545-2547-41f1-9926-c112be0e4ecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:55.623042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbb545-2547-41f1-9926-c112be0e4ecb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:55.633729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:55.713760 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fae37-4b29-47df-8129-0d9a9b092a97 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:55.731630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 329/657] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:55.733020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbb545-2547-41f1-9926-c112be0e4ecb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:55.753958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863a115-2b4c-4505-8d65-e96ed3cdc679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:55.755014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863a115-2b4c-4505-8d65-e96ed3cdc679 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:55.755292 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863a115-2b4c-4505-8d65-e96ed3cdc679 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:55.755770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863a115-2b4c-4505-8d65-e96ed3cdc679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:55.787851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:55.827736 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863a115-2b4c-4505-8d65-e96ed3cdc679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:55.829172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863a115-2b4c-4505-8d65-e96ed3cdc679 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:55.835211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbb545-2547-41f1-9926-c112be0e4ecb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:55.847093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:55.874994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9ec52-eaac-4351-9308-cf9fd9254c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:55.875604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ec52-eaac-4351-9308-cf9fd9254c9b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:55.875880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ec52-eaac-4351-9308-cf9fd9254c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:55.876142 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ec52-eaac-4351-9308-cf9fd9254c9b None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:55.876772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9ec52-eaac-4351-9308-cf9fd9254c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:55.877065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9ec52-eaac-4351-9308-cf9fd9254c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:55.878418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9ec52-eaac-4351-9308-cf9fd9254c9b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:55.890553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 330/658] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:55.896090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53fbb3-8924-46ee-9416-9fc8299669a5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:55.896377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53fbb3-8924-46ee-9416-9fc8299669a5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:55.896672 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53fbb3-8924-46ee-9416-9fc8299669a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:55.914902 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ee53fbb3-8924-46ee-9416-9fc8299669a5 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:55.916071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ee53fbb3-8924-46ee-9416-9fc8299669a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:55.938468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 329/659] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:55.939440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863a115-2b4c-4505-8d65-e96ed3cdc679 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:55.990910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 331/660] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:55.990910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53fbb3-8924-46ee-9416-9fc8299669a5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:56.013062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:56.054943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863a115-2b4c-4505-8d65-e96ed3cdc679 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:56.090664 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4a1ff-a7b0-4e6a-bbdd-3e68b134e36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:56.091566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:56.091698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4a1ff-a7b0-4e6a-bbdd-3e68b134e36e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:56.091921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4a1ff-a7b0-4e6a-bbdd-3e68b134e36e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:56.092634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4a1ff-a7b0-4e6a-bbdd-3e68b134e36e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:56.096748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53fbb3-8924-46ee-9416-9fc8299669a5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:56.104712 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4a1ff-a7b0-4e6a-bbdd-3e68b134e36e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:56.106245 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4a1ff-a7b0-4e6a-bbdd-3e68b134e36e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-3dd4a1ff-a7b0-4e6a-bbdd-3e68b134e36e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:56.121618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:56.122593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:56.124049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:56.124049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:56.124049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:56.124049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 330/661] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:56.124049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4a1ff-a7b0-4e6a-bbdd-3e68b134e36e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:56.136839 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271627-f84a-4243-904d-cf76e992ea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:56.137897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271627-f84a-4243-904d-cf76e992ea8a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:56.138367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271627-f84a-4243-904d-cf76e992ea8a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:56.138868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271627-f84a-4243-904d-cf76e992ea8a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:56.146925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271627-f84a-4243-904d-cf76e992ea8a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:56.148705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271627-f84a-4243-904d-cf76e992ea8a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-98271627-f84a-4243-904d-cf76e992ea8a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:56.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:56.163439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:56.164973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:56.164973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:56.164973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:56.164973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:56.164973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:56.164973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:56.164973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:56.164973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:56.164973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:40:56.164973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:56.167298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 332/662] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:56.168346 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271627-f84a-4243-904d-cf76e992ea8a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:56.240286 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4a1ff-a7b0-4e6a-bbdd-3e68b134e36e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:56.257386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:56.277538 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b1182-aba0-4947-b79f-f22b5692dd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:56.278274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1182-aba0-4947-b79f-f22b5692dd90 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:56.278656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1182-aba0-4947-b79f-f22b5692dd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:56.278976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1182-aba0-4947-b79f-f22b5692dd90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:56.284149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271627-f84a-4243-904d-cf76e992ea8a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:56.290313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b1182-aba0-4947-b79f-f22b5692dd90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:56.291959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b1182-aba0-4947-b79f-f22b5692dd90 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-181b1182-aba0-4947-b79f-f22b5692dd90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:56.307650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:56.308613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:56.309518 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:56.309518 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:56.309518 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:56.313275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 331/663] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:56.314512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b1182-aba0-4947-b79f-f22b5692dd90 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:56.324815 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bd8e4-0840-4767-80d0-d85b1ac08700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:56.325423 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bd8e4-0840-4767-80d0-d85b1ac08700 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:56.325705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bd8e4-0840-4767-80d0-d85b1ac08700 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:56.325974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bd8e4-0840-4767-80d0-d85b1ac08700 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:56.326617 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bd8e4-0840-4767-80d0-d85b1ac08700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:56.326950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bd8e4-0840-4767-80d0-d85b1ac08700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:56.328311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bd8e4-0840-4767-80d0-d85b1ac08700 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:56.341196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 333/664] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:56.341812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bd8e4-0840-4767-80d0-d85b1ac08700 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:56.363311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:56.432566 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b1182-aba0-4947-b79f-f22b5692dd90 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:56.454085 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bd8e4-0840-4767-80d0-d85b1ac08700 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:56.467917 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c2f09-e847-4fd2-a04e-b06714fcf5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:56.468758 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c2f09-e847-4fd2-a04e-b06714fcf5cd None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:56.469169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c2f09-e847-4fd2-a04e-b06714fcf5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:56.469576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c2f09-e847-4fd2-a04e-b06714fcf5cd None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:56.470428 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c2f09-e847-4fd2-a04e-b06714fcf5cd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:56.470926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c2f09-e847-4fd2-a04e-b06714fcf5cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:56.472569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c2f09-e847-4fd2-a04e-b06714fcf5cd None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:56.488556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d9b72-3ff5-45b9-8d41-73e7e71daae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:56.489178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d9b72-3ff5-45b9-8d41-73e7e71daae9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:56.489455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d9b72-3ff5-45b9-8d41-73e7e71daae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:56.489724 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d9b72-3ff5-45b9-8d41-73e7e71daae9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:56.490817 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 332/665] 10.222.0.33 () {56 vars in 1139 bytes} [Sun Sep 11 00:40:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:56.491955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c2f09-e847-4fd2-a04e-b06714fcf5cd None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:56.502531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d9b72-3ff5-45b9-8d41-73e7e71daae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-174d9b72-3ff5-45b9-8d41-73e7e71daae9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:56.509227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:56.510158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:56.511035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:56.511035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:56.511035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:56.511035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:56.511035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:56.511035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:56.511035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:56.511035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:56.511035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:56.511035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:56.511035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:40:56.511035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:56.515263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 334/666] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:40:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:56.516462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d9b72-3ff5-45b9-8d41-73e7e71daae9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:56.519379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:56.595878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:56.601405 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c2f09-e847-4fd2-a04e-b06714fcf5cd None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:56.618309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d9b72-3ff5-45b9-8d41-73e7e71daae9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:56.637788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431788e-e3de-401b-a23a-b813c8fb98e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:56.638390 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431788e-e3de-401b-a23a-b813c8fb98e3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:56.638673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431788e-e3de-401b-a23a-b813c8fb98e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:56.639209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431788e-e3de-401b-a23a-b813c8fb98e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:56.639597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431788e-e3de-401b-a23a-b813c8fb98e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:56.639891 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431788e-e3de-401b-a23a-b813c8fb98e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:56.641241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431788e-e3de-401b-a23a-b813c8fb98e3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:56.657167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 333/667] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:56.657167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431788e-e3de-401b-a23a-b813c8fb98e3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:56.658367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957ea4a-c9fd-4bfb-8c9d-27fe8aeec943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:56.659023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957ea4a-c9fd-4bfb-8c9d-27fe8aeec943 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:56.659298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957ea4a-c9fd-4bfb-8c9d-27fe8aeec943 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:56.660007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957ea4a-c9fd-4bfb-8c9d-27fe8aeec943 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:56.668434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957ea4a-c9fd-4bfb-8c9d-27fe8aeec943 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:56.670006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957ea4a-c9fd-4bfb-8c9d-27fe8aeec943 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8957ea4a-c9fd-4bfb-8c9d-27fe8aeec943 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:56.683296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:56.684240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:56.685139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:56.685139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:56.685139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:56.685139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:56.685139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:56.685139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:56.685139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:56.685139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:56.685139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 335/668] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:56.686286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957ea4a-c9fd-4bfb-8c9d-27fe8aeec943 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:56.760376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:56.775799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431788e-e3de-401b-a23a-b813c8fb98e3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:56.805085 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957ea4a-c9fd-4bfb-8c9d-27fe8aeec943 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:56.810961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478c4be-c260-4b73-9493-3afdc2952aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:56.811564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c4be-c260-4b73-9493-3afdc2952aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:56.811840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c4be-c260-4b73-9493-3afdc2952aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:56.812129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c4be-c260-4b73-9493-3afdc2952aa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:56.840431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94235e-c10e-47e7-a47a-6b19795d1a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:56.841029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94235e-c10e-47e7-a47a-6b19795d1a71 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:56.841302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94235e-c10e-47e7-a47a-6b19795d1a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:56.841564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94235e-c10e-47e7-a47a-6b19795d1a71 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:56.842316 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94235e-c10e-47e7-a47a-6b19795d1a71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:56.842615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94235e-c10e-47e7-a47a-6b19795d1a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:56.844088 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94235e-c10e-47e7-a47a-6b19795d1a71 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:56.849351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:56.858224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 336/669] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:40:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:56.858987 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94235e-c10e-47e7-a47a-6b19795d1a71 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:56.885491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478c4be-c260-4b73-9493-3afdc2952aa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:56.887285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478c4be-c260-4b73-9493-3afdc2952aa1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:56.963680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94235e-c10e-47e7-a47a-6b19795d1a71 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:56.976457 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:56.997953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 334/670] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:56.997953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478c4be-c260-4b73-9493-3afdc2952aa1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:57.006844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef1cf0-4b58-4bcb-89ec-fb0a42f28810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:57.007893 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef1cf0-4b58-4bcb-89ec-fb0a42f28810 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:57.008170 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef1cf0-4b58-4bcb-89ec-fb0a42f28810 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:57.008740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef1cf0-4b58-4bcb-89ec-fb0a42f28810 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:57.015699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef1cf0-4b58-4bcb-89ec-fb0a42f28810 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:57.017142 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef1cf0-4b58-4bcb-89ec-fb0a42f28810 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-13ef1cf0-4b58-4bcb-89ec-fb0a42f28810 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:57.035115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:57.036139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:57.037031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:57.037031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:57.037031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:57.037031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:57.037031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:57.037031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:57.037031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:57.037031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:57.037031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 337/671] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:57.038185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef1cf0-4b58-4bcb-89ec-fb0a42f28810 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:57.108027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:57.118324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478c4be-c260-4b73-9493-3afdc2952aa1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:57.154147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef1cf0-4b58-4bcb-89ec-fb0a42f28810 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:57.155663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b437f9-55aa-43b8-ae52-4dfa8c63051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:57.156261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b437f9-55aa-43b8-ae52-4dfa8c63051a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:57.156540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b437f9-55aa-43b8-ae52-4dfa8c63051a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:57.156810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b437f9-55aa-43b8-ae52-4dfa8c63051a None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:57.157508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b437f9-55aa-43b8-ae52-4dfa8c63051a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:57.157808 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b437f9-55aa-43b8-ae52-4dfa8c63051a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:57.159259 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b437f9-55aa-43b8-ae52-4dfa8c63051a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:57.171290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 335/672] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:57.172075 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b437f9-55aa-43b8-ae52-4dfa8c63051a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:57.193880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b305188-b447-4471-aabf-67870d474700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:57.194498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b305188-b447-4471-aabf-67870d474700 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:57.194821 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b305188-b447-4471-aabf-67870d474700 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:57.195090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b305188-b447-4471-aabf-67870d474700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:57.205240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b305188-b447-4471-aabf-67870d474700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:57.206660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b305188-b447-4471-aabf-67870d474700 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:57.217517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2b305188-b447-4471-aabf-67870d474700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:57.221165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:57.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:57.223292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:57.223292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:57.223292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:57.223292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 338/673] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:57.223292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b305188-b447-4471-aabf-67870d474700 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:57.270311 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b437f9-55aa-43b8-ae52-4dfa8c63051a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:57.303470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bee36-ba42-47ad-9bf1-a06ce3cce520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:57.304103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bee36-ba42-47ad-9bf1-a06ce3cce520 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:57.304376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bee36-ba42-47ad-9bf1-a06ce3cce520 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:57.304638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bee36-ba42-47ad-9bf1-a06ce3cce520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:57.315044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bee36-ba42-47ad-9bf1-a06ce3cce520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:57.316631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bee36-ba42-47ad-9bf1-a06ce3cce520 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:57.321402 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b305188-b447-4471-aabf-67870d474700 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-427bee36-ba42-47ad-9bf1-a06ce3cce520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:57.330615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:57.331791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:57.333362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:57.333362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:57.333362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:57.333362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 336/674] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:57.333362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd372de-5f9c-4aae-8189-9a8f517db4d3 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:57.333362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd372de-5f9c-4aae-8189-9a8f517db4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:57.333362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd372de-5f9c-4aae-8189-9a8f517db4d3 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:57.334604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 337/675] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:40:57.335157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd372de-5f9c-4aae-8189-9a8f517db4d3 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:57.337968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:57.359784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ea697-abf6-43e4-bbab-9a69da4a12bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:57.360312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ea697-abf6-43e4-bbab-9a69da4a12bf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:57.360584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ea697-abf6-43e4-bbab-9a69da4a12bf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:57.360845 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ea697-abf6-43e4-bbab-9a69da4a12bf None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:57.361519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ea697-abf6-43e4-bbab-9a69da4a12bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:57.361814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ea697-abf6-43e4-bbab-9a69da4a12bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:57.363256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ea697-abf6-43e4-bbab-9a69da4a12bf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:57.374897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 339/676] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:57.375677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ea697-abf6-43e4-bbab-9a69da4a12bf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:57.441521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:57.446342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd372de-5f9c-4aae-8189-9a8f517db4d3 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:57.478129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ea697-abf6-43e4-bbab-9a69da4a12bf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:57.480206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ad602-5968-4e02-926a-a72ad8cc1658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:57.480800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ad602-5968-4e02-926a-a72ad8cc1658 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:57.481076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ad602-5968-4e02-926a-a72ad8cc1658 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:57.481345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ad602-5968-4e02-926a-a72ad8cc1658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:57.482064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ad602-5968-4e02-926a-a72ad8cc1658 None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=f0dfdb9054ac4fef97d8e30aa5a8bd66) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:57.482368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ad602-5968-4e02-926a-a72ad8cc1658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:57.483813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ad602-5968-4e02-926a-a72ad8cc1658 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:57.489428 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 338/677] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:57 2022] GET /identity/v3/role_assignments?user.id=f0dfdb9054ac4fef97d8e30aa5a8bd66&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:57.490193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ad602-5968-4e02-926a-a72ad8cc1658 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:57.513624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90ffb6-cc8a-46c2-abfb-ad042c1a599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:57.514264 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90ffb6-cc8a-46c2-abfb-ad042c1a599f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:57.514541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90ffb6-cc8a-46c2-abfb-ad042c1a599f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:57.514842 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90ffb6-cc8a-46c2-abfb-ad042c1a599f None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:57.515504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90ffb6-cc8a-46c2-abfb-ad042c1a599f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:57.515810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90ffb6-cc8a-46c2-abfb-ad042c1a599f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:57.517252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90ffb6-cc8a-46c2-abfb-ad042c1a599f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:57.535182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 340/678] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:57.535182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb98ad2-ab1a-4cda-832f-d214e2dd2c59 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:57.535182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb98ad2-ab1a-4cda-832f-d214e2dd2c59 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:57.535182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb98ad2-ab1a-4cda-832f-d214e2dd2c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:57.551855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4cb98ad2-ab1a-4cda-832f-d214e2dd2c59 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:40:57.553120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4cb98ad2-ab1a-4cda-832f-d214e2dd2c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:40:57.581482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:57.616699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ad602-5968-4e02-926a-a72ad8cc1658 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:57.642768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 341/679] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:40:57.642768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb98ad2-ab1a-4cda-832f-d214e2dd2c59 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:57.654592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894423ef-cd75-4c2c-b934-0f03fd0a77f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:57.655322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894423ef-cd75-4c2c-b934-0f03fd0a77f3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:57.655689 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894423ef-cd75-4c2c-b934-0f03fd0a77f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:57.656017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894423ef-cd75-4c2c-b934-0f03fd0a77f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:57.657816 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894423ef-cd75-4c2c-b934-0f03fd0a77f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:57.658186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894423ef-cd75-4c2c-b934-0f03fd0a77f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:57.659639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894423ef-cd75-4c2c-b934-0f03fd0a77f3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:57.674232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 339/680] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:57.674944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894423ef-cd75-4c2c-b934-0f03fd0a77f3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:57.713227 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:57.776087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb98ad2-ab1a-4cda-832f-d214e2dd2c59 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:57.812706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894423ef-cd75-4c2c-b934-0f03fd0a77f3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:57.821911 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7647d8b-849f-4ec2-9f52-4fc0013c2643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:57.822557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7647d8b-849f-4ec2-9f52-4fc0013c2643 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:57.822870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7647d8b-849f-4ec2-9f52-4fc0013c2643 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:57.823168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7647d8b-849f-4ec2-9f52-4fc0013c2643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:57.824085 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7647d8b-849f-4ec2-9f52-4fc0013c2643 None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=7ecc9e16475344b78bb885437b5d6bec) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:57.824270 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7647d8b-849f-4ec2-9f52-4fc0013c2643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:57.825681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7647d8b-849f-4ec2-9f52-4fc0013c2643 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:57.832093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 342/681] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:57 2022] GET /identity/v3/role_assignments?user.id=7ecc9e16475344b78bb885437b5d6bec&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:57.832899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7647d8b-849f-4ec2-9f52-4fc0013c2643 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:57.865994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dc364-fc1c-470d-8183-fe4d38d3ac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:57.867391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dc364-fc1c-470d-8183-fe4d38d3ac9a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:57.867611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dc364-fc1c-470d-8183-fe4d38d3ac9a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:57.867882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dc364-fc1c-470d-8183-fe4d38d3ac9a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:57.871990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:57.887746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170dc364-fc1c-470d-8183-fe4d38d3ac9a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:57.889206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170dc364-fc1c-470d-8183-fe4d38d3ac9a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-170dc364-fc1c-470d-8183-fe4d38d3ac9a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:57.918014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:57.919071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:57.920742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:57.920742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:57.920742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:57.920742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:57.920742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:57.920742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:57.920742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:57.920742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:57.920742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:40:57.920742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:57.920742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 340/682] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:40:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:57.925962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dc364-fc1c-470d-8183-fe4d38d3ac9a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:58.002709 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7647d8b-849f-4ec2-9f52-4fc0013c2643 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:58.019952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:58.040938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dc364-fc1c-470d-8183-fe4d38d3ac9a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:58.054608 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2db0b-e850-421e-86c6-9da985f4245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:58.055292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2db0b-e850-421e-86c6-9da985f4245c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:58.055571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2db0b-e850-421e-86c6-9da985f4245c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:58.055842 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2db0b-e850-421e-86c6-9da985f4245c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:58.064394 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2db0b-e850-421e-86c6-9da985f4245c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:58.065855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2db0b-e850-421e-86c6-9da985f4245c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2aa2db0b-e850-421e-86c6-9da985f4245c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:58.079080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:58.080219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:58.081533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:58.081533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:58.081533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:58.081533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:58.081533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:58.081533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:58.081533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:58.081533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:58.081533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 343/683] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:58.081533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2db0b-e850-421e-86c6-9da985f4245c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:58.088871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b0c20-4ecf-48a3-93db-b429b2ae2928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:58.089971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b0c20-4ecf-48a3-93db-b429b2ae2928 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:58.089971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b0c20-4ecf-48a3-93db-b429b2ae2928 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:58.090161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b0c20-4ecf-48a3-93db-b429b2ae2928 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:58.091738 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b0c20-4ecf-48a3-93db-b429b2ae2928 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:58.091738 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b0c20-4ecf-48a3-93db-b429b2ae2928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:58.092582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b0c20-4ecf-48a3-93db-b429b2ae2928 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:58.113104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 341/684] 10.222.0.33 () {56 vars in 1135 bytes} [Sun Sep 11 00:40:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:58.114026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b0c20-4ecf-48a3-93db-b429b2ae2928 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:58.183778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:58.196718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2db0b-e850-421e-86c6-9da985f4245c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:58.232227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480082a-2186-4e6b-9edb-921abe8ecaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:58.233183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480082a-2186-4e6b-9edb-921abe8ecaf7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:58.233466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480082a-2186-4e6b-9edb-921abe8ecaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:58.233823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480082a-2186-4e6b-9edb-921abe8ecaf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:58.240592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b0c20-4ecf-48a3-93db-b429b2ae2928 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:58.244622 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480082a-2186-4e6b-9edb-921abe8ecaf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8480082a-2186-4e6b-9edb-921abe8ecaf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:40:58.250031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:58.251009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:58.251840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:58.251840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:58.251840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:58.251840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:58.251840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:40:58.251840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:40:58.251840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:40:58.251840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:40:58.251840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:40:58.251840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:40:58.251840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:40:58.251840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:58.251840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 344/685] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:40:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:58.252538 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480082a-2186-4e6b-9edb-921abe8ecaf7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:58.285449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d1f70-f748-4078-92c6-23412254c5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:58.286206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d1f70-f748-4078-92c6-23412254c5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:58.286610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d1f70-f748-4078-92c6-23412254c5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:58.286915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d1f70-f748-4078-92c6-23412254c5f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:58.287914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d1f70-f748-4078-92c6-23412254c5f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:58.288628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d1f70-f748-4078-92c6-23412254c5f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:58.290354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d1f70-f748-4078-92c6-23412254c5f8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:58.301840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:58.306087 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 342/686] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:58.307843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d1f70-f748-4078-92c6-23412254c5f8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:58.369729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480082a-2186-4e6b-9edb-921abe8ecaf7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:58.408074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e5546-6792-4711-b919-6a2d93f4051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:58.409008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e5546-6792-4711-b919-6a2d93f4051c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:58.409490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e5546-6792-4711-b919-6a2d93f4051c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:58.409906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e5546-6792-4711-b919-6a2d93f4051c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:58.429953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:58.453731 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d1f70-f748-4078-92c6-23412254c5f8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:58.492744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424da15e-89dc-48ae-8fc8-b6d760db0083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:58.493621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424da15e-89dc-48ae-8fc8-b6d760db0083 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:58.494086 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424da15e-89dc-48ae-8fc8-b6d760db0083 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:58.494572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424da15e-89dc-48ae-8fc8-b6d760db0083 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:58.495630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424da15e-89dc-48ae-8fc8-b6d760db0083 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:58.496207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424da15e-89dc-48ae-8fc8-b6d760db0083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:58.497784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424da15e-89dc-48ae-8fc8-b6d760db0083 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:58.507334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e5546-6792-4711-b919-6a2d93f4051c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:58.508400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 343/687] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:40:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:58.508933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e5546-6792-4711-b919-6a2d93f4051c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:58.509698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424da15e-89dc-48ae-8fc8-b6d760db0083 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:58.578929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:58.625144 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424da15e-89dc-48ae-8fc8-b6d760db0083 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:58.646038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 345/688] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:40:58.647543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e5546-6792-4711-b919-6a2d93f4051c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:58.671005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1945d9-d9cd-4ffc-9dee-37a491a658ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:58.672020 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1945d9-d9cd-4ffc-9dee-37a491a658ca None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:58.673044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1945d9-d9cd-4ffc-9dee-37a491a658ca None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:58.673543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1945d9-d9cd-4ffc-9dee-37a491a658ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:58.674703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1945d9-d9cd-4ffc-9dee-37a491a658ca None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=c45d8e2b0b674e9a814167db4d78749e) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:58.675492 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1945d9-d9cd-4ffc-9dee-37a491a658ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:58.677923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1945d9-d9cd-4ffc-9dee-37a491a658ca None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:58.688228 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 344/689] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:58 2022] GET /identity/v3/role_assignments?user.id=c45d8e2b0b674e9a814167db4d78749e&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:58.689258 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1945d9-d9cd-4ffc-9dee-37a491a658ca None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:58.718378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:58.815587 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1945d9-d9cd-4ffc-9dee-37a491a658ca None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:58.837270 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e5546-6792-4711-b919-6a2d93f4051c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:58.850510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:58.865228 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6b052-7ea6-4e8b-a011-6fd3f64feb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:58.865902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6b052-7ea6-4e8b-a011-6fd3f64feb2d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:58.866177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6b052-7ea6-4e8b-a011-6fd3f64feb2d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:58.866443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6b052-7ea6-4e8b-a011-6fd3f64feb2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:58.895410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6b052-7ea6-4e8b-a011-6fd3f64feb2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:58.896959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6b052-7ea6-4e8b-a011-6fd3f64feb2d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:58.899419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2da36-c997-4bde-b480-41b9806429d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:58.900067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2da36-c997-4bde-b480-41b9806429d7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:58.900339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2da36-c997-4bde-b480-41b9806429d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:58.900603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2da36-c997-4bde-b480-41b9806429d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:58.921775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2da36-c997-4bde-b480-41b9806429d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:58.923290 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2da36-c997-4bde-b480-41b9806429d7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-64d6b052-7ea6-4e8b-a011-6fd3f64feb2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:58.928898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:58.929915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:58.930869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:58.930869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:58.930869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:58.938348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 345/690] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-64f2da36-c997-4bde-b480-41b9806429d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:40:58.951456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:58.952536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:40:58.953450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:40:58.953450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:40:58.953450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:58.953450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 346/691] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:58.954759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6b052-7ea6-4e8b-a011-6fd3f64feb2d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:58.958026 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2da36-c997-4bde-b480-41b9806429d7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:59.075536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6b052-7ea6-4e8b-a011-6fd3f64feb2d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:59.079049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:59.084336 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2da36-c997-4bde-b480-41b9806429d7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:59.112625 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44171e5-9eb4-422b-ae02-0146714891d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:59.113232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44171e5-9eb4-422b-ae02-0146714891d6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:59.113508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44171e5-9eb4-422b-ae02-0146714891d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:59.113774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44171e5-9eb4-422b-ae02-0146714891d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:59.114438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44171e5-9eb4-422b-ae02-0146714891d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:59.114757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44171e5-9eb4-422b-ae02-0146714891d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:59.116195 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44171e5-9eb4-422b-ae02-0146714891d6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:59.131702 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 346/692] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:59.137183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807437ec-646f-4477-882d-05cc22daba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:59.137810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807437ec-646f-4477-882d-05cc22daba69 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:59.138088 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807437ec-646f-4477-882d-05cc22daba69 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:59.138362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807437ec-646f-4477-882d-05cc22daba69 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:59.139037 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807437ec-646f-4477-882d-05cc22daba69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:59.140220 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44171e5-9eb4-422b-ae02-0146714891d6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:59.140719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807437ec-646f-4477-882d-05cc22daba69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:59.142096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807437ec-646f-4477-882d-05cc22daba69 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:59.159348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 347/693] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:59.163087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807437ec-646f-4477-882d-05cc22daba69 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:59.199485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:59.293031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807437ec-646f-4477-882d-05cc22daba69 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:59.331794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513762d-dac7-41d9-9556-11ed80be4944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:59.332729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513762d-dac7-41d9-9556-11ed80be4944 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:59.333020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513762d-dac7-41d9-9556-11ed80be4944 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:59.333297 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513762d-dac7-41d9-9556-11ed80be4944 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:59.341733 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513762d-dac7-41d9-9556-11ed80be4944 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:59.343386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513762d-dac7-41d9-9556-11ed80be4944 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c513762d-dac7-41d9-9556-11ed80be4944 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:40:59.356405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:59.357384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:59.358306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:59.358306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:59.358306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:40:59.358306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:40:59.358306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:40:59.358306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:40:59.358306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:40:59.358306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:40:59.358306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:40:59.358306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:40:59.358306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 348/694] 10.222.0.33 () {56 vars in 1093 bytes} [Sun Sep 11 00:40:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:59.363390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513762d-dac7-41d9-9556-11ed80be4944 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:59.376663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44171e5-9eb4-422b-ae02-0146714891d6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:59.392031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:59.453927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bb67d-a1a2-4a3d-84cf-a5fb0ee8c2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:59.454483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bb67d-a1a2-4a3d-84cf-a5fb0ee8c2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:59.454775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bb67d-a1a2-4a3d-84cf-a5fb0ee8c2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:59.455046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bb67d-a1a2-4a3d-84cf-a5fb0ee8c2d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:59.469524 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bb67d-a1a2-4a3d-84cf-a5fb0ee8c2d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:59.471007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bb67d-a1a2-4a3d-84cf-a5fb0ee8c2d1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a56bb67d-a1a2-4a3d-84cf-a5fb0ee8c2d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:40:59.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:40:59.489990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:40:59.491481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:40:59.491481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:40:59.491481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:40:59.491481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:40:59.491481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:40:59.491481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:40:59.491481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:40:59.491481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:40:59.492526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 347/695] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:40:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:40:59.499699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bb67d-a1a2-4a3d-84cf-a5fb0ee8c2d1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:59.539080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513762d-dac7-41d9-9556-11ed80be4944 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:59.628368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2bb03-7942-4e2c-bd5b-2d059e6363e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:59.628992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2bb03-7942-4e2c-bd5b-2d059e6363e8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:59.629268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2bb03-7942-4e2c-bd5b-2d059e6363e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:59.629534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2bb03-7942-4e2c-bd5b-2d059e6363e8 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:59.630266 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2bb03-7942-4e2c-bd5b-2d059e6363e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:59.630569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2bb03-7942-4e2c-bd5b-2d059e6363e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:59.632568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2bb03-7942-4e2c-bd5b-2d059e6363e8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:59.634767 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bb67d-a1a2-4a3d-84cf-a5fb0ee8c2d1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:59.638979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:59.660764 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 349/696] 10.222.0.33 () {56 vars in 1133 bytes} [Sun Sep 11 00:40:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:59.666767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2bb03-7942-4e2c-bd5b-2d059e6363e8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:59.686093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b024d-dee2-4407-88b2-c30bad9385ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:59.686987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b024d-dee2-4407-88b2-c30bad9385ef None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:59.687356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b024d-dee2-4407-88b2-c30bad9385ef None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:59.687715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b024d-dee2-4407-88b2-c30bad9385ef None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:59.688490 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b024d-dee2-4407-88b2-c30bad9385ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:59.688885 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b024d-dee2-4407-88b2-c30bad9385ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:59.690398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b024d-dee2-4407-88b2-c30bad9385ef None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:59.703416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 348/697] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:40:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:59.709325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b024d-dee2-4407-88b2-c30bad9385ef None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:40:59.809272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:40:59.853875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2bb03-7942-4e2c-bd5b-2d059e6363e8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:59.899929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b024d-dee2-4407-88b2-c30bad9385ef None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:40:59.929527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934055a1-d93d-4b13-8f8c-b67b805fcca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:59.930147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934055a1-d93d-4b13-8f8c-b67b805fcca9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:59.930424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934055a1-d93d-4b13-8f8c-b67b805fcca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:59.930695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934055a1-d93d-4b13-8f8c-b67b805fcca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:59.963438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b6316-c684-4c52-939f-b30d1807738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:40:59.964056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b6316-c684-4c52-939f-b30d1807738f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:59.964335 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b6316-c684-4c52-939f-b30d1807738f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:59.964603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b6316-c684-4c52-939f-b30d1807738f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:59.965327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b6316-c684-4c52-939f-b30d1807738f None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=e8baa8033f884cb6a7783f78c01a212e) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:40:59.965633 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b6316-c684-4c52-939f-b30d1807738f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:40:59.967248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b6316-c684-4c52-939f-b30d1807738f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:40:59.973925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 349/698] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:40:59 2022] GET /identity/v3/role_assignments?user.id=e8baa8033f884cb6a7783f78c01a212e&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:40:59.986403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dbd47-b970-4fd1-b466-bf506e0d9a1f None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:59.986720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dbd47-b970-4fd1-b466-bf506e0d9a1f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:59.986990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dbd47-b970-4fd1-b466-bf506e0d9a1f None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:40:59.988591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 350/699] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:40:59.995815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d65ec-63ef-45a1-8873-1691bd55fc47 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:40:59.996377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d65ec-63ef-45a1-8873-1691bd55fc47 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:40:59.996828 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d65ec-63ef-45a1-8873-1691bd55fc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:00.034968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934055a1-d93d-4b13-8f8c-b67b805fcca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:00.036574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934055a1-d93d-4b13-8f8c-b67b805fcca9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:00.042894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d15d65ec-63ef-45a1-8873-1691bd55fc47 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:00.044375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d15d65ec-63ef-45a1-8873-1691bd55fc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:00.075656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:00.127275 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:00.148749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 350/700] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:40:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:41:00.154380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934055a1-d93d-4b13-8f8c-b67b805fcca9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:00.181338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 351/701] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:41:00.265128 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934055a1-d93d-4b13-8f8c-b67b805fcca9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:00.302966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216801bd-b76b-4b11-a00b-a4bcf97294fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:00.303615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216801bd-b76b-4b11-a00b-a4bcf97294fc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:00.303894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216801bd-b76b-4b11-a00b-a4bcf97294fc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:00.304165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216801bd-b76b-4b11-a00b-a4bcf97294fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:00.315411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216801bd-b76b-4b11-a00b-a4bcf97294fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:00.316886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216801bd-b76b-4b11-a00b-a4bcf97294fc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-216801bd-b76b-4b11-a00b-a4bcf97294fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:00.332802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:00.334457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:00.335631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:00.335631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:00.335631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:00.335631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 351/702] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:00.339004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3a88-f73a-40f7-93a0-c96b9cdf2e0f None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:00.339249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3a88-f73a-40f7-93a0-c96b9cdf2e0f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:00.339515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3a88-f73a-40f7-93a0-c96b9cdf2e0f None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:00.341078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 352/703] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:00.343956 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216801bd-b76b-4b11-a00b-a4bcf97294fc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:00.346135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b184b-69bf-410f-b376-c7b15e22a760 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:00.346414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b184b-69bf-410f-b376-c7b15e22a760 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:00.346687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b184b-69bf-410f-b376-c7b15e22a760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:00.377586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c28b184b-69bf-410f-b376-c7b15e22a760 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:00.378792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c28b184b-69bf-410f-b376-c7b15e22a760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:00.389022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:00.477698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 353/704] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:41:00.486711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216801bd-b76b-4b11-a00b-a4bcf97294fc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:00.523664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb927816-fb06-4a0e-9d1a-a2a7d2c1c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:00.524198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb927816-fb06-4a0e-9d1a-a2a7d2c1c82a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:00.524480 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb927816-fb06-4a0e-9d1a-a2a7d2c1c82a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:00.524752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb927816-fb06-4a0e-9d1a-a2a7d2c1c82a None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:00.525391 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb927816-fb06-4a0e-9d1a-a2a7d2c1c82a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:00.525692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb927816-fb06-4a0e-9d1a-a2a7d2c1c82a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:00.527199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb927816-fb06-4a0e-9d1a-a2a7d2c1c82a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:00.530469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b184b-69bf-410f-b376-c7b15e22a760 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:00.542072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 352/705] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:00.547873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb927816-fb06-4a0e-9d1a-a2a7d2c1c82a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:00.636722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:00.658119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:00.666754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b184b-69bf-410f-b376-c7b15e22a760 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:00.681483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb927816-fb06-4a0e-9d1a-a2a7d2c1c82a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:00.714768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f77e6-4389-4fe6-84cd-7851942ee576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:00.716051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f77e6-4389-4fe6-84cd-7851942ee576 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:00.716981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f77e6-4389-4fe6-84cd-7851942ee576 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:00.717706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f77e6-4389-4fe6-84cd-7851942ee576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:00.724686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea57a95-34ab-4398-8469-09cfab7aef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:00.725383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea57a95-34ab-4398-8469-09cfab7aef54 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:00.725766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea57a95-34ab-4398-8469-09cfab7aef54 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:00.726116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea57a95-34ab-4398-8469-09cfab7aef54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:00.731205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f77e6-4389-4fe6-84cd-7851942ee576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:00.733133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f77e6-4389-4fe6-84cd-7851942ee576 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:00.734524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea57a95-34ab-4398-8469-09cfab7aef54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:00.736357 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea57a95-34ab-4398-8469-09cfab7aef54 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-bea57a95-34ab-4398-8469-09cfab7aef54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:00.749070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:00.749980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:00.750898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:00.750898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:00.750898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:00.750898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:00.750898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:00.750898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:00.750898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:00.750898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:00.750898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 353/706] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-920f77e6-4389-4fe6-84cd-7851942ee576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:00.752289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:00.753169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:00.754052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:00.754052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:00.754052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:00.754052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 354/707] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:00.756106 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea57a95-34ab-4398-8469-09cfab7aef54 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:00.759052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f77e6-4389-4fe6-84cd-7851942ee576 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:00.867682 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f77e6-4389-4fe6-84cd-7851942ee576 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:00.883079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea57a95-34ab-4398-8469-09cfab7aef54 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:00.910775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d241f7-60f3-49e5-ab12-051e3da10d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:00.910775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d241f7-60f3-49e5-ab12-051e3da10d12 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:00.910775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d241f7-60f3-49e5-ab12-051e3da10d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:00.910775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d241f7-60f3-49e5-ab12-051e3da10d12 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:00.911273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d241f7-60f3-49e5-ab12-051e3da10d12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:00.911722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d241f7-60f3-49e5-ab12-051e3da10d12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:00.913278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d241f7-60f3-49e5-ab12-051e3da10d12 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:00.915801 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:00.923731 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00a8f1-fe07-4630-b1c5-8b7728ea41e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:00.924433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00a8f1-fe07-4630-b1c5-8b7728ea41e2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:00.924794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00a8f1-fe07-4630-b1c5-8b7728ea41e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:00.925610 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00a8f1-fe07-4630-b1c5-8b7728ea41e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:00.926382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00a8f1-fe07-4630-b1c5-8b7728ea41e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:00.927304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00a8f1-fe07-4630-b1c5-8b7728ea41e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:00.929724 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00a8f1-fe07-4630-b1c5-8b7728ea41e2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:00.935797 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 355/708] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:00.937020 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d241f7-60f3-49e5-ab12-051e3da10d12 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:00.949102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 354/709] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:00.950405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00a8f1-fe07-4630-b1c5-8b7728ea41e2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:00.963539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:01.056428 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d241f7-60f3-49e5-ab12-051e3da10d12 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:01.080518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00a8f1-fe07-4630-b1c5-8b7728ea41e2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:01.102455 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f6279-1a87-4776-8685-f56f26f5cfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:01.103430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f6279-1a87-4776-8685-f56f26f5cfe8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:01.103907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f6279-1a87-4776-8685-f56f26f5cfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:01.104793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f6279-1a87-4776-8685-f56f26f5cfe8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:01.105869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f6279-1a87-4776-8685-f56f26f5cfe8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:01.107550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f6279-1a87-4776-8685-f56f26f5cfe8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:01.119186 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd1d72-2bf4-4bc2-818d-fef0fde5889a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:01.119721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd1d72-2bf4-4bc2-818d-fef0fde5889a None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:01.119998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd1d72-2bf4-4bc2-818d-fef0fde5889a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:01.120267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd1d72-2bf4-4bc2-818d-fef0fde5889a None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:01.120907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd1d72-2bf4-4bc2-818d-fef0fde5889a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a15f6279-1a87-4776-8685-f56f26f5cfe8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:01.121452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:01.122466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:41:01.123352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:01.124077 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd1d72-2bf4-4bc2-818d-fef0fde5889a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:01.131666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 356/710] 10.222.0.33 () {56 vars in 1129 bytes} [Sun Sep 11 00:41:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:01.133705 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f6279-1a87-4776-8685-f56f26f5cfe8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:01.154752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 355/711] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:41:00 2022] POST /identity/v3/users => generated 254 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:01.154752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd1d72-2bf4-4bc2-818d-fef0fde5889a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:01.219105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:01.270147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f6279-1a87-4776-8685-f56f26f5cfe8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:01.314046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e72eff-cca3-4b85-a7e0-cfaf7bd54eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:01.314676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e72eff-cca3-4b85-a7e0-cfaf7bd54eac None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:01.315077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e72eff-cca3-4b85-a7e0-cfaf7bd54eac None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:01.315356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e72eff-cca3-4b85-a7e0-cfaf7bd54eac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:01.316481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e72eff-cca3-4b85-a7e0-cfaf7bd54eac None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=ab5f197fb09e422997434a1b2feb4567) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:01.316797 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e72eff-cca3-4b85-a7e0-cfaf7bd54eac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:01.319098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e72eff-cca3-4b85-a7e0-cfaf7bd54eac None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:01.334774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:01.335018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 357/712] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:41:01 2022] GET /identity/v3/role_assignments?user.id=ab5f197fb09e422997434a1b2feb4567&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:01.374454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd1d72-2bf4-4bc2-818d-fef0fde5889a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:01.417925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae97988-0606-47b1-bf54-4bb46479ca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:01.418551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae97988-0606-47b1-bf54-4bb46479ca7f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:01.418860 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae97988-0606-47b1-bf54-4bb46479ca7f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:01.419133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae97988-0606-47b1-bf54-4bb46479ca7f None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:01.419770 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae97988-0606-47b1-bf54-4bb46479ca7f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:01.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae97988-0606-47b1-bf54-4bb46479ca7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:01.421515 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae97988-0606-47b1-bf54-4bb46479ca7f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:01.426786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 356/713] 10.222.0.33 () {56 vars in 1124 bytes} [Sun Sep 11 00:41:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:01.435499 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e72eff-cca3-4b85-a7e0-cfaf7bd54eac None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:01.500795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed9e8d-5332-4669-ab28-a3fdcc70c433 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:01.501082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed9e8d-5332-4669-ab28-a3fdcc70c433 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:01.501357 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed9e8d-5332-4669-ab28-a3fdcc70c433 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:01.502964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 357/714] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:01.510109 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b9024-85d6-464d-9b57-0caf0c405b8b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:01.510391 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b9024-85d6-464d-9b57-0caf0c405b8b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:01.510678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b9024-85d6-464d-9b57-0caf0c405b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:01.532690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f52b9024-85d6-464d-9b57-0caf0c405b8b None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:01.533967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f52b9024-85d6-464d-9b57-0caf0c405b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:01.566026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e72eff-cca3-4b85-a7e0-cfaf7bd54eac None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:01.605105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:01.624262 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fd9f9-35a1-445f-a458-e3937c286b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:01.624936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fd9f9-35a1-445f-a458-e3937c286b59 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:01.625149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fd9f9-35a1-445f-a458-e3937c286b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:01.625412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fd9f9-35a1-445f-a458-e3937c286b59 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:01.626025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fd9f9-35a1-445f-a458-e3937c286b59 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:01.626326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fd9f9-35a1-445f-a458-e3937c286b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:01.627715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fd9f9-35a1-445f-a458-e3937c286b59 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:01.634466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 358/715] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:41:01.635649 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 358/716] 10.222.0.33 () {56 vars in 1124 bytes} [Sun Sep 11 00:41:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:01.941742 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b9024-85d6-464d-9b57-0caf0c405b8b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:02.014543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:02.070887 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b9024-85d6-464d-9b57-0caf0c405b8b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:02.116987 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa729e7-dd98-4eae-96f3-88be9717078d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:02.117620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa729e7-dd98-4eae-96f3-88be9717078d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:02.117895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa729e7-dd98-4eae-96f3-88be9717078d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:02.118164 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa729e7-dd98-4eae-96f3-88be9717078d None admin] PATH_INFO: `/v3/services/network` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:02.118751 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa729e7-dd98-4eae-96f3-88be9717078d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:02.120120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa729e7-dd98-4eae-96f3-88be9717078d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-dfa729e7-dd98-4eae-96f3-88be9717078d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:02.133968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:02.135048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:02.136504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 359/717] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:01 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:02.141093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fd9f9-35a1-445f-a458-e3937c286b59 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:02.279383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fd9f9-35a1-445f-a458-e3937c286b59 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:02.318579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7433bd0-fdaa-4c7f-92c0-3a3efe0afe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:02.319236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433bd0-fdaa-4c7f-92c0-3a3efe0afe7a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:02.319518 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433bd0-fdaa-4c7f-92c0-3a3efe0afe7a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:02.319789 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433bd0-fdaa-4c7f-92c0-3a3efe0afe7a None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:02.320425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7433bd0-fdaa-4c7f-92c0-3a3efe0afe7a None admin] RBAC: Adding query filter params (name=network) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:02.320727 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7433bd0-fdaa-4c7f-92c0-3a3efe0afe7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:02.322084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7433bd0-fdaa-4c7f-92c0-3a3efe0afe7a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:02.327147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 359/718] 10.222.0.33 () {56 vars in 1112 bytes} [Sun Sep 11 00:41:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:02.332456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa729e7-dd98-4eae-96f3-88be9717078d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:02.500222 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa729e7-dd98-4eae-96f3-88be9717078d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:02.538002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:02.550717 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2951ae-5f32-4775-881d-9f33a8a3b08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:02.551982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2951ae-5f32-4775-881d-9f33a8a3b08e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:02.552264 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2951ae-5f32-4775-881d-9f33a8a3b08e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:02.552596 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2951ae-5f32-4775-881d-9f33a8a3b08e None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:02.553304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2951ae-5f32-4775-881d-9f33a8a3b08e None admin] RBAC: Adding query filter params (type=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:02.553607 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2951ae-5f32-4775-881d-9f33a8a3b08e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:02.555124 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2951ae-5f32-4775-881d-9f33a8a3b08e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:02.568384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 360/719] 10.222.0.33 () {56 vars in 1112 bytes} [Sun Sep 11 00:41:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:03.005831 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf52b4-f36a-4c1c-a880-a9dc4ad94f20 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:03.006360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf52b4-f36a-4c1c-a880-a9dc4ad94f20 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:03.006360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf52b4-f36a-4c1c-a880-a9dc4ad94f20 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:03.008802 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 360/720] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:03.015232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9435dd3-71e3-4990-86b2-2e07242c0796 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:03.016090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9435dd3-71e3-4990-86b2-2e07242c0796 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:03.016638 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9435dd3-71e3-4990-86b2-2e07242c0796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:03.042295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a9435dd3-71e3-4990-86b2-2e07242c0796 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:03.043513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a9435dd3-71e3-4990-86b2-2e07242c0796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:03.148464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 361/721] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:41:03.516378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf52b4-f36a-4c1c-a880-a9dc4ad94f20 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:03.589800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:03.652693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf52b4-f36a-4c1c-a880-a9dc4ad94f20 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:03.693575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f03796-1c2c-4909-b50c-c676808177f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:03.694208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03796-1c2c-4909-b50c-c676808177f3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:03.694491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03796-1c2c-4909-b50c-c676808177f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:03.694788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03796-1c2c-4909-b50c-c676808177f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:03.714178 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f03796-1c2c-4909-b50c-c676808177f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-10f03796-1c2c-4909-b50c-c676808177f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:03.719562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:03.721365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:03.723667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:03.723667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:03.723667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:03.723667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:03.723667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:03.723667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:03.723667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:03.723667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:03.723667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:03.723667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:03.723667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:03.723667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:03.723667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 361/722] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:41:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:03.727738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9435dd3-71e3-4990-86b2-2e07242c0796 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:03.895729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9435dd3-71e3-4990-86b2-2e07242c0796 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:03.923435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:03.954554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab9116-f10c-4c0f-b96a-397790ae1d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:03.955207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab9116-f10c-4c0f-b96a-397790ae1d3c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:03.955481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab9116-f10c-4c0f-b96a-397790ae1d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:03.955745 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab9116-f10c-4c0f-b96a-397790ae1d3c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:03.956449 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab9116-f10c-4c0f-b96a-397790ae1d3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:03.956813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab9116-f10c-4c0f-b96a-397790ae1d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:03.958443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab9116-f10c-4c0f-b96a-397790ae1d3c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:03.970938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 362/723] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:03.978109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f03796-1c2c-4909-b50c-c676808177f3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:04.125122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f03796-1c2c-4909-b50c-c676808177f3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:04.141421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:04.165339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b44458-62a6-4b7a-b86c-a1f9924d8d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:04.165963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b44458-62a6-4b7a-b86c-a1f9924d8d92 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:04.166241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b44458-62a6-4b7a-b86c-a1f9924d8d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:04.166507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b44458-62a6-4b7a-b86c-a1f9924d8d92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:04.177776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b44458-62a6-4b7a-b86c-a1f9924d8d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:04.179242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b44458-62a6-4b7a-b86c-a1f9924d8d92 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-91b44458-62a6-4b7a-b86c-a1f9924d8d92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:04.193509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:04.194495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:04.195455 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:04.195455 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:04.195455 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:04.198833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 362/724] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:04.203827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab9116-f10c-4c0f-b96a-397790ae1d3c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:04.215858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabce69-59d4-4467-9cf7-aff45d3ec63f None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:04.216155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabce69-59d4-4467-9cf7-aff45d3ec63f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:04.216413 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabce69-59d4-4467-9cf7-aff45d3ec63f None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:04.217881 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 363/725] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:41:04.224043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbe891-0e93-48a7-927f-ebcee05a0f84 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:04.224323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbe891-0e93-48a7-927f-ebcee05a0f84 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:04.224592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbe891-0e93-48a7-927f-ebcee05a0f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:04.243452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a1fbe891-0e93-48a7-927f-ebcee05a0f84 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:04.244656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a1fbe891-0e93-48a7-927f-ebcee05a0f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:04.320477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 364/726] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:41:04.328474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e823a-c780-4c4e-b0e4-3c9ade4415a7 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:04.329104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e823a-c780-4c4e-b0e4-3c9ade4415a7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:04.329601 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e823a-c780-4c4e-b0e4-3c9ade4415a7 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:04.330711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab9116-f10c-4c0f-b96a-397790ae1d3c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:04.332349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 365/727] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:04.337761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8db80-f87b-49db-a20c-d07fecc08fc3 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:04.338356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8db80-f87b-49db-a20c-d07fecc08fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:04.338861 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8db80-f87b-49db-a20c-d07fecc08fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:04.362615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c7e8db80-f87b-49db-a20c-d07fecc08fc3 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:04.364165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c7e8db80-f87b-49db-a20c-d07fecc08fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:04.389653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d651d3-69d1-4fc5-bbb5-dbccc3ec0263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:04.390639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d651d3-69d1-4fc5-bbb5-dbccc3ec0263 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:04.391145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d651d3-69d1-4fc5-bbb5-dbccc3ec0263 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:04.391615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d651d3-69d1-4fc5-bbb5-dbccc3ec0263 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:04.392456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d651d3-69d1-4fc5-bbb5-dbccc3ec0263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:04.394556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d651d3-69d1-4fc5-bbb5-dbccc3ec0263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:04.396239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d651d3-69d1-4fc5-bbb5-dbccc3ec0263 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:04.427621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 363/728] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:04.434921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d651d3-69d1-4fc5-bbb5-dbccc3ec0263 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:04.470852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 366/729] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:41:04.479096 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbb71b-abe9-4953-a005-2d5967b99dd8 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:04.479337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbb71b-abe9-4953-a005-2d5967b99dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:04.479622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbb71b-abe9-4953-a005-2d5967b99dd8 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:04.481132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 367/730] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:04.489140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:04.501388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab39533-a1a3-46ec-999a-fd53255d921d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:04.501671 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab39533-a1a3-46ec-999a-fd53255d921d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:04.501950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab39533-a1a3-46ec-999a-fd53255d921d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:04.547777 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7ab39533-a1a3-46ec-999a-fd53255d921d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:04.548983 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7ab39533-a1a3-46ec-999a-fd53255d921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:04.558955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d651d3-69d1-4fc5-bbb5-dbccc3ec0263 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:04.591062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:04.609192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128d1ad-ec65-4e45-a501-9623dd60e156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:04.609822 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128d1ad-ec65-4e45-a501-9623dd60e156 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:04.610094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128d1ad-ec65-4e45-a501-9623dd60e156 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:04.610359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128d1ad-ec65-4e45-a501-9623dd60e156 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:04.623091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128d1ad-ec65-4e45-a501-9623dd60e156 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:04.625545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128d1ad-ec65-4e45-a501-9623dd60e156 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5128d1ad-ec65-4e45-a501-9623dd60e156 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:04.652366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:04.653554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:04.654706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:04.654706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:04.654706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:04.654706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:04.654706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:04.654706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:04.654706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:04.654706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:04.654706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:41:04.654706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:04.659993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 364/731] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:41:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:04.661685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128d1ad-ec65-4e45-a501-9623dd60e156 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:04.679363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 368/732] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:41:04.679964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab39533-a1a3-46ec-999a-fd53255d921d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:04.815340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:04.817703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab39533-a1a3-46ec-999a-fd53255d921d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:04.819734 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128d1ad-ec65-4e45-a501-9623dd60e156 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:04.855835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13f4cc-44a9-401a-881a-b65b23d18db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:04.856446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13f4cc-44a9-401a-881a-b65b23d18db7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:04.856723 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13f4cc-44a9-401a-881a-b65b23d18db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:04.856996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13f4cc-44a9-401a-881a-b65b23d18db7 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:04.857718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13f4cc-44a9-401a-881a-b65b23d18db7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:04.858020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13f4cc-44a9-401a-881a-b65b23d18db7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:04.859469 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13f4cc-44a9-401a-881a-b65b23d18db7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:04.859767 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1624e-8cee-450a-a966-e24c8f717b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:04.860567 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1624e-8cee-450a-a966-e24c8f717b68 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:04.861189 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1624e-8cee-450a-a966-e24c8f717b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:04.861627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1624e-8cee-450a-a966-e24c8f717b68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:04.874234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1624e-8cee-450a-a966-e24c8f717b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:04.882891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 365/733] 10.222.0.33 () {56 vars in 1135 bytes} [Sun Sep 11 00:41:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:04.882891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13f4cc-44a9-401a-881a-b65b23d18db7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-f8a1624e-8cee-450a-a966-e24c8f717b68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:04.885280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:04.886184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:04.888357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:04.888357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:04.888357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:04.888357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:04.888357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:04.888357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:04.888357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:04.888357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:04.888357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:04.888357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:04.888357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:04.888357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:04.888357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 369/734] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:41:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:04.895090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1624e-8cee-450a-a966-e24c8f717b68 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:04.916742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:04.986169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13f4cc-44a9-401a-881a-b65b23d18db7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:05.021018 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710b147-9b7b-4f05-b671-a5e6dbbad04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:05.021550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1624e-8cee-450a-a966-e24c8f717b68 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:05.021664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710b147-9b7b-4f05-b671-a5e6dbbad04b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:05.021899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710b147-9b7b-4f05-b671-a5e6dbbad04b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:05.022165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710b147-9b7b-4f05-b671-a5e6dbbad04b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:05.034939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710b147-9b7b-4f05-b671-a5e6dbbad04b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3710b147-9b7b-4f05-b671-a5e6dbbad04b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:05.039746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:05.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:05.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:05.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:05.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:05.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:05.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:05.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:05.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:05.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:05.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:05.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:05.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:41:05.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:05.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 366/735] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:41:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:05.042260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710b147-9b7b-4f05-b671-a5e6dbbad04b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:05.061024 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:05.065582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea42824-fb44-4023-bb6a-c6bcdf453758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:05.066122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea42824-fb44-4023-bb6a-c6bcdf453758 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:05.066424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea42824-fb44-4023-bb6a-c6bcdf453758 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:05.066694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea42824-fb44-4023-bb6a-c6bcdf453758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:05.139166 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea42824-fb44-4023-bb6a-c6bcdf453758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:05.140622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea42824-fb44-4023-bb6a-c6bcdf453758 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:05.149085 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710b147-9b7b-4f05-b671-a5e6dbbad04b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:05.154740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:05.185157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b1301-cde1-4d06-8a35-8c94bc6f6cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:05.185758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1301-cde1-4d06-8a35-8c94bc6f6cbe None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:05.186032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1301-cde1-4d06-8a35-8c94bc6f6cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:05.186293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1301-cde1-4d06-8a35-8c94bc6f6cbe None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:05.186969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b1301-cde1-4d06-8a35-8c94bc6f6cbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:05.187265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b1301-cde1-4d06-8a35-8c94bc6f6cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:05.188619 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b1301-cde1-4d06-8a35-8c94bc6f6cbe None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:05.197334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 367/736] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:41:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:05.201980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b1301-cde1-4d06-8a35-8c94bc6f6cbe None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:05.250696 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 370/737] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:41:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:41:05.250696 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea42824-fb44-4023-bb6a-c6bcdf453758 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:05.284797 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:05.307815 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b1301-cde1-4d06-8a35-8c94bc6f6cbe None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:05.345288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e58ad-f570-4a18-8ad2-57d4f0c1684e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:05.345824 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e58ad-f570-4a18-8ad2-57d4f0c1684e None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:05.346116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e58ad-f570-4a18-8ad2-57d4f0c1684e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:05.346412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e58ad-f570-4a18-8ad2-57d4f0c1684e None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:05.347121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e58ad-f570-4a18-8ad2-57d4f0c1684e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:05.348562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e58ad-f570-4a18-8ad2-57d4f0c1684e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:05.366455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 368/738] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:41:05 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:05.366865 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea42824-fb44-4023-bb6a-c6bcdf453758 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:05.367330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e58ad-f570-4a18-8ad2-57d4f0c1684e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:05.393721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:05.447337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93455b04-beed-4ccd-af20-59c96f745f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:05.449150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93455b04-beed-4ccd-af20-59c96f745f91 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:05.449628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93455b04-beed-4ccd-af20-59c96f745f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:05.450214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93455b04-beed-4ccd-af20-59c96f745f91 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:05.451240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93455b04-beed-4ccd-af20-59c96f745f91 None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:05.451764 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93455b04-beed-4ccd-af20-59c96f745f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:05.453414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93455b04-beed-4ccd-af20-59c96f745f91 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:05.470952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 371/739] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:41:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:05.472737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93455b04-beed-4ccd-af20-59c96f745f91 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:05.499429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e58ad-f570-4a18-8ad2-57d4f0c1684e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:05.537798 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da669f-d206-4d90-83b4-cdbd2bbbebc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:05.538453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da669f-d206-4d90-83b4-cdbd2bbbebc4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:05.538776 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da669f-d206-4d90-83b4-cdbd2bbbebc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:05.539049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da669f-d206-4d90-83b4-cdbd2bbbebc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:05.547278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:05.552007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da669f-d206-4d90-83b4-cdbd2bbbebc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:05.553745 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da669f-d206-4d90-83b4-cdbd2bbbebc4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e3da669f-d206-4d90-83b4-cdbd2bbbebc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:05.572562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:05.573549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:05.574424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:05.574424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:05.574424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:05.578385 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 369/740] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:05.579753 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742fd37-81d7-4bef-83f6-b0b2b8038a82 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:05.580966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742fd37-81d7-4bef-83f6-b0b2b8038a82 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:05.580966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742fd37-81d7-4bef-83f6-b0b2b8038a82 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:05.582512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 370/741] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:05.584209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742fd37-81d7-4bef-83f6-b0b2b8038a82 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:05.588211 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93455b04-beed-4ccd-af20-59c96f745f91 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:05.625043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c91be-40a5-4f90-8993-281f7a85841d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:05.625585 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c91be-40a5-4f90-8993-281f7a85841d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:05.625859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c91be-40a5-4f90-8993-281f7a85841d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:05.626128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c91be-40a5-4f90-8993-281f7a85841d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:05.636926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c91be-40a5-4f90-8993-281f7a85841d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:05.638353 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c91be-40a5-4f90-8993-281f7a85841d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-596c91be-40a5-4f90-8993-281f7a85841d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:05.652959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:05.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:05.654909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:05.654909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:05.654909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:05.654909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 372/742] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:05.654909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c91be-40a5-4f90-8993-281f7a85841d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:05.684536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:05.695992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742fd37-81d7-4bef-83f6-b0b2b8038a82 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:05.730352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a23d93-df62-4848-b4f6-fa47f5b8cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:05.731011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a23d93-df62-4848-b4f6-fa47f5b8cec2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:05.731285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a23d93-df62-4848-b4f6-fa47f5b8cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:05.731555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a23d93-df62-4848-b4f6-fa47f5b8cec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:05.743120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a23d93-df62-4848-b4f6-fa47f5b8cec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:05.744566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a23d93-df62-4848-b4f6-fa47f5b8cec2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d7a23d93-df62-4848-b4f6-fa47f5b8cec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:05.759048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:05.760050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:05.760948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:05.760948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:05.760948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:05.760948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 371/743] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:05.761498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa563-c71d-4e2f-a606-19c30f9f79a8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:05.761591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa563-c71d-4e2f-a606-19c30f9f79a8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:05.761864 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa563-c71d-4e2f-a606-19c30f9f79a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:05.773160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c91be-40a5-4f90-8993-281f7a85841d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:05.780181 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f5bfa563-c71d-4e2f-a606-19c30f9f79a8 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:05.782767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f5bfa563-c71d-4e2f-a606-19c30f9f79a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:05.816508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5ed28-4260-4191-ba91-15ee668ad5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:05.817110 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ed28-4260-4191-ba91-15ee668ad5ad None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:05.817383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ed28-4260-4191-ba91-15ee668ad5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:05.817653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ed28-4260-4191-ba91-15ee668ad5ad None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:05.818286 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5ed28-4260-4191-ba91-15ee668ad5ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:05.818583 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5ed28-4260-4191-ba91-15ee668ad5ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:05.819957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5ed28-4260-4191-ba91-15ee668ad5ad None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:05.824129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:05.837414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 373/744] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:05.837414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5ed28-4260-4191-ba91-15ee668ad5ad None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:05.866884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 372/745] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:41:05.867818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfa563-c71d-4e2f-a606-19c30f9f79a8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:06.012064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:06.016836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfa563-c71d-4e2f-a606-19c30f9f79a8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:06.054440 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcf874-bce3-4bad-bd94-8c67359fc683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:06.055343 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcf874-bce3-4bad-bd94-8c67359fc683 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:06.055757 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcf874-bce3-4bad-bd94-8c67359fc683 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:06.056327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcf874-bce3-4bad-bd94-8c67359fc683 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:06.057310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcf874-bce3-4bad-bd94-8c67359fc683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:06.058021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcf874-bce3-4bad-bd94-8c67359fc683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:06.059734 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcf874-bce3-4bad-bd94-8c67359fc683 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:06.068919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5ed28-4260-4191-ba91-15ee668ad5ad None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:06.077482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 373/746] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:06.078769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcf874-bce3-4bad-bd94-8c67359fc683 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:06.126837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:06.150599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28369c1-3e9e-4d17-92ed-e62d3fef6a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:06.151886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28369c1-3e9e-4d17-92ed-e62d3fef6a16 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:06.152393 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28369c1-3e9e-4d17-92ed-e62d3fef6a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:06.153289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28369c1-3e9e-4d17-92ed-e62d3fef6a16 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:06.155003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28369c1-3e9e-4d17-92ed-e62d3fef6a16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:06.155601 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28369c1-3e9e-4d17-92ed-e62d3fef6a16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:06.158261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28369c1-3e9e-4d17-92ed-e62d3fef6a16 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:06.179190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 374/747] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:06.180177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28369c1-3e9e-4d17-92ed-e62d3fef6a16 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:06.214396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcf874-bce3-4bad-bd94-8c67359fc683 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:06.249561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a147a94-6df5-45ad-bee0-796202605f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:06.250593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a147a94-6df5-45ad-bee0-796202605f62 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:06.251096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a147a94-6df5-45ad-bee0-796202605f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:06.251547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a147a94-6df5-45ad-bee0-796202605f62 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:06.259677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a147a94-6df5-45ad-bee0-796202605f62 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:06.261430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a147a94-6df5-45ad-bee0-796202605f62 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9a147a94-6df5-45ad-bee0-796202605f62 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:06.273710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:06.274632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:06.275613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:06.275613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:06.275613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:06.275613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:06.275613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:06.275613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:06.275613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:06.275613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:06.275613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:41:06.275613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:06.278086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 374/748] 10.222.0.33 () {56 vars in 1093 bytes} [Sun Sep 11 00:41:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:06.279101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a147a94-6df5-45ad-bee0-796202605f62 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:06.316535 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28369c1-3e9e-4d17-92ed-e62d3fef6a16 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:06.356396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3e1bc-9f50-4c25-9535-565e92f3b109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:06.357010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3e1bc-9f50-4c25-9535-565e92f3b109 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:06.357303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3e1bc-9f50-4c25-9535-565e92f3b109 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:06.357557 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3e1bc-9f50-4c25-9535-565e92f3b109 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:06.367731 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3e1bc-9f50-4c25-9535-565e92f3b109 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:06.369522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3e1bc-9f50-4c25-9535-565e92f3b109 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-f8d3e1bc-9f50-4c25-9535-565e92f3b109 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:06.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:06.384196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:06.385156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:06.385156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:06.385156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:06.385156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:06.385156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:06.385156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:06.385156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:06.385156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:06.385156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:41:06.385156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:06.385156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 375/749] 10.222.0.33 () {56 vars in 1117 bytes} [Sun Sep 11 00:41:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:06.385156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3e1bc-9f50-4c25-9535-565e92f3b109 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:06.387999 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:06.392977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:06.402141 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a147a94-6df5-45ad-bee0-796202605f62 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:06.440821 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf03afd-8d2b-4e59-bee3-2bae1330dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:06.441435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf03afd-8d2b-4e59-bee3-2bae1330dfb5 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:06.441711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf03afd-8d2b-4e59-bee3-2bae1330dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:06.441978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf03afd-8d2b-4e59-bee3-2bae1330dfb5 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:06.442622 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf03afd-8d2b-4e59-bee3-2bae1330dfb5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:06.444011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf03afd-8d2b-4e59-bee3-2bae1330dfb5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:06.459351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 375/750] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:41:06 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:06.460491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf03afd-8d2b-4e59-bee3-2bae1330dfb5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:06.534581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3e1bc-9f50-4c25-9535-565e92f3b109 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:06.579992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ceccd-ad06-47eb-8698-e0281a8e8c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:06.580637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ceccd-ad06-47eb-8698-e0281a8e8c27 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:06.580912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ceccd-ad06-47eb-8698-e0281a8e8c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:06.581177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ceccd-ad06-47eb-8698-e0281a8e8c27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:06.588788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ceccd-ad06-47eb-8698-e0281a8e8c27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:06.590231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ceccd-ad06-47eb-8698-e0281a8e8c27 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a94ceccd-ad06-47eb-8698-e0281a8e8c27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:06.603031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:06.604008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:06.604900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:06.604900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:06.604900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:06.604900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:06.604900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:06.604900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:06.604900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:06.604900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:06.609104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 376/751] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:06.610090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ceccd-ad06-47eb-8698-e0281a8e8c27 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:06.616309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf03afd-8d2b-4e59-bee3-2bae1330dfb5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:06.663206 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e51a6f-8cb5-44ed-a72b-5c4776683d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:06.664183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e51a6f-8cb5-44ed-a72b-5c4776683d61 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:06.664467 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e51a6f-8cb5-44ed-a72b-5c4776683d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:06.664740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e51a6f-8cb5-44ed-a72b-5c4776683d61 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:06.665792 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e51a6f-8cb5-44ed-a72b-5c4776683d61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:06.666250 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e51a6f-8cb5-44ed-a72b-5c4776683d61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:06.668564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e51a6f-8cb5-44ed-a72b-5c4776683d61 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:06.683094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:06.688177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 376/752] 10.222.0.33 () {56 vars in 1133 bytes} [Sun Sep 11 00:41:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:06.689040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e51a6f-8cb5-44ed-a72b-5c4776683d61 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:06.704354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:06.746247 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ceccd-ad06-47eb-8698-e0281a8e8c27 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:06.782372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd20e4-8a5d-42f8-a0ff-1d23a611a0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:06.783081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd20e4-8a5d-42f8-a0ff-1d23a611a0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:06.783362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd20e4-8a5d-42f8-a0ff-1d23a611a0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:06.783635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd20e4-8a5d-42f8-a0ff-1d23a611a0a0 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:06.784365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd20e4-8a5d-42f8-a0ff-1d23a611a0a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:06.784725 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd20e4-8a5d-42f8-a0ff-1d23a611a0a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:06.786090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd20e4-8a5d-42f8-a0ff-1d23a611a0a0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:06.804580 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 377/753] 10.222.0.33 () {56 vars in 1149 bytes} [Sun Sep 11 00:41:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:06.805514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd20e4-8a5d-42f8-a0ff-1d23a611a0a0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:06.825155 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e51a6f-8cb5-44ed-a72b-5c4776683d61 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:06.865490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb4ccb-5c79-4d8c-a251-3258cfd6c0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:06.866499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb4ccb-5c79-4d8c-a251-3258cfd6c0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:06.866809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb4ccb-5c79-4d8c-a251-3258cfd6c0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:06.867086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb4ccb-5c79-4d8c-a251-3258cfd6c0f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:06.868376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb4ccb-5c79-4d8c-a251-3258cfd6c0f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:06.868691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb4ccb-5c79-4d8c-a251-3258cfd6c0f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:06.870350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb4ccb-5c79-4d8c-a251-3258cfd6c0f6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:06.885810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 377/754] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:06.886808 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb4ccb-5c79-4d8c-a251-3258cfd6c0f6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:06.936480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd20e4-8a5d-42f8-a0ff-1d23a611a0a0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:06.955262 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:06.974171 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:06.978063 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54169283-9559-4538-b41f-d747d11ae81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:06.978970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54169283-9559-4538-b41f-d747d11ae81d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:06.979447 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54169283-9559-4538-b41f-d747d11ae81d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:06.979896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54169283-9559-4538-b41f-d747d11ae81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:06.994620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54169283-9559-4538-b41f-d747d11ae81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:06.996106 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54169283-9559-4538-b41f-d747d11ae81d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:07.013821 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb4ccb-5c79-4d8c-a251-3258cfd6c0f6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-54169283-9559-4538-b41f-d747d11ae81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:07.017045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:07.018056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:07.019091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:07.019091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:07.019091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:07.021246 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 378/755] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:07.022376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54169283-9559-4538-b41f-d747d11ae81d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:07.050474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41603bd3-c962-4533-916b-20956ab570e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:07.051283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41603bd3-c962-4533-916b-20956ab570e2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:07.051567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41603bd3-c962-4533-916b-20956ab570e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:07.051917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41603bd3-c962-4533-916b-20956ab570e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:07.131465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41603bd3-c962-4533-916b-20956ab570e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:07.133277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41603bd3-c962-4533-916b-20956ab570e2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:07.144259 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54169283-9559-4538-b41f-d747d11ae81d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:07.185622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61173a-3c88-4939-9c0b-bb47e3f8a18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:07.186591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61173a-3c88-4939-9c0b-bb47e3f8a18a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:07.187140 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61173a-3c88-4939-9c0b-bb47e3f8a18a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:07.187605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61173a-3c88-4939-9c0b-bb47e3f8a18a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:07.188523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61173a-3c88-4939-9c0b-bb47e3f8a18a None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=e8baa8033f884cb6a7783f78c01a212e) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:07.189575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61173a-3c88-4939-9c0b-bb47e3f8a18a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:07.191235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61173a-3c88-4939-9c0b-bb47e3f8a18a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:07.197493 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 379/756] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:41:07 2022] GET /identity/v3/role_assignments?user.id=e8baa8033f884cb6a7783f78c01a212e&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:07.198655 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61173a-3c88-4939-9c0b-bb47e3f8a18a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:07.244341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:07.273847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:07.313943 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 378/757] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:41:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:41:07.321113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41603bd3-c962-4533-916b-20956ab570e2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:07.410423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61173a-3c88-4939-9c0b-bb47e3f8a18a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:07.463818 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fb594-def6-4f50-83fd-b436b96cbc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:07.464433 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fb594-def6-4f50-83fd-b436b96cbc08 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:07.464711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fb594-def6-4f50-83fd-b436b96cbc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:07.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fb594-def6-4f50-83fd-b436b96cbc08 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:07.465629 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fb594-def6-4f50-83fd-b436b96cbc08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:07.465929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fb594-def6-4f50-83fd-b436b96cbc08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:07.467331 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fb594-def6-4f50-83fd-b436b96cbc08 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:07.481452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 380/758] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:07.495276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fb594-def6-4f50-83fd-b436b96cbc08 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:07.534754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41603bd3-c962-4533-916b-20956ab570e2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:07.606463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35617a3a-8014-4e67-a269-86c2986288e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:07.607182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35617a3a-8014-4e67-a269-86c2986288e0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:07.607463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35617a3a-8014-4e67-a269-86c2986288e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:07.607732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35617a3a-8014-4e67-a269-86c2986288e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:07.629410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35617a3a-8014-4e67-a269-86c2986288e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:07.630929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35617a3a-8014-4e67-a269-86c2986288e0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:07.649406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-35617a3a-8014-4e67-a269-86c2986288e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:07.652335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:07.653251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:07.654970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:07.654970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:07.654970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:07.654970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 379/759] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:07.659344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35617a3a-8014-4e67-a269-86c2986288e0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:07.670823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fb594-def6-4f50-83fd-b436b96cbc08 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:07.687212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:07.711315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1e510-3eaf-44c2-a59a-cb7811908976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:07.711945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1e510-3eaf-44c2-a59a-cb7811908976 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:07.712221 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1e510-3eaf-44c2-a59a-cb7811908976 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:07.712489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1e510-3eaf-44c2-a59a-cb7811908976 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:07.720269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1e510-3eaf-44c2-a59a-cb7811908976 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:07.722008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1e510-3eaf-44c2-a59a-cb7811908976 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-3ca1e510-3eaf-44c2-a59a-cb7811908976 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:07.734833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:07.736302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:07.737203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:07.737203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:07.737203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:07.737203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:07.737203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:07.737203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:07.737203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:07.737203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:07.737203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 381/760] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:07.742856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eab0f-2ce8-43de-b75b-d32155f88f89 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:07.742856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eab0f-2ce8-43de-b75b-d32155f88f89 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:07.742856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eab0f-2ce8-43de-b75b-d32155f88f89 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:07.742856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 382/761] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:07.743180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eab0f-2ce8-43de-b75b-d32155f88f89 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:07.802071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35617a3a-8014-4e67-a269-86c2986288e0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:07.848103 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0195021-a34c-45cb-bbfa-59a0e0997366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:07.849325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0195021-a34c-45cb-bbfa-59a0e0997366 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:07.850010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0195021-a34c-45cb-bbfa-59a0e0997366 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:07.850483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0195021-a34c-45cb-bbfa-59a0e0997366 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:07.851928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0195021-a34c-45cb-bbfa-59a0e0997366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:07.852436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0195021-a34c-45cb-bbfa-59a0e0997366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:07.854788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0195021-a34c-45cb-bbfa-59a0e0997366 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:07.857473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eab0f-2ce8-43de-b75b-d32155f88f89 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:07.871497 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 380/762] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:07.873812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df637d-cffe-4029-bbd0-39764a72041b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:07.874321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df637d-cffe-4029-bbd0-39764a72041b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:07.874956 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df637d-cffe-4029-bbd0-39764a72041b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:07.896810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a7df637d-cffe-4029-bbd0-39764a72041b None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:07.898091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a7df637d-cffe-4029-bbd0-39764a72041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:07.898377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b7b07-84ed-49a7-9dbb-4376c14f7f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:07.899242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b7b07-84ed-49a7-9dbb-4376c14f7f78 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:07.899722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b7b07-84ed-49a7-9dbb-4376c14f7f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:07.900508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b7b07-84ed-49a7-9dbb-4376c14f7f78 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:07.902303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b7b07-84ed-49a7-9dbb-4376c14f7f78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:07.902866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b7b07-84ed-49a7-9dbb-4376c14f7f78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:07.904501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b7b07-84ed-49a7-9dbb-4376c14f7f78 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:07.926771 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 383/763] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:07.927156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b7b07-84ed-49a7-9dbb-4376c14f7f78 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:07.947467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:07.983489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 381/764] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:07.984406 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df637d-cffe-4029-bbd0-39764a72041b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:08.004087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:08.060699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b7b07-84ed-49a7-9dbb-4376c14f7f78 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:08.100659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df637d-cffe-4029-bbd0-39764a72041b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:08.101268 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d26891-f32e-47f4-b4dc-0548fb21e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:08.102134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d26891-f32e-47f4-b4dc-0548fb21e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:08.102616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d26891-f32e-47f4-b4dc-0548fb21e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:08.103109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d26891-f32e-47f4-b4dc-0548fb21e6e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:08.110338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d26891-f32e-47f4-b4dc-0548fb21e6e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:08.112074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d26891-f32e-47f4-b4dc-0548fb21e6e2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-65d26891-f32e-47f4-b4dc-0548fb21e6e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:08.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:08.125481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:08.126965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:08.126965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:08.126965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:08.126965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:08.126965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:08.126965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:08.126965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:08.126965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:08.129731 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 384/765] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:08.135892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d26891-f32e-47f4-b4dc-0548fb21e6e2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:08.148757 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9366349-05d5-4e05-9b6b-f88fb61ee961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:08.149428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366349-05d5-4e05-9b6b-f88fb61ee961 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:08.149705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366349-05d5-4e05-9b6b-f88fb61ee961 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:08.149974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366349-05d5-4e05-9b6b-f88fb61ee961 None admin] PATH_INFO: `/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/ab5f197fb09e422997434a1b2feb4567/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:08.154242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9366349-05d5-4e05-9b6b-f88fb61ee961 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce5275375bc1421cb3fe6e27d5f685fe, user_id=ab5f197fb09e422997434a1b2feb4567, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:08.155711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9366349-05d5-4e05-9b6b-f88fb61ee961 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:08.182017 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 382/766] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:41:07 2022] PUT /identity/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/ab5f197fb09e422997434a1b2feb4567/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:41:08.254417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:08.289457 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d26891-f32e-47f4-b4dc-0548fb21e6e2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:08.327106 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61d570-3fbe-4b46-9438-428ff1a41d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:08.327729 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61d570-3fbe-4b46-9438-428ff1a41d02 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:08.328002 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61d570-3fbe-4b46-9438-428ff1a41d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:08.328267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61d570-3fbe-4b46-9438-428ff1a41d02 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:08.329639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61d570-3fbe-4b46-9438-428ff1a41d02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:08.329943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61d570-3fbe-4b46-9438-428ff1a41d02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:08.331697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61d570-3fbe-4b46-9438-428ff1a41d02 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:08.355130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 385/767] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:08.361612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9366349-05d5-4e05-9b6b-f88fb61ee961 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:08.428867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61d570-3fbe-4b46-9438-428ff1a41d02 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:08.455812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:08.539395 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61d570-3fbe-4b46-9438-428ff1a41d02 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:08.545561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9366349-05d5-4e05-9b6b-f88fb61ee961 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:08.571970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:08.577417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106e77c-6c5d-47b5-b122-981abafb7069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:08.578267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106e77c-6c5d-47b5-b122-981abafb7069 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:08.579496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106e77c-6c5d-47b5-b122-981abafb7069 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:08.580296 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106e77c-6c5d-47b5-b122-981abafb7069 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:08.581351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106e77c-6c5d-47b5-b122-981abafb7069 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:08.582941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106e77c-6c5d-47b5-b122-981abafb7069 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b106e77c-6c5d-47b5-b122-981abafb7069 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:08.592630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:08.593650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:41:08.594547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:08.597030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 386/768] 10.222.0.33 () {56 vars in 1129 bytes} [Sun Sep 11 00:41:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:08.607079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106e77c-6c5d-47b5-b122-981abafb7069 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:08.624413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06327de4-dd83-43aa-a72e-5fd16b35f723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:08.624956 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06327de4-dd83-43aa-a72e-5fd16b35f723 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:08.625232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06327de4-dd83-43aa-a72e-5fd16b35f723 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:08.625495 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06327de4-dd83-43aa-a72e-5fd16b35f723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:08.626783 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06327de4-dd83-43aa-a72e-5fd16b35f723 None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=f2c9025c666340aaaf2a664c88650942) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:08.627094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06327de4-dd83-43aa-a72e-5fd16b35f723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:08.628543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06327de4-dd83-43aa-a72e-5fd16b35f723 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:08.639075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 383/769] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:41:08 2022] GET /identity/v3/role_assignments?user.id=f2c9025c666340aaaf2a664c88650942&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:08.749018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106e77c-6c5d-47b5-b122-981abafb7069 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:08.791261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbc593-09e6-4b3d-bee8-e572421a4482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:08.791870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc593-09e6-4b3d-bee8-e572421a4482 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:08.792147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc593-09e6-4b3d-bee8-e572421a4482 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:08.792418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc593-09e6-4b3d-bee8-e572421a4482 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:08.793057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbc593-09e6-4b3d-bee8-e572421a4482 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:08.793359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbc593-09e6-4b3d-bee8-e572421a4482 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:08.794803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbc593-09e6-4b3d-bee8-e572421a4482 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:08.800551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 387/770] 10.222.0.33 () {56 vars in 1124 bytes} [Sun Sep 11 00:41:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:08.806277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06327de4-dd83-43aa-a72e-5fd16b35f723 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:08.939983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06327de4-dd83-43aa-a72e-5fd16b35f723 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:08.992037 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba41bde-c2bd-4f5b-9e49-d3104295a1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:08.992689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41bde-c2bd-4f5b-9e49-d3104295a1ea None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:08.992965 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41bde-c2bd-4f5b-9e49-d3104295a1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:08.993285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41bde-c2bd-4f5b-9e49-d3104295a1ea None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:08.993917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba41bde-c2bd-4f5b-9e49-d3104295a1ea None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:08.994214 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba41bde-c2bd-4f5b-9e49-d3104295a1ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:08.995596 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba41bde-c2bd-4f5b-9e49-d3104295a1ea None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:09.006925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 384/771] 10.222.0.33 () {56 vars in 1124 bytes} [Sun Sep 11 00:41:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:09.007072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:09.013421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbc593-09e6-4b3d-bee8-e572421a4482 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:09.071863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0423-2be2-41ab-95cc-f8a83d328341 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:09.072198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0423-2be2-41ab-95cc-f8a83d328341 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:09.072411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0423-2be2-41ab-95cc-f8a83d328341 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:09.073985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 385/772] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:09.081720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a57dc2-5c01-4a24-a676-4a9b10c324f0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:09.081998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a57dc2-5c01-4a24-a676-4a9b10c324f0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:09.082263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a57dc2-5c01-4a24-a676-4a9b10c324f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:09.112101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-41a57dc2-5c01-4a24-a676-4a9b10c324f0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:09.114044 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-41a57dc2-5c01-4a24-a676-4a9b10c324f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:09.119688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:09.195876 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbc593-09e6-4b3d-bee8-e572421a4482 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:09.240232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 386/773] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:09.250752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465e199-ff54-4e63-9e3e-3dc81dd74f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:09.251365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e199-ff54-4e63-9e3e-3dc81dd74f3a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:09.251639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e199-ff54-4e63-9e3e-3dc81dd74f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:09.251902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e199-ff54-4e63-9e3e-3dc81dd74f3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:09.252591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465e199-ff54-4e63-9e3e-3dc81dd74f3a None admin] RBAC: Adding query filter params (interface=public, service_id=929a2492004d44f193da5c5fbf21c4ca, region_id=RegionOne) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:09.252888 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465e199-ff54-4e63-9e3e-3dc81dd74f3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:09.254239 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465e199-ff54-4e63-9e3e-3dc81dd74f3a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:09.269647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 388/774] 10.222.0.33 () {56 vars in 1251 bytes} [Sun Sep 11 00:41:09 2022] GET /identity/v3/endpoints?service_id=929a2492004d44f193da5c5fbf21c4ca&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:09.275303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a57dc2-5c01-4a24-a676-4a9b10c324f0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:09.392409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a57dc2-5c01-4a24-a676-4a9b10c324f0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:09.423046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:09.434688 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27b76c-4575-4a7c-97e5-8e1a52e16ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:09.435344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27b76c-4575-4a7c-97e5-8e1a52e16ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:09.435618 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27b76c-4575-4a7c-97e5-8e1a52e16ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:09.435885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27b76c-4575-4a7c-97e5-8e1a52e16ee5 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:09.436487 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27b76c-4575-4a7c-97e5-8e1a52e16ee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:09.438365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27b76c-4575-4a7c-97e5-8e1a52e16ee5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:09.444060 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 387/775] 10.222.0.33 () {56 vars in 1087 bytes} [Sun Sep 11 00:41:09 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:09.589660 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465e199-ff54-4e63-9e3e-3dc81dd74f3a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:09.711672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465e199-ff54-4e63-9e3e-3dc81dd74f3a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:09.736109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:09.747096 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e1573-dbac-4eb3-a1f2-ea340f81ad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:09.747749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e1573-dbac-4eb3-a1f2-ea340f81ad6d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:09.748027 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e1573-dbac-4eb3-a1f2-ea340f81ad6d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:09.748299 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e1573-dbac-4eb3-a1f2-ea340f81ad6d None admin] PATH_INFO: `/v3/services/network` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:09.748896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e1573-dbac-4eb3-a1f2-ea340f81ad6d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:09.750936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e1573-dbac-4eb3-a1f2-ea340f81ad6d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-366e1573-dbac-4eb3-a1f2-ea340f81ad6d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:09.760982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:09.762058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:09.762934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 389/776] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:09 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:09.768331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27b76c-4575-4a7c-97e5-8e1a52e16ee5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:09.877699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27b76c-4575-4a7c-97e5-8e1a52e16ee5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:09.900008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a4b55-6a5d-4825-aa79-e4dd26283ffe None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:09.900351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a4b55-6a5d-4825-aa79-e4dd26283ffe None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:09.900628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a4b55-6a5d-4825-aa79-e4dd26283ffe None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:09.902012 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 390/777] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:09.907418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836f85e-f806-41fe-9d5e-3c1207ccb977 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:09.907704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836f85e-f806-41fe-9d5e-3c1207ccb977 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:09.907978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836f85e-f806-41fe-9d5e-3c1207ccb977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:09.918618 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b06ab-356b-47fc-88ae-5ee249e859a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:09.919330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b06ab-356b-47fc-88ae-5ee249e859a6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:09.919612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b06ab-356b-47fc-88ae-5ee249e859a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:09.919882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b06ab-356b-47fc-88ae-5ee249e859a6 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:09.920630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b06ab-356b-47fc-88ae-5ee249e859a6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:09.920937 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b06ab-356b-47fc-88ae-5ee249e859a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:09.922869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b06ab-356b-47fc-88ae-5ee249e859a6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:09.928032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 388/778] 10.222.0.33 () {56 vars in 1112 bytes} [Sun Sep 11 00:41:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:09.939848 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b06ab-356b-47fc-88ae-5ee249e859a6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:09.944807 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5836f85e-f806-41fe-9d5e-3c1207ccb977 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:09.946013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5836f85e-f806-41fe-9d5e-3c1207ccb977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:10.073745 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 391/779] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:10.092137 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:10.147803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b06ab-356b-47fc-88ae-5ee249e859a6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:10.191031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc4526-d23c-4889-b5f3-fd19b8d57200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:10.191662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc4526-d23c-4889-b5f3-fd19b8d57200 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:10.191943 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc4526-d23c-4889-b5f3-fd19b8d57200 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:10.192218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc4526-d23c-4889-b5f3-fd19b8d57200 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:10.192856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc4526-d23c-4889-b5f3-fd19b8d57200 None admin] RBAC: Adding query filter params (type=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:10.193157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc4526-d23c-4889-b5f3-fd19b8d57200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:10.194530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc4526-d23c-4889-b5f3-fd19b8d57200 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:10.202069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 389/780] 10.222.0.33 () {56 vars in 1112 bytes} [Sun Sep 11 00:41:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:10.208381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836f85e-f806-41fe-9d5e-3c1207ccb977 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:10.433064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836f85e-f806-41fe-9d5e-3c1207ccb977 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:10.451736 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:10.473789 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf968eb5-0a80-4b72-abbf-32c23549ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:10.474408 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf968eb5-0a80-4b72-abbf-32c23549ac3b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:10.474687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf968eb5-0a80-4b72-abbf-32c23549ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:10.474983 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf968eb5-0a80-4b72-abbf-32c23549ac3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:10.475679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf968eb5-0a80-4b72-abbf-32c23549ac3b None admin] RBAC: Adding query filter params (interface=public, service_id=80aa3066f00943f98965cd130d9bb7f9, region_id=RegionOne) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:10.475989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf968eb5-0a80-4b72-abbf-32c23549ac3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:10.477364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf968eb5-0a80-4b72-abbf-32c23549ac3b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:10.485155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 392/781] 10.222.0.33 () {56 vars in 1251 bytes} [Sun Sep 11 00:41:10 2022] GET /identity/v3/endpoints?service_id=80aa3066f00943f98965cd130d9bb7f9&interface=public®ion_id=RegionOne => generated 194 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:10.490440 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc4526-d23c-4889-b5f3-fd19b8d57200 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:10.513726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf968eb5-0a80-4b72-abbf-32c23549ac3b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:10.678193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc4526-d23c-4889-b5f3-fd19b8d57200 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:10.687417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf968eb5-0a80-4b72-abbf-32c23549ac3b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:10.712697 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:10.719823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2251-9277-4592-b8c7-0ce2dd2fadde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:10.720583 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2251-9277-4592-b8c7-0ce2dd2fadde None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:10.720894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2251-9277-4592-b8c7-0ce2dd2fadde None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:10.721191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2251-9277-4592-b8c7-0ce2dd2fadde None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:10.727472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee2251-9277-4592-b8c7-0ce2dd2fadde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:10.728876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee2251-9277-4592-b8c7-0ce2dd2fadde None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:10.737570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 390/782] 10.222.0.33 () {56 vars in 1087 bytes} [Sun Sep 11 00:41:10 2022] GET /identity/v3/services => generated 772 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:10.743662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb439d-9c74-4b0a-b7c7-7e7740511b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:10.744312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb439d-9c74-4b0a-b7c7-7e7740511b56 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:10.744586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb439d-9c74-4b0a-b7c7-7e7740511b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:10.744852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb439d-9c74-4b0a-b7c7-7e7740511b56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:10.756660 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb439d-9c74-4b0a-b7c7-7e7740511b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-20bb439d-9c74-4b0a-b7c7-7e7740511b56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:10.761942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:10.762976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:10.764264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:10.764264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:10.764264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:10.764264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:10.764264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:10.764264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:10.764264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:10.764264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:10.764264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:10.764264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:10.764264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:10.764264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:10.764264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 393/783] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:10.770342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2251-9277-4592-b8c7-0ce2dd2fadde None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:10.902898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2251-9277-4592-b8c7-0ce2dd2fadde None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:10.952514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f209a4-d85c-491a-bec5-4ace39f75f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:10.953121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f209a4-d85c-491a-bec5-4ace39f75f84 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:10.953403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f209a4-d85c-491a-bec5-4ace39f75f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:10.953673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f209a4-d85c-491a-bec5-4ace39f75f84 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:10.954599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f209a4-d85c-491a-bec5-4ace39f75f84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:10.954934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f209a4-d85c-491a-bec5-4ace39f75f84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:10.956310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f209a4-d85c-491a-bec5-4ace39f75f84 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:10.967441 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 391/784] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:10.973296 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb439d-9c74-4b0a-b7c7-7e7740511b56 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:10.981153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112edd00-5059-4454-83c0-bd1abf08b964 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:10.981433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112edd00-5059-4454-83c0-bd1abf08b964 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:10.981766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112edd00-5059-4454-83c0-bd1abf08b964 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:10.983369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 392/785] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:10.988998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b1689-3b19-4339-bbe5-7b305be631ec None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:10.989281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b1689-3b19-4339-bbe5-7b305be631ec None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:10.989550 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b1689-3b19-4339-bbe5-7b305be631ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:11.008422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-915b1689-3b19-4339-bbe5-7b305be631ec None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:11.009626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-915b1689-3b19-4339-bbe5-7b305be631ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:11.041532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:11.059400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:11.106770 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 393/786] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:11.111335 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb439d-9c74-4b0a-b7c7-7e7740511b56 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:11.166164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb45e80-5b14-4689-8778-e3308a64e696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:11.167203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb45e80-5b14-4689-8778-e3308a64e696 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:11.167685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb45e80-5b14-4689-8778-e3308a64e696 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:11.168164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb45e80-5b14-4689-8778-e3308a64e696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:11.186400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb45e80-5b14-4689-8778-e3308a64e696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:11.192485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb45e80-5b14-4689-8778-e3308a64e696 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-dcb45e80-5b14-4689-8778-e3308a64e696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:11.210572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:11.211570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:11.212474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:11.212474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:11.212474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:11.214698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 394/787] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:11.223854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b1689-3b19-4339-bbe5-7b305be631ec None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:11.349631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd272123-3496-4540-b7b0-234ec43a2747 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:11.350257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd272123-3496-4540-b7b0-234ec43a2747 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:11.350785 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd272123-3496-4540-b7b0-234ec43a2747 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:11.352291 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 395/788] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:41:11.364500 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543494f-7d99-4668-8f73-246e6716a3ec None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:11.364783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543494f-7d99-4668-8f73-246e6716a3ec None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:11.365034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543494f-7d99-4668-8f73-246e6716a3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:11.369333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b1689-3b19-4339-bbe5-7b305be631ec None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:11.414667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780919b5-db5b-4f62-9b94-1d7fbe742e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:11.415685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780919b5-db5b-4f62-9b94-1d7fbe742e69 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:11.415795 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7543494f-7d99-4668-8f73-246e6716a3ec None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:11.416296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780919b5-db5b-4f62-9b94-1d7fbe742e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:11.416762 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780919b5-db5b-4f62-9b94-1d7fbe742e69 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:11.416866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7543494f-7d99-4668-8f73-246e6716a3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:11.417698 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780919b5-db5b-4f62-9b94-1d7fbe742e69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:11.418193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780919b5-db5b-4f62-9b94-1d7fbe742e69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:11.424823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780919b5-db5b-4f62-9b94-1d7fbe742e69 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:11.443851 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 394/789] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:11.455670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780919b5-db5b-4f62-9b94-1d7fbe742e69 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:11.510748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:11.560979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 396/790] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:11.562062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543494f-7d99-4668-8f73-246e6716a3ec None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:11.589613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:11.608982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780919b5-db5b-4f62-9b94-1d7fbe742e69 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:11.689589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe1f53-f7e6-4650-a17c-68cbe67dc1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:11.690238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe1f53-f7e6-4650-a17c-68cbe67dc1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:11.690512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe1f53-f7e6-4650-a17c-68cbe67dc1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:11.690805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe1f53-f7e6-4650-a17c-68cbe67dc1e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:11.696889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543494f-7d99-4668-8f73-246e6716a3ec None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:11.711540 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe1f53-f7e6-4650-a17c-68cbe67dc1e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:11.713012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe1f53-f7e6-4650-a17c-68cbe67dc1e9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:11.733301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6dcbf-8102-49ae-9cbb-504056574d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:11.734021 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6dcbf-8102-49ae-9cbb-504056574d21 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:11.734296 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6dcbf-8102-49ae-9cbb-504056574d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:11.734565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6dcbf-8102-49ae-9cbb-504056574d21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-cdfe1f53-f7e6-4650-a17c-68cbe67dc1e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:11.739726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:11.740635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:11.741647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:11.741647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:11.741647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:11.741647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:11.741647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:11.741647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:11.741647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:11.741647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:11.741647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:41:11.741647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:11.743056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 395/791] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:41:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:11.747711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6dcbf-8102-49ae-9cbb-504056574d21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-26a6dcbf-8102-49ae-9cbb-504056574d21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:11.753378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:11.755531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:11.757919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:11.757919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:11.757919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:11.757919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:11.757919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:11.757919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:11.757919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:11.757919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:11.757919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:11.757919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:11.757919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:11.757919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:11.757919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 397/792] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:41:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:11.761544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe1f53-f7e6-4650-a17c-68cbe67dc1e9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:11.770932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6dcbf-8102-49ae-9cbb-504056574d21 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:11.884591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:11.898346 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:11.903870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe1f53-f7e6-4650-a17c-68cbe67dc1e9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:11.908584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6dcbf-8102-49ae-9cbb-504056574d21 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:11.942531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbc8f4-e7df-4c4a-84b0-c95d5d49ef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:11.943163 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbc8f4-e7df-4c4a-84b0-c95d5d49ef67 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:11.943438 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbc8f4-e7df-4c4a-84b0-c95d5d49ef67 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:11.943703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbc8f4-e7df-4c4a-84b0-c95d5d49ef67 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:11.944357 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbc8f4-e7df-4c4a-84b0-c95d5d49ef67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:11.944656 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbc8f4-e7df-4c4a-84b0-c95d5d49ef67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:11.946021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbc8f4-e7df-4c4a-84b0-c95d5d49ef67 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:11.955347 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 396/793] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:41:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:11.956274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbc8f4-e7df-4c4a-84b0-c95d5d49ef67 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:11.959720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7198e5e-89dc-467e-b427-25faeee43adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:11.960324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7198e5e-89dc-467e-b427-25faeee43adf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:11.960657 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7198e5e-89dc-467e-b427-25faeee43adf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:11.960931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7198e5e-89dc-467e-b427-25faeee43adf None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:11.961655 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7198e5e-89dc-467e-b427-25faeee43adf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:11.961957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7198e5e-89dc-467e-b427-25faeee43adf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:11.963389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7198e5e-89dc-467e-b427-25faeee43adf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:11.993317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 398/794] 10.222.0.33 () {56 vars in 1135 bytes} [Sun Sep 11 00:41:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:11.993317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7198e5e-89dc-467e-b427-25faeee43adf None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:12.070181 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbc8f4-e7df-4c4a-84b0-c95d5d49ef67 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:12.105977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad03b91-4e99-4681-aa77-c330972f352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:12.107014 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad03b91-4e99-4681-aa77-c330972f352c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:12.107489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad03b91-4e99-4681-aa77-c330972f352c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:12.107973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad03b91-4e99-4681-aa77-c330972f352c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:12.121136 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad03b91-4e99-4681-aa77-c330972f352c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:12.125187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7198e5e-89dc-467e-b427-25faeee43adf None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2ad03b91-4e99-4681-aa77-c330972f352c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:12.127680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:12.128623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:12.129442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:12.129442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:12.129442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:12.129442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:12.129442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:12.129442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:12.129442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:12.129442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:12.129442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:12.129442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:12.129442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:41:12.129442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:12.137115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 397/795] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:41:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:12.138402 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad03b91-4e99-4681-aa77-c330972f352c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:12.163568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:12.173804 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372130d-d2b1-4543-830c-2f1c584457c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:12.174686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372130d-d2b1-4543-830c-2f1c584457c8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:12.174986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372130d-d2b1-4543-830c-2f1c584457c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:12.175254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372130d-d2b1-4543-830c-2f1c584457c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:12.188482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372130d-d2b1-4543-830c-2f1c584457c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:12.190261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372130d-d2b1-4543-830c-2f1c584457c8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:12.192506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a372130d-d2b1-4543-830c-2f1c584457c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:12.210337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:12.211656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:12.212550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:12.212550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:12.212550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:12.219235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 399/796] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:12.220334 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372130d-d2b1-4543-830c-2f1c584457c8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:12.257486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad03b91-4e99-4681-aa77-c330972f352c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:12.292419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3575da-f18c-46fd-94aa-d5923f4536f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:12.293095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3575da-f18c-46fd-94aa-d5923f4536f6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:12.293312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3575da-f18c-46fd-94aa-d5923f4536f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:12.293577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3575da-f18c-46fd-94aa-d5923f4536f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:12.304050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3575da-f18c-46fd-94aa-d5923f4536f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:12.305478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3575da-f18c-46fd-94aa-d5923f4536f6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2b3575da-f18c-46fd-94aa-d5923f4536f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:12.319755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:12.320779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:12.321693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:12.321693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:12.321693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:12.321693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 398/797] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:12.321693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3575da-f18c-46fd-94aa-d5923f4536f6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:12.331990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372130d-d2b1-4543-830c-2f1c584457c8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:12.366866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658579e4-af66-4cb8-9f54-9e267463e608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:12.367465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658579e4-af66-4cb8-9f54-9e267463e608 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:12.367743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658579e4-af66-4cb8-9f54-9e267463e608 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:12.368015 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658579e4-af66-4cb8-9f54-9e267463e608 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:12.368676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658579e4-af66-4cb8-9f54-9e267463e608 None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:12.368976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658579e4-af66-4cb8-9f54-9e267463e608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:12.370333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658579e4-af66-4cb8-9f54-9e267463e608 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:12.378893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 400/798] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:41:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:12.380118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef3f6-2a11-40b3-a6ef-7663c5f61ffb None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:12.380398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef3f6-2a11-40b3-a6ef-7663c5f61ffb None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:12.380666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef3f6-2a11-40b3-a6ef-7663c5f61ffb None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:12.382000 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 401/799] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:12.383521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef3f6-2a11-40b3-a6ef-7663c5f61ffb None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:12.403677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:12.448855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3575da-f18c-46fd-94aa-d5923f4536f6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:12.449985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:12.489019 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810de22-dd98-4c28-b9a9-337849ccd1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:12.490015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810de22-dd98-4c28-b9a9-337849ccd1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:12.490383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810de22-dd98-4c28-b9a9-337849ccd1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:12.490751 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810de22-dd98-4c28-b9a9-337849ccd1d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:12.491830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810de22-dd98-4c28-b9a9-337849ccd1d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:12.492322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810de22-dd98-4c28-b9a9-337849ccd1d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:12.493817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810de22-dd98-4c28-b9a9-337849ccd1d3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:12.498850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef3f6-2a11-40b3-a6ef-7663c5f61ffb None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:12.506180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 399/800] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:12.511582 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810de22-dd98-4c28-b9a9-337849ccd1d3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:12.533259 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0dc19a-6739-4243-9a66-14980f7718f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:12.534269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dc19a-6739-4243-9a66-14980f7718f2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:12.534547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dc19a-6739-4243-9a66-14980f7718f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:12.534840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dc19a-6739-4243-9a66-14980f7718f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:12.535618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0dc19a-6739-4243-9a66-14980f7718f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:12.535915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0dc19a-6739-4243-9a66-14980f7718f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:12.537260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0dc19a-6739-4243-9a66-14980f7718f2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:12.553579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 402/801] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:12.553579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5213e-a6a9-4d6d-a47c-91af4d84b4a3 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:12.553579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5213e-a6a9-4d6d-a47c-91af4d84b4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:12.553579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5213e-a6a9-4d6d-a47c-91af4d84b4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:12.568630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ced5213e-a6a9-4d6d-a47c-91af4d84b4a3 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:12.569786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ced5213e-a6a9-4d6d-a47c-91af4d84b4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:12.616571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810de22-dd98-4c28-b9a9-337849ccd1d3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:12.648827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:12.649153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 403/802] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:12.650095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5213e-a6a9-4d6d-a47c-91af4d84b4a3 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:12.655097 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c763f-9265-4fad-9975-840e8193e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:12.656828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c763f-9265-4fad-9975-840e8193e02a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:12.657257 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c763f-9265-4fad-9975-840e8193e02a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:12.657704 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c763f-9265-4fad-9975-840e8193e02a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:12.670292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c763f-9265-4fad-9975-840e8193e02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:12.673152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c763f-9265-4fad-9975-840e8193e02a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0a8c763f-9265-4fad-9975-840e8193e02a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:12.696624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:12.697714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:12.698613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:12.698613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:12.698613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:12.706928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 400/803] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:12.706928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c763f-9265-4fad-9975-840e8193e02a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:12.715953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:12.790596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5213e-a6a9-4d6d-a47c-91af4d84b4a3 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:12.834565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c763f-9265-4fad-9975-840e8193e02a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:12.835058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254032b-35b5-4206-9027-8372d3f9f8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:12.835687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254032b-35b5-4206-9027-8372d3f9f8eb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:12.835975 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254032b-35b5-4206-9027-8372d3f9f8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:12.836242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254032b-35b5-4206-9027-8372d3f9f8eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:12.848542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254032b-35b5-4206-9027-8372d3f9f8eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:12.849967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254032b-35b5-4206-9027-8372d3f9f8eb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-4254032b-35b5-4206-9027-8372d3f9f8eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:12.863050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:12.864008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:12.864976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:12.864976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:12.864976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:12.864976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:12.864976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:12.864976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:12.864976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:12.864976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:12.864976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:41:12.864976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:12.866929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 404/804] 10.222.0.33 () {56 vars in 1093 bytes} [Sun Sep 11 00:41:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:12.867930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254032b-35b5-4206-9027-8372d3f9f8eb None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:12.876618 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3cd01-9c2c-4204-90ac-f27b0ffa3c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:12.877540 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3cd01-9c2c-4204-90ac-f27b0ffa3c5b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:12.878051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3cd01-9c2c-4204-90ac-f27b0ffa3c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:12.878516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3cd01-9c2c-4204-90ac-f27b0ffa3c5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:12.885739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3cd01-9c2c-4204-90ac-f27b0ffa3c5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:12.887431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3cd01-9c2c-4204-90ac-f27b0ffa3c5b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-73f3cd01-9c2c-4204-90ac-f27b0ffa3c5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:12.899640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:12.900954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:12.901836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:12.901836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:12.901836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:12.901836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:12.901836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:12.901836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:12.901836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:12.901836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:12.909367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 401/805] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:12.910647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3cd01-9c2c-4204-90ac-f27b0ffa3c5b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:12.958606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:12.980532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254032b-35b5-4206-9027-8372d3f9f8eb None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:12.988266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:13.014984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3cd01-9c2c-4204-90ac-f27b0ffa3c5b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:13.020596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91606dfc-8264-435f-9067-d1987a3cfcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:13.021199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91606dfc-8264-435f-9067-d1987a3cfcc7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:13.021476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91606dfc-8264-435f-9067-d1987a3cfcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:13.021742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91606dfc-8264-435f-9067-d1987a3cfcc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:13.022926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91606dfc-8264-435f-9067-d1987a3cfcc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:13.023231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91606dfc-8264-435f-9067-d1987a3cfcc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:13.025028 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91606dfc-8264-435f-9067-d1987a3cfcc7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:13.039133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 405/806] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:13.039887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91606dfc-8264-435f-9067-d1987a3cfcc7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:13.051551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fb691-f9ab-47d9-b80b-aa21c0b1ca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:13.052195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fb691-f9ab-47d9-b80b-aa21c0b1ca7f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:13.052531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fb691-f9ab-47d9-b80b-aa21c0b1ca7f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:13.052841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fb691-f9ab-47d9-b80b-aa21c0b1ca7f None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:13.053592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fb691-f9ab-47d9-b80b-aa21c0b1ca7f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:13.054171 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fb691-f9ab-47d9-b80b-aa21c0b1ca7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:13.055797 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fb691-f9ab-47d9-b80b-aa21c0b1ca7f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:13.075027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 402/807] 10.222.0.33 () {56 vars in 1133 bytes} [Sun Sep 11 00:41:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:13.082236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fb691-f9ab-47d9-b80b-aa21c0b1ca7f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:13.158521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91606dfc-8264-435f-9067-d1987a3cfcc7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:13.193823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fb691-f9ab-47d9-b80b-aa21c0b1ca7f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:13.195584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:13.195747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed1371-a85b-4c7d-a979-ba84a7f5d768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:13.196338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed1371-a85b-4c7d-a979-ba84a7f5d768 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:13.196618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed1371-a85b-4c7d-a979-ba84a7f5d768 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:13.196887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed1371-a85b-4c7d-a979-ba84a7f5d768 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:13.197585 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed1371-a85b-4c7d-a979-ba84a7f5d768 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:13.197977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed1371-a85b-4c7d-a979-ba84a7f5d768 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:13.199396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed1371-a85b-4c7d-a979-ba84a7f5d768 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:13.212017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 406/808] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:13.212805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed1371-a85b-4c7d-a979-ba84a7f5d768 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:13.229089 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f779e-e7f9-4117-a447-790037b5ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:13.229715 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f779e-e7f9-4117-a447-790037b5ad1c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:13.229983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f779e-e7f9-4117-a447-790037b5ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:13.230248 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f779e-e7f9-4117-a447-790037b5ad1c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:13.230856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f779e-e7f9-4117-a447-790037b5ad1c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:13.232211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f779e-e7f9-4117-a447-790037b5ad1c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:13.240289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-406f779e-e7f9-4117-a447-790037b5ad1c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:13.240700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:13.241710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:13.243041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 403/809] 10.222.0.33 () {56 vars in 1129 bytes} [Sun Sep 11 00:41:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:13.244027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f779e-e7f9-4117-a447-790037b5ad1c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:13.316542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed1371-a85b-4c7d-a979-ba84a7f5d768 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:13.339557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f779e-e7f9-4117-a447-790037b5ad1c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:13.350060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406dfa7-5d25-4e72-bacb-9fc637c92406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:13.350682 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406dfa7-5d25-4e72-bacb-9fc637c92406 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:13.350981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406dfa7-5d25-4e72-bacb-9fc637c92406 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:13.351250 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406dfa7-5d25-4e72-bacb-9fc637c92406 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:13.358551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406dfa7-5d25-4e72-bacb-9fc637c92406 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:13.359997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406dfa7-5d25-4e72-bacb-9fc637c92406 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-8406dfa7-5d25-4e72-bacb-9fc637c92406 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:13.371050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:13.371977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:13.372939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:13.372939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:13.372939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:13.372939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:13.372939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:13.372939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:13.372939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:13.372939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:13.372939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:41:13.372939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:13.372939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 407/810] 10.222.0.33 () {56 vars in 1117 bytes} [Sun Sep 11 00:41:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:13.374222 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966e181-e3c9-484c-83bc-1f018220e3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:13.374222 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966e181-e3c9-484c-83bc-1f018220e3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:13.374445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de65ac3-0e3d-4314-b942-9a43cff6a90c None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:13.374556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966e181-e3c9-484c-83bc-1f018220e3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:13.374655 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de65ac3-0e3d-4314-b942-9a43cff6a90c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:13.374778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966e181-e3c9-484c-83bc-1f018220e3d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:13.374880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de65ac3-0e3d-4314-b942-9a43cff6a90c None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:13.379513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 408/811] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:13.380242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de65ac3-0e3d-4314-b942-9a43cff6a90c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:13.413493 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:13.449472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966e181-e3c9-484c-83bc-1f018220e3d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:13.450981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966e181-e3c9-484c-83bc-1f018220e3d8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:13.468458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:13.484287 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de65ac3-0e3d-4314-b942-9a43cff6a90c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:13.516130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfde13a-14f9-4f9f-b451-bb335c81c775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:13.516765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde13a-14f9-4f9f-b451-bb335c81c775 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:13.517037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde13a-14f9-4f9f-b451-bb335c81c775 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:13.517302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde13a-14f9-4f9f-b451-bb335c81c775 None admin] PATH_INFO: `/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/e8baa8033f884cb6a7783f78c01a212e/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:13.519199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfde13a-14f9-4f9f-b451-bb335c81c775 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce5275375bc1421cb3fe6e27d5f685fe, user_id=e8baa8033f884cb6a7783f78c01a212e, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:13.520600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfde13a-14f9-4f9f-b451-bb335c81c775 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:13.532699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 409/812] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:41:13 2022] PUT /identity/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/e8baa8033f884cb6a7783f78c01a212e/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:41:13.533467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfde13a-14f9-4f9f-b451-bb335c81c775 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:13.563732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 404/813] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:41:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:41:13.564927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966e181-e3c9-484c-83bc-1f018220e3d8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:13.642139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:13.650543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfde13a-14f9-4f9f-b451-bb335c81c775 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:13.684678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966e181-e3c9-484c-83bc-1f018220e3d8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:13.688101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97387d-ba27-4130-b8a9-33bf7dda0f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:13.688718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97387d-ba27-4130-b8a9-33bf7dda0f5c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:13.688987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97387d-ba27-4130-b8a9-33bf7dda0f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:13.689257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97387d-ba27-4130-b8a9-33bf7dda0f5c None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:13.689890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97387d-ba27-4130-b8a9-33bf7dda0f5c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:13.690185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97387d-ba27-4130-b8a9-33bf7dda0f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:13.691594 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97387d-ba27-4130-b8a9-33bf7dda0f5c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:13.696929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 410/814] 10.222.0.33 () {56 vars in 1124 bytes} [Sun Sep 11 00:41:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:13.698573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28b8e9-247a-4741-ae14-ffa0c84388c4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:13.699195 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28b8e9-247a-4741-ae14-ffa0c84388c4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:13.699475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28b8e9-247a-4741-ae14-ffa0c84388c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:13.721361 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-fe28b8e9-247a-4741-ae14-ffa0c84388c4 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:13.722499 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fe28b8e9-247a-4741-ae14-ffa0c84388c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:13.725413 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:13.735433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d6ca2-f594-47bd-8d9e-6a9f60754335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:13.736069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d6ca2-f594-47bd-8d9e-6a9f60754335 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:13.736357 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d6ca2-f594-47bd-8d9e-6a9f60754335 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:13.736617 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d6ca2-f594-47bd-8d9e-6a9f60754335 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:13.737680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d6ca2-f594-47bd-8d9e-6a9f60754335 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:13.737990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d6ca2-f594-47bd-8d9e-6a9f60754335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:13.739523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d6ca2-f594-47bd-8d9e-6a9f60754335 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:13.756750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 405/815] 10.222.0.33 () {56 vars in 1149 bytes} [Sun Sep 11 00:41:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:13.757577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d6ca2-f594-47bd-8d9e-6a9f60754335 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:13.798563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 411/816] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:13.803984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28b8e9-247a-4741-ae14-ffa0c84388c4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:13.862708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d6ca2-f594-47bd-8d9e-6a9f60754335 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:13.887986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:13.900237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e337af2-5765-4db2-81e3-001ce62fadc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:13.900941 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e337af2-5765-4db2-81e3-001ce62fadc8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:13.901190 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e337af2-5765-4db2-81e3-001ce62fadc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:13.901470 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e337af2-5765-4db2-81e3-001ce62fadc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:13.912500 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e337af2-5765-4db2-81e3-001ce62fadc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:13.914104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e337af2-5765-4db2-81e3-001ce62fadc8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8e337af2-5765-4db2-81e3-001ce62fadc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:13.929386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:13.930323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:13.931261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:13.931261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:13.931261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:13.931261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 406/817] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:13.931508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e337af2-5765-4db2-81e3-001ce62fadc8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:13.942311 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28b8e9-247a-4741-ae14-ffa0c84388c4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:13.985375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8d262-1e38-4bb2-af93-cda2ed88627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:13.985980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8d262-1e38-4bb2-af93-cda2ed88627b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:13.986255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8d262-1e38-4bb2-af93-cda2ed88627b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:13.986522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8d262-1e38-4bb2-af93-cda2ed88627b None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:13.987183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8d262-1e38-4bb2-af93-cda2ed88627b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:13.987480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8d262-1e38-4bb2-af93-cda2ed88627b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:13.988938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8d262-1e38-4bb2-af93-cda2ed88627b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:13.994359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 412/818] 10.222.0.33 () {56 vars in 1124 bytes} [Sun Sep 11 00:41:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:13.995214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8d262-1e38-4bb2-af93-cda2ed88627b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:14.000165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:14.065042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e337af2-5765-4db2-81e3-001ce62fadc8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:14.105825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8d262-1e38-4bb2-af93-cda2ed88627b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:14.106060 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7ca71-c39d-4367-8d7b-f4aa4cd83486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:14.106507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7ca71-c39d-4367-8d7b-f4aa4cd83486 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:14.106816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7ca71-c39d-4367-8d7b-f4aa4cd83486 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:14.107086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7ca71-c39d-4367-8d7b-f4aa4cd83486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:14.120898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7ca71-c39d-4367-8d7b-f4aa4cd83486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:14.123745 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7ca71-c39d-4367-8d7b-f4aa4cd83486 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-75e7ca71-c39d-4367-8d7b-f4aa4cd83486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:14.140348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:14.141308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:14.142278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:14.142278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:14.142278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:14.144193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced88b6-1eac-43c1-8b03-9489271a1ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:14.144795 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced88b6-1eac-43c1-8b03-9489271a1ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:14.145074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced88b6-1eac-43c1-8b03-9489271a1ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:14.145343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced88b6-1eac-43c1-8b03-9489271a1ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:14.146062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 407/819] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:14.146174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced88b6-1eac-43c1-8b03-9489271a1ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:14.146362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced88b6-1eac-43c1-8b03-9489271a1ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:14.146888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7ca71-c39d-4367-8d7b-f4aa4cd83486 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:14.147731 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced88b6-1eac-43c1-8b03-9489271a1ad8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:14.164580 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 413/820] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:14.165434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced88b6-1eac-43c1-8b03-9489271a1ad8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:14.176877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:14.236207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:14.253091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7ca71-c39d-4367-8d7b-f4aa4cd83486 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:14.276555 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced88b6-1eac-43c1-8b03-9489271a1ad8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:14.290155 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5831-54fc-42d1-a265-3aebc6b49432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:14.290781 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5831-54fc-42d1-a265-3aebc6b49432 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:14.291056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5831-54fc-42d1-a265-3aebc6b49432 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:14.291335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5831-54fc-42d1-a265-3aebc6b49432 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:14.291975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a5831-54fc-42d1-a265-3aebc6b49432 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:14.293554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a5831-54fc-42d1-a265-3aebc6b49432 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:14.311621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ceac58-7375-44ff-8d9b-5b64c5ca6bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:14.312252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceac58-7375-44ff-8d9b-5b64c5ca6bea None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:14.312532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceac58-7375-44ff-8d9b-5b64c5ca6bea None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:14.312836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceac58-7375-44ff-8d9b-5b64c5ca6bea None admin] PATH_INFO: `/v3/services/network` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:14.313380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ceac58-7375-44ff-8d9b-5b64c5ca6bea None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:14.314771 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ceac58-7375-44ff-8d9b-5b64c5ca6bea None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:14.326756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 408/821] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:41:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:14.326756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5831-54fc-42d1-a265-3aebc6b49432 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b3ceac58-7375-44ff-8d9b-5b64c5ca6bea None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:14.327052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:14.328273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:14.329105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 414/822] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:14 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:14.329914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ceac58-7375-44ff-8d9b-5b64c5ca6bea None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:14.476997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:14.485276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ceac58-7375-44ff-8d9b-5b64c5ca6bea None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:14.504513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5831-54fc-42d1-a265-3aebc6b49432 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:14.523674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:14.532908 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373ac28-3ad5-4684-8464-1bd603e01c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:14.533540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373ac28-3ad5-4684-8464-1bd603e01c5c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:14.533822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373ac28-3ad5-4684-8464-1bd603e01c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:14.534080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373ac28-3ad5-4684-8464-1bd603e01c5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:14.544514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373ac28-3ad5-4684-8464-1bd603e01c5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:14.544514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373ac28-3ad5-4684-8464-1bd603e01c5c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:14.547572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f06f1-3e34-44e7-ac23-00408e78197e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:14.548129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f06f1-3e34-44e7-ac23-00408e78197e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:14.548407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f06f1-3e34-44e7-ac23-00408e78197e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:14.551077 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f06f1-3e34-44e7-ac23-00408e78197e None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:14.551077 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f06f1-3e34-44e7-ac23-00408e78197e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:14.551077 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f06f1-3e34-44e7-ac23-00408e78197e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:14.551077 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f06f1-3e34-44e7-ac23-00408e78197e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-2373ac28-3ad5-4684-8464-1bd603e01c5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:14.558219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:14.559128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:14.560024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:14.560024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:14.560024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:14.560024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:14.560024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:14.560024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:14.560024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:14.560024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:14.560024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 415/823] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:14.561666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373ac28-3ad5-4684-8464-1bd603e01c5c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:14.568624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 409/824] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:14.570570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f06f1-3e34-44e7-ac23-00408e78197e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:14.683093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373ac28-3ad5-4684-8464-1bd603e01c5c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:14.693555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f06f1-3e34-44e7-ac23-00408e78197e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:14.721453 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329ae5d-9dfb-43dc-9767-f6a715e2db1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:14.722216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329ae5d-9dfb-43dc-9767-f6a715e2db1a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:14.722599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329ae5d-9dfb-43dc-9767-f6a715e2db1a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:14.722993 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329ae5d-9dfb-43dc-9767-f6a715e2db1a None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:14.723906 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329ae5d-9dfb-43dc-9767-f6a715e2db1a None admin] RBAC: Adding query filter params (name=network) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:14.724096 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329ae5d-9dfb-43dc-9767-f6a715e2db1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:14.725538 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329ae5d-9dfb-43dc-9767-f6a715e2db1a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:14.730590 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 416/825] 10.222.0.33 () {56 vars in 1112 bytes} [Sun Sep 11 00:41:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:14.731490 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329ae5d-9dfb-43dc-9767-f6a715e2db1a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:14.732586 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a700539-521a-4623-af79-57bb3686c383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:14.733361 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a700539-521a-4623-af79-57bb3686c383 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:14.733795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a700539-521a-4623-af79-57bb3686c383 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:14.734208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a700539-521a-4623-af79-57bb3686c383 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:14.735178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a700539-521a-4623-af79-57bb3686c383 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:14.735681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a700539-521a-4623-af79-57bb3686c383 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:14.737294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a700539-521a-4623-af79-57bb3686c383 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:14.746707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:14.755745 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 410/826] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:14.756949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a700539-521a-4623-af79-57bb3686c383 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:14.794364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:14.855931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329ae5d-9dfb-43dc-9767-f6a715e2db1a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:14.879453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a700539-521a-4623-af79-57bb3686c383 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:14.906766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2ca70-2c5b-4482-b65e-75362aff5076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:14.907684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2ca70-2c5b-4482-b65e-75362aff5076 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:14.908130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2ca70-2c5b-4482-b65e-75362aff5076 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:14.908614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2ca70-2c5b-4482-b65e-75362aff5076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:14.915971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2ca70-2c5b-4482-b65e-75362aff5076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:14.917604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2ca70-2c5b-4482-b65e-75362aff5076 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:14.919531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdce76e-ac5e-4187-9fed-4c831a735645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:14.920055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdce76e-ac5e-4187-9fed-4c831a735645 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:14.920500 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdce76e-ac5e-4187-9fed-4c831a735645 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:14.920840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdce76e-ac5e-4187-9fed-4c831a735645 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:14.921615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdce76e-ac5e-4187-9fed-4c831a735645 None admin] RBAC: Adding query filter params (type=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:14.921949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdce76e-ac5e-4187-9fed-4c831a735645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:14.923481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdce76e-ac5e-4187-9fed-4c831a735645 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:14.928929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 411/827] 10.222.0.33 () {56 vars in 1112 bytes} [Sun Sep 11 00:41:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:14.929868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdce76e-ac5e-4187-9fed-4c831a735645 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-50e2ca70-2c5b-4482-b65e-75362aff5076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:14.931726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:14.932602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:14.933645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:14.933645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:14.933645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:14.933645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:14.933645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:14.933645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:14.933645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:14.933645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:14.936637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 417/828] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:14.937612 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2ca70-2c5b-4482-b65e-75362aff5076 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:14.999425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:15.040614 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdce76e-ac5e-4187-9fed-4c831a735645 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:15.045001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2ca70-2c5b-4482-b65e-75362aff5076 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:15.058374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:15.077741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ec781-516f-49d9-bc49-ad5bee6d066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:15.078356 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ec781-516f-49d9-bc49-ad5bee6d066e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:15.078635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ec781-516f-49d9-bc49-ad5bee6d066e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:15.078934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ec781-516f-49d9-bc49-ad5bee6d066e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:15.079653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ec781-516f-49d9-bc49-ad5bee6d066e None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=ab5f197fb09e422997434a1b2feb4567) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:15.079960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ec781-516f-49d9-bc49-ad5bee6d066e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:15.081699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ec781-516f-49d9-bc49-ad5bee6d066e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:15.084000 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f491380-f405-4fc2-8875-b6b2ce239f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:15.084843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f491380-f405-4fc2-8875-b6b2ce239f7f None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:15.085323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f491380-f405-4fc2-8875-b6b2ce239f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:15.085794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f491380-f405-4fc2-8875-b6b2ce239f7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:15.086645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f491380-f405-4fc2-8875-b6b2ce239f7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:15.088210 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f491380-f405-4fc2-8875-b6b2ce239f7f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:15.088617 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 412/829] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:41:14 2022] GET /identity/v3/role_assignments?user.id=ab5f197fb09e422997434a1b2feb4567&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:15.089426 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ec781-516f-49d9-bc49-ad5bee6d066e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:15.117341 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 418/830] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:41:14 2022] POST /identity/v3/endpoints => generated 337 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:15.215536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ec781-516f-49d9-bc49-ad5bee6d066e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:15.247179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:15.264422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0d8e4-304f-409d-8692-da65c0b5002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:15.265059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0d8e4-304f-409d-8692-da65c0b5002f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:15.265337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0d8e4-304f-409d-8692-da65c0b5002f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:15.265670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0d8e4-304f-409d-8692-da65c0b5002f None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:15.266388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0d8e4-304f-409d-8692-da65c0b5002f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:15.266692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0d8e4-304f-409d-8692-da65c0b5002f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:15.268348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0d8e4-304f-409d-8692-da65c0b5002f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:15.283378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 413/831] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:15.289494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f491380-f405-4fc2-8875-b6b2ce239f7f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:15.429185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f491380-f405-4fc2-8875-b6b2ce239f7f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:15.471675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243319f1-1294-4dfd-a33e-a31ec2b091bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:15.472679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243319f1-1294-4dfd-a33e-a31ec2b091bd None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:15.473155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243319f1-1294-4dfd-a33e-a31ec2b091bd None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:15.473648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243319f1-1294-4dfd-a33e-a31ec2b091bd None admin] PATH_INFO: `/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/f2c9025c666340aaaf2a664c88650942/roles/62da722185f844e3acdc4e690c9903b7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:15.493439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243319f1-1294-4dfd-a33e-a31ec2b091bd None admin] RBAC: Authorizing `identity:create_grant(project_id=ce5275375bc1421cb3fe6e27d5f685fe, user_id=f2c9025c666340aaaf2a664c88650942, role_id=62da722185f844e3acdc4e690c9903b7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:15.494960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243319f1-1294-4dfd-a33e-a31ec2b091bd None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:15.510521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 419/832] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:41:15 2022] PUT /identity/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/f2c9025c666340aaaf2a664c88650942/roles/62da722185f844e3acdc4e690c9903b7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:41:15.752827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0d7fc-d1cc-495f-9f9d-f1fe36205f17 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:15.753217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0d7fc-d1cc-495f-9f9d-f1fe36205f17 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:15.753418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0d7fc-d1cc-495f-9f9d-f1fe36205f17 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:15.755007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 414/833] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:15.760322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb556a40-37ce-41a4-ae9c-4014a8c81a90 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:15.760607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb556a40-37ce-41a4-ae9c-4014a8c81a90 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:15.760875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb556a40-37ce-41a4-ae9c-4014a8c81a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:15.779796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-cb556a40-37ce-41a4-ae9c-4014a8c81a90 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:15.780970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cb556a40-37ce-41a4-ae9c-4014a8c81a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:15.795923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:15.851195 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 420/834] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:16.121497 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0d7fc-d1cc-495f-9f9d-f1fe36205f17 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:16.227316 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0d7fc-d1cc-495f-9f9d-f1fe36205f17 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:16.263668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687f128-2be0-4985-be6e-16232f1ce322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:16.264427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687f128-2be0-4985-be6e-16232f1ce322 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:16.264707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687f128-2be0-4985-be6e-16232f1ce322 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:16.264979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687f128-2be0-4985-be6e-16232f1ce322 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:16.275787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687f128-2be0-4985-be6e-16232f1ce322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5687f128-2be0-4985-be6e-16232f1ce322 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:16.280667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:16.281572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:16.282832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:16.282832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:16.282832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:16.282832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:16.282832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:16.282832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:16.282832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:16.282832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:16.282832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:16.282832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:16.282832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:16.282832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:16.282832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 415/835] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:41:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:16.287674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb556a40-37ce-41a4-ae9c-4014a8c81a90 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:16.389621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb556a40-37ce-41a4-ae9c-4014a8c81a90 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:16.431030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0cb1b-ad5e-4c37-a98b-170a2533b2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:16.432080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0cb1b-ad5e-4c37-a98b-170a2533b2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:16.432564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0cb1b-ad5e-4c37-a98b-170a2533b2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:16.433060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0cb1b-ad5e-4c37-a98b-170a2533b2b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:16.434025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0cb1b-ad5e-4c37-a98b-170a2533b2b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:16.435083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0cb1b-ad5e-4c37-a98b-170a2533b2b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:16.436670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0cb1b-ad5e-4c37-a98b-170a2533b2b9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:16.446276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 421/836] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:41:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:16.452105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687f128-2be0-4985-be6e-16232f1ce322 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:16.499204 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:16.554572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687f128-2be0-4985-be6e-16232f1ce322 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:16.590143 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b9511-5fda-4646-9871-eb1c748d94a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:16.590847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b9511-5fda-4646-9871-eb1c748d94a7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:16.591155 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b9511-5fda-4646-9871-eb1c748d94a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:16.591433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b9511-5fda-4646-9871-eb1c748d94a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:16.601673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b9511-5fda-4646-9871-eb1c748d94a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:16.603146 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b9511-5fda-4646-9871-eb1c748d94a7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5f5b9511-5fda-4646-9871-eb1c748d94a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:16.618389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:16.619399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:16.620933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:16.620933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:16.620933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:16.620933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 416/837] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:16.625780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0cb1b-ad5e-4c37-a98b-170a2533b2b9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:16.641181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:16.731052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0cb1b-ad5e-4c37-a98b-170a2533b2b9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:16.749686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca44eb5-daa4-4338-8838-64aaeb1557b8 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:16.749993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca44eb5-daa4-4338-8838-64aaeb1557b8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:16.750237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca44eb5-daa4-4338-8838-64aaeb1557b8 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:16.751883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 417/838] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:16.756897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5d7f9-43d2-404d-ade5-10812cb8e590 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:16.757179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5d7f9-43d2-404d-ade5-10812cb8e590 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:16.757451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5d7f9-43d2-404d-ade5-10812cb8e590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:16.768292 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa0646-f3c5-476b-a550-1df9fb10bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:16.768894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa0646-f3c5-476b-a550-1df9fb10bc54 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:16.769174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa0646-f3c5-476b-a550-1df9fb10bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:16.769439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa0646-f3c5-476b-a550-1df9fb10bc54 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:16.770084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa0646-f3c5-476b-a550-1df9fb10bc54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:16.770383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa0646-f3c5-476b-a550-1df9fb10bc54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:16.772311 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa0646-f3c5-476b-a550-1df9fb10bc54 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:16.777566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1ba5d7f9-43d2-404d-ade5-10812cb8e590 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:16.778846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1ba5d7f9-43d2-404d-ade5-10812cb8e590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:16.785370 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 422/839] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:16.790720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa0646-f3c5-476b-a550-1df9fb10bc54 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:16.850901 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 418/840] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:16.883083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:16.900978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa0646-f3c5-476b-a550-1df9fb10bc54 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:16.935616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b46d12-2a7d-443e-813a-0bf53fd4b054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:16.936234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b46d12-2a7d-443e-813a-0bf53fd4b054 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:16.936508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b46d12-2a7d-443e-813a-0bf53fd4b054 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:16.936772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b46d12-2a7d-443e-813a-0bf53fd4b054 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:16.943782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b46d12-2a7d-443e-813a-0bf53fd4b054 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:16.945200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b46d12-2a7d-443e-813a-0bf53fd4b054 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-94b46d12-2a7d-443e-813a-0bf53fd4b054 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:16.956919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:16.957825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:16.958903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:16.958903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:16.958903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:16.958903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:16.958903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:16.958903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:16.958903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:16.958903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:16.958903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:41:16.958903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:16.958903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 423/841] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:41:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:16.966287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5d7f9-43d2-404d-ade5-10812cb8e590 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:16.998602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:17.077959 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5d7f9-43d2-404d-ade5-10812cb8e590 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:17.113252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6f439-6c8c-4171-b01e-08a68c668934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:17.113860 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6f439-6c8c-4171-b01e-08a68c668934 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:17.114135 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6f439-6c8c-4171-b01e-08a68c668934 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:17.114403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6f439-6c8c-4171-b01e-08a68c668934 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:17.115326 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6f439-6c8c-4171-b01e-08a68c668934 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:17.115626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6f439-6c8c-4171-b01e-08a68c668934 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:17.117049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6f439-6c8c-4171-b01e-08a68c668934 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:17.123367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b46d12-2a7d-443e-813a-0bf53fd4b054 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:17.145303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 419/842] 10.222.0.33 () {56 vars in 1135 bytes} [Sun Sep 11 00:41:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:17.147693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6f439-6c8c-4171-b01e-08a68c668934 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:17.255056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b46d12-2a7d-443e-813a-0bf53fd4b054 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:17.259924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:17.277579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6f439-6c8c-4171-b01e-08a68c668934 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:17.295542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:17.304272 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c23685-d5f8-4492-8629-3ffa33adc0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:17.305289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c23685-d5f8-4492-8629-3ffa33adc0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:17.305768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c23685-d5f8-4492-8629-3ffa33adc0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:17.306235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c23685-d5f8-4492-8629-3ffa33adc0b0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:17.307140 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c23685-d5f8-4492-8629-3ffa33adc0b0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:17.308792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c23685-d5f8-4492-8629-3ffa33adc0b0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-95c23685-d5f8-4492-8629-3ffa33adc0b0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:17.319205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:17.320283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:41:17.321130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:17.329751 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 424/843] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:41:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:17.331156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c23685-d5f8-4492-8629-3ffa33adc0b0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:17.432524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f95a84-d102-4ec4-99eb-f92b19bc80a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:17.433385 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f95a84-d102-4ec4-99eb-f92b19bc80a0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:17.433682 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f95a84-d102-4ec4-99eb-f92b19bc80a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:17.434098 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f95a84-d102-4ec4-99eb-f92b19bc80a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:17.453574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c23685-d5f8-4492-8629-3ffa33adc0b0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:17.498711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5951976-f422-46fa-847b-ac923355b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:17.499955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5951976-f422-46fa-847b-ac923355b7ef None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:17.500712 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5951976-f422-46fa-847b-ac923355b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:17.501161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5951976-f422-46fa-847b-ac923355b7ef None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:17.501957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5951976-f422-46fa-847b-ac923355b7ef None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:17.502431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5951976-f422-46fa-847b-ac923355b7ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:17.504129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5951976-f422-46fa-847b-ac923355b7ef None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:17.506699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f95a84-d102-4ec4-99eb-f92b19bc80a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:17.508245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f95a84-d102-4ec4-99eb-f92b19bc80a0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:17.515040 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 425/844] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:41:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:17.516599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5951976-f422-46fa-847b-ac923355b7ef None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:17.578348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:17.631188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:17.635252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5951976-f422-46fa-847b-ac923355b7ef None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:17.664559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 420/845] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:41:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:41:17.665330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f95a84-d102-4ec4-99eb-f92b19bc80a0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:17.686594 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d4d91-9324-46e9-b2aa-924690c43dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:17.688131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4d91-9324-46e9-b2aa-924690c43dac None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:17.688636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4d91-9324-46e9-b2aa-924690c43dac None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:17.689354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4d91-9324-46e9-b2aa-924690c43dac None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:17.690440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d4d91-9324-46e9-b2aa-924690c43dac None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:17.691366 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d4d91-9324-46e9-b2aa-924690c43dac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:17.693489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d4d91-9324-46e9-b2aa-924690c43dac None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:17.707750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 426/846] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:41:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:17.736317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cb12f-1571-4c50-8540-27c4afbaad99 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:17.736597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cb12f-1571-4c50-8540-27c4afbaad99 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:17.736869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cb12f-1571-4c50-8540-27c4afbaad99 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:17.738255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 427/847] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:41:17.744139 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1c9f-daad-426b-b3f3-9d37a1af5dec None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:17.744413 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1c9f-daad-426b-b3f3-9d37a1af5dec None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:17.744684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1c9f-daad-426b-b3f3-9d37a1af5dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:17.765744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-acde1c9f-daad-426b-b3f3-9d37a1af5dec None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:17.766912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-acde1c9f-daad-426b-b3f3-9d37a1af5dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:17.790102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f95a84-d102-4ec4-99eb-f92b19bc80a0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:17.829197 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47737a-5291-4f27-87f1-89132f106722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:17.829852 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47737a-5291-4f27-87f1-89132f106722 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:17.830115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47737a-5291-4f27-87f1-89132f106722 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:17.830380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47737a-5291-4f27-87f1-89132f106722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:17.841489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47737a-5291-4f27-87f1-89132f106722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:17.846873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 428/848] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:17.847071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47737a-5291-4f27-87f1-89132f106722 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:17.847155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163cd09-5f1c-4e57-94d6-f5e7846c08db None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:17.847155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163cd09-5f1c-4e57-94d6-f5e7846c08db None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:17.847155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163cd09-5f1c-4e57-94d6-f5e7846c08db None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:17.847155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 429/849] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:17.851424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88492e25-b268-4c97-bf73-ba6e3d492ab6 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:17.851899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88492e25-b268-4c97-bf73-ba6e3d492ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:17.852311 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88492e25-b268-4c97-bf73-ba6e3d492ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-fb47737a-5291-4f27-87f1-89132f106722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:17.866093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:17.867199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:17.868438 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:17.868438 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:17.868438 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:17.868438 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 421/850] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:17.875835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47737a-5291-4f27-87f1-89132f106722 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:17.877188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-88492e25-b268-4c97-bf73-ba6e3d492ab6 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:17.878426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-88492e25-b268-4c97-bf73-ba6e3d492ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:17.923616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:17.952333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:17.967497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 430/851] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:17.993459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47737a-5291-4f27-87f1-89132f106722 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:18.029784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6a0f1-86ba-476d-bf4c-05165f665f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:18.031167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6a0f1-86ba-476d-bf4c-05165f665f97 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:18.031666 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6a0f1-86ba-476d-bf4c-05165f665f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:18.032138 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6a0f1-86ba-476d-bf4c-05165f665f97 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:18.033286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6a0f1-86ba-476d-bf4c-05165f665f97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:18.033834 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6a0f1-86ba-476d-bf4c-05165f665f97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:18.035600 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6a0f1-86ba-476d-bf4c-05165f665f97 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:18.049002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 422/852] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:18.055031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88492e25-b268-4c97-bf73-ba6e3d492ab6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:18.115215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6a0f1-86ba-476d-bf4c-05165f665f97 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:18.158935 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88492e25-b268-4c97-bf73-ba6e3d492ab6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:18.195678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cc1d3-2317-43c3-b43a-57686794d8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:18.196359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cc1d3-2317-43c3-b43a-57686794d8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:18.196673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cc1d3-2317-43c3-b43a-57686794d8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:18.196938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cc1d3-2317-43c3-b43a-57686794d8c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:18.204215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cc1d3-2317-43c3-b43a-57686794d8c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:18.205756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cc1d3-2317-43c3-b43a-57686794d8c0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-977cc1d3-2317-43c3-b43a-57686794d8c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:18.217596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:18.218619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:18.219562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:18.219562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:18.219562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:18.219562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:18.219562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:18.219562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:18.219562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:18.219562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:18.223159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 431/853] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:18.224690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cc1d3-2317-43c3-b43a-57686794d8c0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:18.240882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:18.249943 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6a0f1-86ba-476d-bf4c-05165f665f97 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:18.274530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:18.287713 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ce76-e13c-484e-91df-3532fa24c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:18.288278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ce76-e13c-484e-91df-3532fa24c642 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:18.288549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ce76-e13c-484e-91df-3532fa24c642 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:18.289007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ce76-e13c-484e-91df-3532fa24c642 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:18.289378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6ce76-e13c-484e-91df-3532fa24c642 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:18.290737 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6ce76-e13c-484e-91df-3532fa24c642 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a0a6ce76-e13c-484e-91df-3532fa24c642 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:18.300530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:18.301477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:18.302368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 423/854] 10.222.0.33 () {56 vars in 1132 bytes} [Sun Sep 11 00:41:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:18.303798 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ce76-e13c-484e-91df-3532fa24c642 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:18.343155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cc1d3-2317-43c3-b43a-57686794d8c0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:18.381426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa841e-de5b-4685-9bec-d81b668b46b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:18.382029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa841e-de5b-4685-9bec-d81b668b46b7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:18.382313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa841e-de5b-4685-9bec-d81b668b46b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:18.382579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa841e-de5b-4685-9bec-d81b668b46b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:18.383300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa841e-de5b-4685-9bec-d81b668b46b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:18.383608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa841e-de5b-4685-9bec-d81b668b46b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:18.385018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa841e-de5b-4685-9bec-d81b668b46b7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:18.402880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 432/855] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:18.402880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa841e-de5b-4685-9bec-d81b668b46b7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:18.413261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ce76-e13c-484e-91df-3532fa24c642 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:18.455616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841111f-8357-44ff-879d-004cc0078973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:18.456245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841111f-8357-44ff-879d-004cc0078973 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:18.456521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841111f-8357-44ff-879d-004cc0078973 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:18.456791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841111f-8357-44ff-879d-004cc0078973 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:18.468004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841111f-8357-44ff-879d-004cc0078973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7841111f-8357-44ff-879d-004cc0078973 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:18.474096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:18.475063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:18.475934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:18.475934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:18.475934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:18.475934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:18.475934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:18.475934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:18.475934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:18.475934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:18.475934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:18.475934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:18.475934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:41:18.475934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:18.475934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 424/856] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:41:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:18.476652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841111f-8357-44ff-879d-004cc0078973 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:18.499801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:18.529082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa841e-de5b-4685-9bec-d81b668b46b7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:18.530808 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:18.566199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1efc1-a205-4da3-a0bf-c51a21bf02ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:18.566775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1efc1-a205-4da3-a0bf-c51a21bf02ea None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:18.567056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1efc1-a205-4da3-a0bf-c51a21bf02ea None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:18.567330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1efc1-a205-4da3-a0bf-c51a21bf02ea None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:18.567956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1efc1-a205-4da3-a0bf-c51a21bf02ea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:18.568257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1efc1-a205-4da3-a0bf-c51a21bf02ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:18.569658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1efc1-a205-4da3-a0bf-c51a21bf02ea None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:18.574232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 433/857] 10.222.0.33 () {56 vars in 1126 bytes} [Sun Sep 11 00:41:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:18.575044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1efc1-a205-4da3-a0bf-c51a21bf02ea None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:18.586192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841111f-8357-44ff-879d-004cc0078973 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:18.620304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96facc6b-e350-48fe-acdf-ac77df93d288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:18.620905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96facc6b-e350-48fe-acdf-ac77df93d288 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:18.621705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96facc6b-e350-48fe-acdf-ac77df93d288 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:18.621974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96facc6b-e350-48fe-acdf-ac77df93d288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:18.622682 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96facc6b-e350-48fe-acdf-ac77df93d288 None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=e8baa8033f884cb6a7783f78c01a212e) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:18.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96facc6b-e350-48fe-acdf-ac77df93d288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:18.624437 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96facc6b-e350-48fe-acdf-ac77df93d288 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:18.638898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 425/858] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:41:18 2022] GET /identity/v3/role_assignments?user.id=e8baa8033f884cb6a7783f78c01a212e&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:18.638898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96facc6b-e350-48fe-acdf-ac77df93d288 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:18.704982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1efc1-a205-4da3-a0bf-c51a21bf02ea None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:18.754674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5fcec-d7ab-4383-b930-4dc29fc3926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:18.755266 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:18.755389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5fcec-d7ab-4383-b930-4dc29fc3926b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:18.755620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5fcec-d7ab-4383-b930-4dc29fc3926b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:18.755909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5fcec-d7ab-4383-b930-4dc29fc3926b None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:18.756746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5fcec-d7ab-4383-b930-4dc29fc3926b None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:18.757071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5fcec-d7ab-4383-b930-4dc29fc3926b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:18.759114 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5fcec-d7ab-4383-b930-4dc29fc3926b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:18.771696 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 434/859] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:41:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:18.777109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5fcec-d7ab-4383-b930-4dc29fc3926b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:18.781016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96facc6b-e350-48fe-acdf-ac77df93d288 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:18.820085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:18.820398 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1237e-969c-4591-9385-cfede75d3b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:18.821532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1237e-969c-4591-9385-cfede75d3b70 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:18.822191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1237e-969c-4591-9385-cfede75d3b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:18.822827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1237e-969c-4591-9385-cfede75d3b70 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:18.824511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1237e-969c-4591-9385-cfede75d3b70 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:18.824975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1237e-969c-4591-9385-cfede75d3b70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:18.826927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1237e-969c-4591-9385-cfede75d3b70 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:18.832712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 426/860] 10.222.0.33 () {56 vars in 1126 bytes} [Sun Sep 11 00:41:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:18.902691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5fcec-d7ab-4383-b930-4dc29fc3926b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:18.942267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703da5e5-bcbd-4aca-b3f9-e8ab65e2f125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:18.943563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703da5e5-bcbd-4aca-b3f9-e8ab65e2f125 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:18.944277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703da5e5-bcbd-4aca-b3f9-e8ab65e2f125 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:18.944803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703da5e5-bcbd-4aca-b3f9-e8ab65e2f125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:18.958274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703da5e5-bcbd-4aca-b3f9-e8ab65e2f125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:18.960016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703da5e5-bcbd-4aca-b3f9-e8ab65e2f125 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-703da5e5-bcbd-4aca-b3f9-e8ab65e2f125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:18.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:18.977378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:18.978523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:18.978523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:18.978523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:18.980943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 435/861] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:18.986561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1237e-969c-4591-9385-cfede75d3b70 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:19.094937 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1237e-969c-4591-9385-cfede75d3b70 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:19.130097 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66360cbc-3e7a-468d-b51e-3d18d0b87e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:19.130705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66360cbc-3e7a-468d-b51e-3d18d0b87e7c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:19.131004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66360cbc-3e7a-468d-b51e-3d18d0b87e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:19.131317 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66360cbc-3e7a-468d-b51e-3d18d0b87e7c None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:19.132010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66360cbc-3e7a-468d-b51e-3d18d0b87e7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:19.132312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66360cbc-3e7a-468d-b51e-3d18d0b87e7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:19.133671 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66360cbc-3e7a-468d-b51e-3d18d0b87e7c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:19.146551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 427/862] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:19.151875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703da5e5-bcbd-4aca-b3f9-e8ab65e2f125 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:19.236250 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:19.256877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703da5e5-bcbd-4aca-b3f9-e8ab65e2f125 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:19.290875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af28925-8887-47a8-aeb5-577edb4e297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:19.291627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28925-8887-47a8-aeb5-577edb4e297c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:19.292029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28925-8887-47a8-aeb5-577edb4e297c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:19.292302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28925-8887-47a8-aeb5-577edb4e297c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:19.300127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af28925-8887-47a8-aeb5-577edb4e297c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:19.301541 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af28925-8887-47a8-aeb5-577edb4e297c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-5af28925-8887-47a8-aeb5-577edb4e297c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:19.313253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:19.314222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:19.315217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:19.315217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:19.315217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:19.315217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:19.315217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:19.315217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:19.315217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:19.315217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:19.315217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:41:19.315217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:19.315217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 436/863] 10.222.0.33 () {56 vars in 1117 bytes} [Sun Sep 11 00:41:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:19.320274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66360cbc-3e7a-468d-b51e-3d18d0b87e7c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:19.332129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:19.432137 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66360cbc-3e7a-468d-b51e-3d18d0b87e7c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:19.469309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520f79d-e7aa-4e3e-81ac-3d407b877806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:19.469913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520f79d-e7aa-4e3e-81ac-3d407b877806 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:19.470191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520f79d-e7aa-4e3e-81ac-3d407b877806 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:19.470459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520f79d-e7aa-4e3e-81ac-3d407b877806 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:19.471269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520f79d-e7aa-4e3e-81ac-3d407b877806 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:19.471577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520f79d-e7aa-4e3e-81ac-3d407b877806 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:19.473000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520f79d-e7aa-4e3e-81ac-3d407b877806 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:19.491889 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 428/864] 10.222.0.33 () {56 vars in 1149 bytes} [Sun Sep 11 00:41:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:19.497762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af28925-8887-47a8-aeb5-577edb4e297c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:19.604832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af28925-8887-47a8-aeb5-577edb4e297c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:19.640144 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf94f88-52c0-4d79-86a9-7bf20c98879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:19.640753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf94f88-52c0-4d79-86a9-7bf20c98879d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:19.641031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf94f88-52c0-4d79-86a9-7bf20c98879d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:19.641298 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf94f88-52c0-4d79-86a9-7bf20c98879d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:19.653663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:19.712856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf94f88-52c0-4d79-86a9-7bf20c98879d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:19.714370 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf94f88-52c0-4d79-86a9-7bf20c98879d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:19.816480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 437/865] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:41:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:41:19.822048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520f79d-e7aa-4e3e-81ac-3d407b877806 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:19.891378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:19.930484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520f79d-e7aa-4e3e-81ac-3d407b877806 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:19.966407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d555bd9-a955-4191-9463-8beee1075626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:19.967377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d555bd9-a955-4191-9463-8beee1075626 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:19.967889 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d555bd9-a955-4191-9463-8beee1075626 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:19.968352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d555bd9-a955-4191-9463-8beee1075626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:19.978965 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d555bd9-a955-4191-9463-8beee1075626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:19.980703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d555bd9-a955-4191-9463-8beee1075626 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9d555bd9-a955-4191-9463-8beee1075626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:19.995997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:19.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:19.997825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:19.997825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:19.997825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:19.999931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 429/866] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:20.005727 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf94f88-52c0-4d79-86a9-7bf20c98879d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:20.014777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32de0a-997f-4f97-8276-412e915345d6 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:20.015324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32de0a-997f-4f97-8276-412e915345d6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:20.015912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32de0a-997f-4f97-8276-412e915345d6 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:20.017481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 430/867] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:41:20.022988 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c433e-4d0e-4484-9397-341c60d3a5a0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:20.023431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c433e-4d0e-4484-9397-341c60d3a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:20.023846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c433e-4d0e-4484-9397-341c60d3a5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:20.046651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a25c433e-4d0e-4484-9397-341c60d3a5a0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:20.047841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a25c433e-4d0e-4484-9397-341c60d3a5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:20.066438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:20.131101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 431/868] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:20.140697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf94f88-52c0-4d79-86a9-7bf20c98879d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:20.176069 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf6835-28bc-40b7-ab2f-8f61912bd88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:20.176669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf6835-28bc-40b7-ab2f-8f61912bd88e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:20.176941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf6835-28bc-40b7-ab2f-8f61912bd88e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:20.177205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf6835-28bc-40b7-ab2f-8f61912bd88e None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:20.177836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf6835-28bc-40b7-ab2f-8f61912bd88e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:20.178134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf6835-28bc-40b7-ab2f-8f61912bd88e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:20.179491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf6835-28bc-40b7-ab2f-8f61912bd88e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:20.191232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 438/869] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:20.196696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c433e-4d0e-4484-9397-341c60d3a5a0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:20.247584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:20.298928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c433e-4d0e-4484-9397-341c60d3a5a0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:20.333408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70d011-603b-45f2-9f1e-34d4ac8e4964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:20.334013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70d011-603b-45f2-9f1e-34d4ac8e4964 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:20.334329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70d011-603b-45f2-9f1e-34d4ac8e4964 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:20.334601 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70d011-603b-45f2-9f1e-34d4ac8e4964 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:20.341504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70d011-603b-45f2-9f1e-34d4ac8e4964 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:20.343006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70d011-603b-45f2-9f1e-34d4ac8e4964 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-fd70d011-603b-45f2-9f1e-34d4ac8e4964 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:20.354065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:20.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:20.356518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:20.356518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:20.356518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:20.356518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:20.356518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:20.356518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:20.356518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:20.356518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:20.356518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 432/870] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:20.361642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf6835-28bc-40b7-ab2f-8f61912bd88e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:20.447710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70d011-603b-45f2-9f1e-34d4ac8e4964 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:20.465137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:20.469209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf6835-28bc-40b7-ab2f-8f61912bd88e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:20.512585 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bd2a1-a85c-4e48-b242-967228a7ee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:20.513210 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bd2a1-a85c-4e48-b242-967228a7ee51 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:20.513591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bd2a1-a85c-4e48-b242-967228a7ee51 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:20.514154 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bd2a1-a85c-4e48-b242-967228a7ee51 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:20.515385 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bd2a1-a85c-4e48-b242-967228a7ee51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:20.515799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bd2a1-a85c-4e48-b242-967228a7ee51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:20.517593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bd2a1-a85c-4e48-b242-967228a7ee51 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:20.538011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 439/871] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:20.539384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bd2a1-a85c-4e48-b242-967228a7ee51 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:20.592192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70d011-603b-45f2-9f1e-34d4ac8e4964 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:20.602175 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:20.629482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fad412-a90f-4af3-baa0-66aadc8f872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:20.630360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fad412-a90f-4af3-baa0-66aadc8f872a None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:20.630825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fad412-a90f-4af3-baa0-66aadc8f872a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:20.631250 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fad412-a90f-4af3-baa0-66aadc8f872a None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:20.632143 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fad412-a90f-4af3-baa0-66aadc8f872a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:20.633699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fad412-a90f-4af3-baa0-66aadc8f872a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:20.658807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 433/872] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:41:20 2022] POST /identity/v3/services => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:20.688541 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bd2a1-a85c-4e48-b242-967228a7ee51 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:20.735620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331af9b6-fea6-4ae9-bc92-686f66e66d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:20.736286 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331af9b6-fea6-4ae9-bc92-686f66e66d43 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:20.736623 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331af9b6-fea6-4ae9-bc92-686f66e66d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:20.736968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331af9b6-fea6-4ae9-bc92-686f66e66d43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:20.737788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331af9b6-fea6-4ae9-bc92-686f66e66d43 None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=f2c9025c666340aaaf2a664c88650942) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:20.738150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331af9b6-fea6-4ae9-bc92-686f66e66d43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:20.739841 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331af9b6-fea6-4ae9-bc92-686f66e66d43 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:20.748275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 440/873] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:41:20 2022] GET /identity/v3/role_assignments?user.id=f2c9025c666340aaaf2a664c88650942&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:21.008655 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1262a-6d84-4fbf-b376-e8cb337dff7d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:21.009064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1262a-6d84-4fbf-b376-e8cb337dff7d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:21.009187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1262a-6d84-4fbf-b376-e8cb337dff7d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:21.011338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 434/874] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:21.017715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ded12-17d7-425c-a744-e0dc3918a73b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:21.018333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ded12-17d7-425c-a744-e0dc3918a73b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:21.018866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ded12-17d7-425c-a744-e0dc3918a73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:21.040539 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e12ded12-17d7-425c-a744-e0dc3918a73b None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:21.041726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e12ded12-17d7-425c-a744-e0dc3918a73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:21.059534 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:21.114646 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 441/875] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:21.150683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8ebaa-ed93-46e0-9cb2-7032d01fa473 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:21.151000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8ebaa-ed93-46e0-9cb2-7032d01fa473 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:21.151332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8ebaa-ed93-46e0-9cb2-7032d01fa473 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:21.152910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 435/876] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:21.158263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533969c-b47f-4637-88ad-f72320a805c2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:21.158553 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533969c-b47f-4637-88ad-f72320a805c2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:21.158843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533969c-b47f-4637-88ad-f72320a805c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:21.177580 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2533969c-b47f-4637-88ad-f72320a805c2 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:21.178756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2533969c-b47f-4637-88ad-f72320a805c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:21.252964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 442/877] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:21.394990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8ebaa-ed93-46e0-9cb2-7032d01fa473 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:21.504545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8ebaa-ed93-46e0-9cb2-7032d01fa473 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:21.531313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533969c-b47f-4637-88ad-f72320a805c2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:21.541223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ced95-0260-4b93-b05a-b30781f6f640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:21.541911 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ced95-0260-4b93-b05a-b30781f6f640 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:21.542243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ced95-0260-4b93-b05a-b30781f6f640 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:21.542512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ced95-0260-4b93-b05a-b30781f6f640 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:21.543121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ced95-0260-4b93-b05a-b30781f6f640 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:21.544525 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ced95-0260-4b93-b05a-b30781f6f640 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8b4ced95-0260-4b93-b05a-b30781f6f640 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:21.553916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:21.555053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:21.555985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 436/878] 10.222.0.33 () {56 vars in 1126 bytes} [Sun Sep 11 00:41:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:21.561917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ced95-0260-4b93-b05a-b30781f6f640 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:21.602621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:21.623064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:21.647868 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533969c-b47f-4637-88ad-f72320a805c2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:21.696584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4831848-f6dc-4c4f-9c97-7b4048cd2ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:21.697468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4831848-f6dc-4c4f-9c97-7b4048cd2ad7 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:21.698160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4831848-f6dc-4c4f-9c97-7b4048cd2ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:21.698615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4831848-f6dc-4c4f-9c97-7b4048cd2ad7 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:21.700350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4831848-f6dc-4c4f-9c97-7b4048cd2ad7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:21.701860 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4831848-f6dc-4c4f-9c97-7b4048cd2ad7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:21.702218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ced95-0260-4b93-b05a-b30781f6f640 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:21.722195 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 443/879] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:41:21 2022] POST /identity/v3/services => generated 269 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:21.757661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7795850-5489-41cf-9c93-75378adc4c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:21.758498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7795850-5489-41cf-9c93-75378adc4c88 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:21.758910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7795850-5489-41cf-9c93-75378adc4c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:21.759282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7795850-5489-41cf-9c93-75378adc4c88 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:21.760044 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7795850-5489-41cf-9c93-75378adc4c88 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:21.761012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7795850-5489-41cf-9c93-75378adc4c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:21.762586 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7795850-5489-41cf-9c93-75378adc4c88 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:21.768751 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 437/880] 10.222.0.33 () {56 vars in 1122 bytes} [Sun Sep 11 00:41:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:21.774647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4831848-f6dc-4c4f-9c97-7b4048cd2ad7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:21.888731 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4831848-f6dc-4c4f-9c97-7b4048cd2ad7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:21.924832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a271b4-e08a-4b24-ba39-a2cc6c1ef9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:21.925766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a271b4-e08a-4b24-ba39-a2cc6c1ef9da None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:21.926257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a271b4-e08a-4b24-ba39-a2cc6c1ef9da None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:21.926746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a271b4-e08a-4b24-ba39-a2cc6c1ef9da None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:21.927598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a271b4-e08a-4b24-ba39-a2cc6c1ef9da None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:21.928095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a271b4-e08a-4b24-ba39-a2cc6c1ef9da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:21.929639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a271b4-e08a-4b24-ba39-a2cc6c1ef9da None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:21.934849 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 444/881] 10.222.0.33 () {56 vars in 1122 bytes} [Sun Sep 11 00:41:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:22.984378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e96a6-70a7-47de-9d55-dbc6cf5aa766 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:22.984923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e96a6-70a7-47de-9d55-dbc6cf5aa766 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:22.984923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e96a6-70a7-47de-9d55-dbc6cf5aa766 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:22.986463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 438/882] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:22.991840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ad1bc-520e-4b15-9039-b71ffcb8d356 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:22.992233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ad1bc-520e-4b15-9039-b71ffcb8d356 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:22.992425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ad1bc-520e-4b15-9039-b71ffcb8d356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:23.001415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:23.015134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-894ad1bc-520e-4b15-9039-b71ffcb8d356 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:23.016318 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-894ad1bc-520e-4b15-9039-b71ffcb8d356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:23.048320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f78efd-047e-4464-a323-07878182bad4 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:23.048627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f78efd-047e-4464-a323-07878182bad4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:23.048855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f78efd-047e-4464-a323-07878182bad4 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:23.050457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 439/883] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:41:23.055526 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e53da7-b2e9-421c-bce0-ce7aeb43156e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:23.055847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e53da7-b2e9-421c-bce0-ce7aeb43156e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:23.056075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e53da7-b2e9-421c-bce0-ce7aeb43156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:23.075743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c6e53da7-b2e9-421c-bce0-ce7aeb43156e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:23.076876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c6e53da7-b2e9-421c-bce0-ce7aeb43156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:23.099500 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 445/884] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:23.148847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 440/885] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:23.380368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ad1bc-520e-4b15-9039-b71ffcb8d356 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:23.420225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e53da7-b2e9-421c-bce0-ce7aeb43156e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:23.447096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:23.488457 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ad1bc-520e-4b15-9039-b71ffcb8d356 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:23.527118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cc25e-7be1-4e06-8912-68bd12d6e4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:23.527775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cc25e-7be1-4e06-8912-68bd12d6e4fb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:23.528310 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cc25e-7be1-4e06-8912-68bd12d6e4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:23.528590 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cc25e-7be1-4e06-8912-68bd12d6e4fb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:23.529181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cc25e-7be1-4e06-8912-68bd12d6e4fb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:23.530542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cc25e-7be1-4e06-8912-68bd12d6e4fb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:23.532554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a24cc25e-7be1-4e06-8912-68bd12d6e4fb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:23.541995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:23.543368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:41:23.544381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:23.550808 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 446/886] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:41:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:23.552554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cc25e-7be1-4e06-8912-68bd12d6e4fb None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:23.556890 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e53da7-b2e9-421c-bce0-ce7aeb43156e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:23.602844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d97df2-a00b-4d59-b4f0-b978501b2aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:23.603542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d97df2-a00b-4d59-b4f0-b978501b2aed None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:23.603819 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d97df2-a00b-4d59-b4f0-b978501b2aed None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:23.604087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d97df2-a00b-4d59-b4f0-b978501b2aed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:23.620354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d97df2-a00b-4d59-b4f0-b978501b2aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f4d97df2-a00b-4d59-b4f0-b978501b2aed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:23.630696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:23.631790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:23.632652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:23.632652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:23.632652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:23.632652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:23.632652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:23.632652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:23.632652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:23.632652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:23.632652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:23.632652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:23.632652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:41:23.632652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:23.636921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 441/887] 10.222.0.33 () {56 vars in 1120 bytes} [Sun Sep 11 00:41:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:23.638644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d97df2-a00b-4d59-b4f0-b978501b2aed None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:23.683187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cc25e-7be1-4e06-8912-68bd12d6e4fb None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:23.725377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1ae2d-8525-4e44-b11b-e1f630aab860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:23.725989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1ae2d-8525-4e44-b11b-e1f630aab860 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:23.726320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1ae2d-8525-4e44-b11b-e1f630aab860 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:23.727327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1ae2d-8525-4e44-b11b-e1f630aab860 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:23.727327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1ae2d-8525-4e44-b11b-e1f630aab860 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:23.727578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1ae2d-8525-4e44-b11b-e1f630aab860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:23.729467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1ae2d-8525-4e44-b11b-e1f630aab860 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:23.739200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 447/888] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:41:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:23.740218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1ae2d-8525-4e44-b11b-e1f630aab860 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:23.746831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:23.770703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d97df2-a00b-4d59-b4f0-b978501b2aed None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:23.818501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd966965-8ae2-40da-8bc7-364384009cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:23.819164 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966965-8ae2-40da-8bc7-364384009cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:23.819830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966965-8ae2-40da-8bc7-364384009cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:23.820113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966965-8ae2-40da-8bc7-364384009cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:23.820777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd966965-8ae2-40da-8bc7-364384009cb3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:23.821221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd966965-8ae2-40da-8bc7-364384009cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:23.823660 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:23.823896 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd966965-8ae2-40da-8bc7-364384009cb3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:23.838826 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 442/889] 10.222.0.33 () {56 vars in 1115 bytes} [Sun Sep 11 00:41:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:23.844875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd966965-8ae2-40da-8bc7-364384009cb3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:23.879260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1ae2d-8525-4e44-b11b-e1f630aab860 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:23.919147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672666f-0a4f-4a9c-a028-c8dc7b40b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:23.919750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672666f-0a4f-4a9c-a028-c8dc7b40b89c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:23.920324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672666f-0a4f-4a9c-a028-c8dc7b40b89c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:23.920324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672666f-0a4f-4a9c-a028-c8dc7b40b89c None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:23.920964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672666f-0a4f-4a9c-a028-c8dc7b40b89c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:23.921267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672666f-0a4f-4a9c-a028-c8dc7b40b89c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:23.922626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672666f-0a4f-4a9c-a028-c8dc7b40b89c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:23.930800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 448/890] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:41:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:23.934774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672666f-0a4f-4a9c-a028-c8dc7b40b89c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:23.979684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd966965-8ae2-40da-8bc7-364384009cb3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:24.014944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add70de-48ad-4ed2-8782-422bd816d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:24.015678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add70de-48ad-4ed2-8782-422bd816d3df None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:24.016049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add70de-48ad-4ed2-8782-422bd816d3df None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:24.016391 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add70de-48ad-4ed2-8782-422bd816d3df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:24.027922 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add70de-48ad-4ed2-8782-422bd816d3df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:24.029382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add70de-48ad-4ed2-8782-422bd816d3df None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:24.032484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7add70de-48ad-4ed2-8782-422bd816d3df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:24.046769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:24.047856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:24.048796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:24.048796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:24.048796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:24.048796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 443/891] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:24.049836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5f1ed-9f69-4735-a09f-c3dd4fb7846c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:24.050185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5f1ed-9f69-4735-a09f-c3dd4fb7846c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:24.050522 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5f1ed-9f69-4735-a09f-c3dd4fb7846c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:24.052365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 444/892] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:24.054203 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5f1ed-9f69-4735-a09f-c3dd4fb7846c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:24.061620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672666f-0a4f-4a9c-a028-c8dc7b40b89c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:24.092287 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:24.102320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6b26e-dc77-4a9b-9b0a-1b2e6c195548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:24.102972 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6b26e-dc77-4a9b-9b0a-1b2e6c195548 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:24.103417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6b26e-dc77-4a9b-9b0a-1b2e6c195548 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:24.103875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6b26e-dc77-4a9b-9b0a-1b2e6c195548 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:24.105276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6b26e-dc77-4a9b-9b0a-1b2e6c195548 None admin] RBAC: Adding query filter params (interface=public, service_id=24a7b9e3971c4a8e80c454e952f96fb9, region_id=RegionOne) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:24.105821 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6b26e-dc77-4a9b-9b0a-1b2e6c195548 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:24.107562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6b26e-dc77-4a9b-9b0a-1b2e6c195548 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:24.115524 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 449/893] 10.222.0.33 () {56 vars in 1251 bytes} [Sun Sep 11 00:41:23 2022] GET /identity/v3/endpoints?service_id=24a7b9e3971c4a8e80c454e952f96fb9&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:24.116817 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b732c-c058-4faf-bfc9-5fa75e5ffbb4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:24.117101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b732c-c058-4faf-bfc9-5fa75e5ffbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:24.117374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b732c-c058-4faf-bfc9-5fa75e5ffbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:24.137150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-258b732c-c058-4faf-bfc9-5fa75e5ffbb4 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:24.140953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-258b732c-c058-4faf-bfc9-5fa75e5ffbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:24.170454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5f1ed-9f69-4735-a09f-c3dd4fb7846c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:24.207440 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b4ba0-04cb-4f8c-bef4-d2f567bc8666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:24.208042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b4ba0-04cb-4f8c-bef4-d2f567bc8666 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:24.208317 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b4ba0-04cb-4f8c-bef4-d2f567bc8666 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:24.208588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b4ba0-04cb-4f8c-bef4-d2f567bc8666 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:24.209217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b4ba0-04cb-4f8c-bef4-d2f567bc8666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:24.209516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b4ba0-04cb-4f8c-bef4-d2f567bc8666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:24.210517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 450/894] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:24.210917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b4ba0-04cb-4f8c-bef4-d2f567bc8666 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:24.211434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b732c-c058-4faf-bfc9-5fa75e5ffbb4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:24.239028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 445/895] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:24.240786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e1035-0ec5-4815-9950-f42619e1065a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:24.241162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e1035-0ec5-4815-9950-f42619e1065a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:24.241577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e1035-0ec5-4815-9950-f42619e1065a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:24.246866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 446/896] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:24.246866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e1035-0ec5-4815-9950-f42619e1065a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:24.303967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:24.315843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b732c-c058-4faf-bfc9-5fa75e5ffbb4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:24.342786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:24.353836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e1035-0ec5-4815-9950-f42619e1065a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:24.358376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b993584-f79c-4914-89dc-a0d4e502ce84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:24.359003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b993584-f79c-4914-89dc-a0d4e502ce84 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:24.359281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b993584-f79c-4914-89dc-a0d4e502ce84 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:24.359546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b993584-f79c-4914-89dc-a0d4e502ce84 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:24.360140 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b993584-f79c-4914-89dc-a0d4e502ce84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:24.361607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b993584-f79c-4914-89dc-a0d4e502ce84 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:24.367890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 451/897] 10.222.0.33 () {56 vars in 1087 bytes} [Sun Sep 11 00:41:24 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:41:24.369843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7771b-0356-473e-9e98-78bd85949f40 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:24.370335 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7771b-0356-473e-9e98-78bd85949f40 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:24.370831 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7771b-0356-473e-9e98-78bd85949f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:24.391985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0ba7771b-0356-473e-9e98-78bd85949f40 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:24.393812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0ba7771b-0356-473e-9e98-78bd85949f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:24.402524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cd1c8-8d87-40dc-b2de-99cbb81bd7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:24.403295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cd1c8-8d87-40dc-b2de-99cbb81bd7fd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:24.403668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cd1c8-8d87-40dc-b2de-99cbb81bd7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:24.403937 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cd1c8-8d87-40dc-b2de-99cbb81bd7fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:24.412509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92cd1c8-8d87-40dc-b2de-99cbb81bd7fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:24.414318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92cd1c8-8d87-40dc-b2de-99cbb81bd7fd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d92cd1c8-8d87-40dc-b2de-99cbb81bd7fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:24.432541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:24.433595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:24.434570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:24.434570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:24.434570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:24.434570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:24.434570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:24.434570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:24.434570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:24.434570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:24.434570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:41:24.434570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:24.434570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 447/898] 10.222.0.33 () {56 vars in 1117 bytes} [Sun Sep 11 00:41:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:24.444787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cd1c8-8d87-40dc-b2de-99cbb81bd7fd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:24.497090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 452/899] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:24.497964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7771b-0356-473e-9e98-78bd85949f40 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:24.571454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cd1c8-8d87-40dc-b2de-99cbb81bd7fd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:24.595138 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:24.614611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470157fd-f445-4561-9750-d32b2971845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:24.615258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470157fd-f445-4561-9750-d32b2971845f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:24.615594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470157fd-f445-4561-9750-d32b2971845f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:24.615872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470157fd-f445-4561-9750-d32b2971845f None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:24.616603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470157fd-f445-4561-9750-d32b2971845f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:24.616907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470157fd-f445-4561-9750-d32b2971845f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:24.618472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470157fd-f445-4561-9750-d32b2971845f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:24.631539 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7771b-0356-473e-9e98-78bd85949f40 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:24.637957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 448/900] 10.222.0.33 () {56 vars in 1149 bytes} [Sun Sep 11 00:41:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:24.643619 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470157fd-f445-4561-9750-d32b2971845f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:24.646871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:24.673756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cae1be-e353-4274-bd78-fee0857fe53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:24.674483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cae1be-e353-4274-bd78-fee0857fe53b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:24.674852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cae1be-e353-4274-bd78-fee0857fe53b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:24.675406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cae1be-e353-4274-bd78-fee0857fe53b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:24.676035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cae1be-e353-4274-bd78-fee0857fe53b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:24.678069 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cae1be-e353-4274-bd78-fee0857fe53b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-65cae1be-e353-4274-bd78-fee0857fe53b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:24.688526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:24.689508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:24.690391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 453/901] 10.222.0.33 () {56 vars in 1132 bytes} [Sun Sep 11 00:41:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:24.695905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cae1be-e353-4274-bd78-fee0857fe53b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:24.757096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470157fd-f445-4561-9750-d32b2971845f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:24.793626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e97d2-e878-440d-bcd4-7a29103ce959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:24.794343 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e97d2-e878-440d-bcd4-7a29103ce959 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:24.794676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e97d2-e878-440d-bcd4-7a29103ce959 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:24.794977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e97d2-e878-440d-bcd4-7a29103ce959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:24.809933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cae1be-e353-4274-bd78-fee0857fe53b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:24.837028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:24.849500 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef96af-7ded-4184-adf5-09800e6236bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:24.850102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef96af-7ded-4184-adf5-09800e6236bf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:24.850377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef96af-7ded-4184-adf5-09800e6236bf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:24.850693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef96af-7ded-4184-adf5-09800e6236bf None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:24.851336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef96af-7ded-4184-adf5-09800e6236bf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:24.851634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef96af-7ded-4184-adf5-09800e6236bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:24.853501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef96af-7ded-4184-adf5-09800e6236bf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:24.863011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 454/902] 10.222.0.33 () {56 vars in 1126 bytes} [Sun Sep 11 00:41:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:24.863011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef96af-7ded-4184-adf5-09800e6236bf None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:24.864068 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e97d2-e878-440d-bcd4-7a29103ce959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:24.865395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e97d2-e878-440d-bcd4-7a29103ce959 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:24.907853 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:24.967597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef96af-7ded-4184-adf5-09800e6236bf None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:24.974950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 449/903] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:41:24 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 00:41:24.974950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e97d2-e878-440d-bcd4-7a29103ce959 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:25.007737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da78d-eb8e-4a02-9071-78a282f10dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:25.008448 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da78d-eb8e-4a02-9071-78a282f10dd6 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:25.008758 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da78d-eb8e-4a02-9071-78a282f10dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:25.009809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da78d-eb8e-4a02-9071-78a282f10dd6 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:25.010516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da78d-eb8e-4a02-9071-78a282f10dd6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:25.012638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da78d-eb8e-4a02-9071-78a282f10dd6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:25.026159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 455/904] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:41:24 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:25.031042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da78d-eb8e-4a02-9071-78a282f10dd6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:25.073536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:25.106145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e97d2-e878-440d-bcd4-7a29103ce959 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:25.148260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:25.154545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da78d-eb8e-4a02-9071-78a282f10dd6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:25.158805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db21a52-af9b-4cb2-8657-3945e6361eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:25.159714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db21a52-af9b-4cb2-8657-3945e6361eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:25.160144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db21a52-af9b-4cb2-8657-3945e6361eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:25.160552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db21a52-af9b-4cb2-8657-3945e6361eb9 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:25.161345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db21a52-af9b-4cb2-8657-3945e6361eb9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:25.161799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db21a52-af9b-4cb2-8657-3945e6361eb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:25.163393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db21a52-af9b-4cb2-8657-3945e6361eb9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:25.175938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 450/905] 10.222.0.33 () {56 vars in 1126 bytes} [Sun Sep 11 00:41:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:25.177193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db21a52-af9b-4cb2-8657-3945e6361eb9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:25.202676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d43a80-dcda-4cb5-8f29-71bfe574540d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:25.203393 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d43a80-dcda-4cb5-8f29-71bfe574540d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:25.203715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d43a80-dcda-4cb5-8f29-71bfe574540d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:25.203937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d43a80-dcda-4cb5-8f29-71bfe574540d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:25.220121 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d43a80-dcda-4cb5-8f29-71bfe574540d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:25.222172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d43a80-dcda-4cb5-8f29-71bfe574540d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a8d43a80-dcda-4cb5-8f29-71bfe574540d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:25.239778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:25.240757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:25.241642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:25.241642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:25.241642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:25.241642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 456/906] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:25.247366 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d43a80-dcda-4cb5-8f29-71bfe574540d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:25.302689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db21a52-af9b-4cb2-8657-3945e6361eb9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:25.348855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4057087-29f1-44fb-9e6e-06b8ce8e264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:25.349590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4057087-29f1-44fb-9e6e-06b8ce8e264c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:25.350061 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4057087-29f1-44fb-9e6e-06b8ce8e264c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:25.350506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4057087-29f1-44fb-9e6e-06b8ce8e264c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:25.351339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4057087-29f1-44fb-9e6e-06b8ce8e264c None admin] RBAC: Adding query filter params (interface=public, service_id=ad46712de5c044709e4352c794ed4eff, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:25.351957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4057087-29f1-44fb-9e6e-06b8ce8e264c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:25.354364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4057087-29f1-44fb-9e6e-06b8ce8e264c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:25.364664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 451/907] 10.222.0.33 () {56 vars in 1251 bytes} [Sun Sep 11 00:41:25 2022] GET /identity/v3/endpoints?service_id=ad46712de5c044709e4352c794ed4eff&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:25.372095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4057087-29f1-44fb-9e6e-06b8ce8e264c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:25.374716 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d43a80-dcda-4cb5-8f29-71bfe574540d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:25.376305 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:25.415967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473acd4-e8b9-4502-8042-3eeedfe31eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:25.416599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473acd4-e8b9-4502-8042-3eeedfe31eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:25.416882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473acd4-e8b9-4502-8042-3eeedfe31eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:25.417156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473acd4-e8b9-4502-8042-3eeedfe31eb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:25.417853 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473acd4-e8b9-4502-8042-3eeedfe31eb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:25.418159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473acd4-e8b9-4502-8042-3eeedfe31eb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:25.419553 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473acd4-e8b9-4502-8042-3eeedfe31eb0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:25.449643 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 457/908] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:25.451358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473acd4-e8b9-4502-8042-3eeedfe31eb0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:25.464614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:25.499174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4057087-29f1-44fb-9e6e-06b8ce8e264c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:25.534711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57498132-e27a-4013-9480-f674316fe321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:25.535305 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57498132-e27a-4013-9480-f674316fe321 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:25.535585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57498132-e27a-4013-9480-f674316fe321 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:25.535856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57498132-e27a-4013-9480-f674316fe321 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:25.536458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57498132-e27a-4013-9480-f674316fe321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:25.537820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57498132-e27a-4013-9480-f674316fe321 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:25.545092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 452/909] 10.222.0.33 () {56 vars in 1087 bytes} [Sun Sep 11 00:41:25 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:41:25.574873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473acd4-e8b9-4502-8042-3eeedfe31eb0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:25.614966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323a948-a0ad-47c7-9157-66085d7da1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:25.615853 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323a948-a0ad-47c7-9157-66085d7da1ca None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:25.616272 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323a948-a0ad-47c7-9157-66085d7da1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:25.616680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323a948-a0ad-47c7-9157-66085d7da1ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:25.624997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323a948-a0ad-47c7-9157-66085d7da1ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:25.626709 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323a948-a0ad-47c7-9157-66085d7da1ca None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-9323a948-a0ad-47c7-9157-66085d7da1ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:25.640151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:25.641396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:25.642512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:25.642512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:25.642512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:25.642512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:25.642512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:25.642512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:25.642512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:25.642512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:25.644727 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 458/910] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:25.651167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57498132-e27a-4013-9480-f674316fe321 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:25.726318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:25.766986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57498132-e27a-4013-9480-f674316fe321 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:25.806005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cb59d-9e02-4897-a070-74c657b92729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:25.806672 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cb59d-9e02-4897-a070-74c657b92729 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:25.806979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cb59d-9e02-4897-a070-74c657b92729 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:25.807249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cb59d-9e02-4897-a070-74c657b92729 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:25.807934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cb59d-9e02-4897-a070-74c657b92729 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:25.808235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cb59d-9e02-4897-a070-74c657b92729 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:25.809661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cb59d-9e02-4897-a070-74c657b92729 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:25.822846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 453/911] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:25.829004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323a948-a0ad-47c7-9157-66085d7da1ca None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:25.901167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:25.934564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323a948-a0ad-47c7-9157-66085d7da1ca None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:25.970199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b4234-e9b6-429d-96c1-2ce5cd038d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:25.971078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b4234-e9b6-429d-96c1-2ce5cd038d73 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:25.971530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b4234-e9b6-429d-96c1-2ce5cd038d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:25.971958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b4234-e9b6-429d-96c1-2ce5cd038d73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:25.972846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b4234-e9b6-429d-96c1-2ce5cd038d73 None admin] RBAC: Adding query filter params (role.id=9f2d3d0a9ad045e7a84121e39319f1fc, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=f2c9025c666340aaaf2a664c88650942) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:25.973302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b4234-e9b6-429d-96c1-2ce5cd038d73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:25.974904 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b4234-e9b6-429d-96c1-2ce5cd038d73 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:25.983809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 459/912] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:41:25 2022] GET /identity/v3/role_assignments?user.id=f2c9025c666340aaaf2a664c88650942&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=9f2d3d0a9ad045e7a84121e39319f1fc => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:26.624905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dadb1-df6e-46a9-a83a-ecdd757403c8 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:26.625420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dadb1-df6e-46a9-a83a-ecdd757403c8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:26.625420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dadb1-df6e-46a9-a83a-ecdd757403c8 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:26.627064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 454/913] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:26.632451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e742f-8e52-4a9a-bb6c-78ab2ac1eb5e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:26.632851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e742f-8e52-4a9a-bb6c-78ab2ac1eb5e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:26.633041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e742f-8e52-4a9a-bb6c-78ab2ac1eb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:26.651540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-754e742f-8e52-4a9a-bb6c-78ab2ac1eb5e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:26.652721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-754e742f-8e52-4a9a-bb6c-78ab2ac1eb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:26.725926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 460/914] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:26.995822 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dadb1-df6e-46a9-a83a-ecdd757403c8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:27.100510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dadb1-df6e-46a9-a83a-ecdd757403c8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:27.131085 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:27.140366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05f692-23f5-4a1e-a4af-a495d1a3b984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:27.141440 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05f692-23f5-4a1e-a4af-a495d1a3b984 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:27.141711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05f692-23f5-4a1e-a4af-a495d1a3b984 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:27.141976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05f692-23f5-4a1e-a4af-a495d1a3b984 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:27.142555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05f692-23f5-4a1e-a4af-a495d1a3b984 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:27.143949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05f692-23f5-4a1e-a4af-a495d1a3b984 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3b05f692-23f5-4a1e-a4af-a495d1a3b984 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:27.153509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:27.154478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:27.155337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 455/915] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:41:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:27.160596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e742f-8e52-4a9a-bb6c-78ab2ac1eb5e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:27.223556 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:27.264305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e742f-8e52-4a9a-bb6c-78ab2ac1eb5e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:27.300357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fa2b7-ba8d-494d-8989-e7ce72d8c2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:27.300969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fa2b7-ba8d-494d-8989-e7ce72d8c2be None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:27.301293 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fa2b7-ba8d-494d-8989-e7ce72d8c2be None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:27.301569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fa2b7-ba8d-494d-8989-e7ce72d8c2be None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:27.302199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fa2b7-ba8d-494d-8989-e7ce72d8c2be None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:27.302504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fa2b7-ba8d-494d-8989-e7ce72d8c2be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:27.303914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fa2b7-ba8d-494d-8989-e7ce72d8c2be None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:27.314619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 461/916] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:41:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:27.316105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05f692-23f5-4a1e-a4af-a495d1a3b984 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:27.423316 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05f692-23f5-4a1e-a4af-a495d1a3b984 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:27.444043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b416a5b-8938-47f1-988f-2687308e7106 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:27.444326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b416a5b-8938-47f1-988f-2687308e7106 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:27.444595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b416a5b-8938-47f1-988f-2687308e7106 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:27.446215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 462/917] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:27.452076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d726a31-35ca-4ae2-8f49-a6d9ebba1430 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:27.452469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d726a31-35ca-4ae2-8f49-a6d9ebba1430 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:27.452844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d726a31-35ca-4ae2-8f49-a6d9ebba1430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:27.459980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e079e-cdb5-4038-b257-80f13f12a37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:27.462173 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e079e-cdb5-4038-b257-80f13f12a37d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:27.462619 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e079e-cdb5-4038-b257-80f13f12a37d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:27.463058 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e079e-cdb5-4038-b257-80f13f12a37d None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:27.463821 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e079e-cdb5-4038-b257-80f13f12a37d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:27.464271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e079e-cdb5-4038-b257-80f13f12a37d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:27.465766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e079e-cdb5-4038-b257-80f13f12a37d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:27.471750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 456/918] 10.222.0.33 () {56 vars in 1114 bytes} [Sun Sep 11 00:41:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:27.475856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4d726a31-35ca-4ae2-8f49-a6d9ebba1430 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:27.477938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e079e-cdb5-4038-b257-80f13f12a37d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:27.478429 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4d726a31-35ca-4ae2-8f49-a6d9ebba1430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:27.543093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:27.556122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 463/919] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:27.595956 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e079e-cdb5-4038-b257-80f13f12a37d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:27.630718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87667009-ffa3-49f2-9166-25c8c8e34343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:27.632079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87667009-ffa3-49f2-9166-25c8c8e34343 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:27.632547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87667009-ffa3-49f2-9166-25c8c8e34343 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:27.633152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87667009-ffa3-49f2-9166-25c8c8e34343 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:27.633998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87667009-ffa3-49f2-9166-25c8c8e34343 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:27.635589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87667009-ffa3-49f2-9166-25c8c8e34343 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:27.657926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 457/920] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:41:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:41:27.856301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d726a31-35ca-4ae2-8f49-a6d9ebba1430 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:27.860990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1aec10-7ec3-4542-9c38-9eee30425abd None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:27.861285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1aec10-7ec3-4542-9c38-9eee30425abd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:27.861560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1aec10-7ec3-4542-9c38-9eee30425abd None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:27.862945 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 458/921] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:27.868173 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e6aa-c7fc-4cd5-8bd3-11ecccb10cc7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:27.868705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e6aa-c7fc-4cd5-8bd3-11ecccb10cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:27.869192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e6aa-c7fc-4cd5-8bd3-11ecccb10cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:27.888449 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a6e0e6aa-c7fc-4cd5-8bd3-11ecccb10cc7 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:27.889652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a6e0e6aa-c7fc-4cd5-8bd3-11ecccb10cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:27.928708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:27.973203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d726a31-35ca-4ae2-8f49-a6d9ebba1430 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:27.979361 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 459/922] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:28.010390 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e0e6c-69ea-42ca-8245-dd5f82378fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:28.011063 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e0e6c-69ea-42ca-8245-dd5f82378fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:28.011341 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e0e6c-69ea-42ca-8245-dd5f82378fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:28.011608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e0e6c-69ea-42ca-8245-dd5f82378fb3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:28.012186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e0e6c-69ea-42ca-8245-dd5f82378fb3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:28.013706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e0e6c-69ea-42ca-8245-dd5f82378fb3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-7f5e0e6c-69ea-42ca-8245-dd5f82378fb3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:28.022765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:28.024367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:28.025233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 464/923] 10.222.0.33 () {56 vars in 1126 bytes} [Sun Sep 11 00:41:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:28.030886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0e6aa-c7fc-4cd5-8bd3-11ecccb10cc7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:28.068642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:28.143907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0e6aa-c7fc-4cd5-8bd3-11ecccb10cc7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:28.180455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082ed89-a1ad-466c-8ae6-f5bc84cd74d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:28.181062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082ed89-a1ad-466c-8ae6-f5bc84cd74d4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:28.181336 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082ed89-a1ad-466c-8ae6-f5bc84cd74d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:28.181602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082ed89-a1ad-466c-8ae6-f5bc84cd74d4 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:28.182219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082ed89-a1ad-466c-8ae6-f5bc84cd74d4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:28.182513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082ed89-a1ad-466c-8ae6-f5bc84cd74d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:28.183906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082ed89-a1ad-466c-8ae6-f5bc84cd74d4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:28.188982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 460/924] 10.222.0.33 () {56 vars in 1122 bytes} [Sun Sep 11 00:41:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:28.194285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e0e6c-69ea-42ca-8245-dd5f82378fb3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:28.201404 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050cc0e-9469-46b4-9e16-fbef7537e20c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:28.201694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050cc0e-9469-46b4-9e16-fbef7537e20c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:28.201969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050cc0e-9469-46b4-9e16-fbef7537e20c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:28.203594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 461/925] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:41:28.208572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85ffd3-5791-448a-8745-e1a72c9387b6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:28.208855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85ffd3-5791-448a-8745-e1a72c9387b6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:28.209130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85ffd3-5791-448a-8745-e1a72c9387b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:28.228334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ab85ffd3-5791-448a-8745-e1a72c9387b6 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:28.229525 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ab85ffd3-5791-448a-8745-e1a72c9387b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:28.301654 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 462/926] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:28.303398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e0e6c-69ea-42ca-8245-dd5f82378fb3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:28.303612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85ffd3-5791-448a-8745-e1a72c9387b6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:28.326916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:28.340076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed685d04-bb69-497e-b97b-46030e58b8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:28.340668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:28.340778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed685d04-bb69-497e-b97b-46030e58b8bf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:28.341134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed685d04-bb69-497e-b97b-46030e58b8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:28.341465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed685d04-bb69-497e-b97b-46030e58b8bf None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:28.342157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed685d04-bb69-497e-b97b-46030e58b8bf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:28.342690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed685d04-bb69-497e-b97b-46030e58b8bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:28.344603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed685d04-bb69-497e-b97b-46030e58b8bf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:28.350022 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 465/927] 10.222.0.33 () {56 vars in 1122 bytes} [Sun Sep 11 00:41:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:28.356897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed685d04-bb69-497e-b97b-46030e58b8bf None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:28.422419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85ffd3-5791-448a-8745-e1a72c9387b6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:28.459470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed685d04-bb69-497e-b97b-46030e58b8bf None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:28.463718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2825a5-f6fa-4a5f-9b65-29bcc0e24944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:28.464536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2825a5-f6fa-4a5f-9b65-29bcc0e24944 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:28.464975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2825a5-f6fa-4a5f-9b65-29bcc0e24944 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:28.465390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2825a5-f6fa-4a5f-9b65-29bcc0e24944 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:28.466114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2825a5-f6fa-4a5f-9b65-29bcc0e24944 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:28.467864 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2825a5-f6fa-4a5f-9b65-29bcc0e24944 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0d2825a5-f6fa-4a5f-9b65-29bcc0e24944 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:28.479063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:28.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:41:28.481268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:28.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 463/928] 10.222.0.33 () {56 vars in 1132 bytes} [Sun Sep 11 00:41:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:28.489996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2825a5-f6fa-4a5f-9b65-29bcc0e24944 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:28.495376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd538ccd-10e9-4e93-af3b-18b42633a966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:28.495533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd538ccd-10e9-4e93-af3b-18b42633a966 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:28.495752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd538ccd-10e9-4e93-af3b-18b42633a966 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:28.496013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd538ccd-10e9-4e93-af3b-18b42633a966 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:28.496815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd538ccd-10e9-4e93-af3b-18b42633a966 None admin] RBAC: Adding query filter params (interface=public, service_id=e36781d717e14042a0659a31aa4f9272, region_id=RegionOne) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:28.497013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd538ccd-10e9-4e93-af3b-18b42633a966 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:28.498426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd538ccd-10e9-4e93-af3b-18b42633a966 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:28.508520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 466/929] 10.222.0.33 () {56 vars in 1251 bytes} [Sun Sep 11 00:41:28 2022] GET /identity/v3/endpoints?service_id=e36781d717e14042a0659a31aa4f9272&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:28.510203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd538ccd-10e9-4e93-af3b-18b42633a966 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:28.560414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:28.597621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:28.607845 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2825a5-f6fa-4a5f-9b65-29bcc0e24944 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:28.614855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd538ccd-10e9-4e93-af3b-18b42633a966 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:28.642396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c579a-8fc1-4339-89fa-e7f0c816b89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:28.643264 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c579a-8fc1-4339-89fa-e7f0c816b89f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:28.643374 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c579a-8fc1-4339-89fa-e7f0c816b89f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:28.643569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c579a-8fc1-4339-89fa-e7f0c816b89f None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:28.644185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c579a-8fc1-4339-89fa-e7f0c816b89f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:28.644486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c579a-8fc1-4339-89fa-e7f0c816b89f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:28.645846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c579a-8fc1-4339-89fa-e7f0c816b89f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:28.650828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 464/930] 10.222.0.33 () {56 vars in 1126 bytes} [Sun Sep 11 00:41:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:28.651465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c579a-8fc1-4339-89fa-e7f0c816b89f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:28.654873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e3ecc-0808-4730-8cfd-56a30c71c5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:28.655825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e3ecc-0808-4730-8cfd-56a30c71c5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:28.656164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e3ecc-0808-4730-8cfd-56a30c71c5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:28.656500 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e3ecc-0808-4730-8cfd-56a30c71c5c1 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:28.657450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e3ecc-0808-4730-8cfd-56a30c71c5c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:28.659859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e3ecc-0808-4730-8cfd-56a30c71c5c1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:28.678949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 467/931] 10.222.0.33 () {56 vars in 1087 bytes} [Sun Sep 11 00:41:28 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:41:28.678949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e3ecc-0808-4730-8cfd-56a30c71c5c1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:28.781010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c579a-8fc1-4339-89fa-e7f0c816b89f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:28.819781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e3ecc-0808-4730-8cfd-56a30c71c5c1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:28.827948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1d629-461c-4ea4-bc2a-34b8e1d3bfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:28.828732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1d629-461c-4ea4-bc2a-34b8e1d3bfc3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:28.829100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1d629-461c-4ea4-bc2a-34b8e1d3bfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:28.829460 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1d629-461c-4ea4-bc2a-34b8e1d3bfc3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:28.838758 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:28.843625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1d629-461c-4ea4-bc2a-34b8e1d3bfc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-17d1d629-461c-4ea4-bc2a-34b8e1d3bfc3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:28.850512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:28.851609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:28.852448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:28.852448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:28.852448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:28.852448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:28.852448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:28.852448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:28.852448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:28.852448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:28.852448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:28.852448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:28.852448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:41:28.852448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:28.852448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 465/932] 10.222.0.33 () {56 vars in 1120 bytes} [Sun Sep 11 00:41:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:28.859681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1d629-461c-4ea4-bc2a-34b8e1d3bfc3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:28.866752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d484-427b-40b9-93ce-e61ab579c26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:28.866752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d484-427b-40b9-93ce-e61ab579c26b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:28.866752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d484-427b-40b9-93ce-e61ab579c26b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:28.866752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d484-427b-40b9-93ce-e61ab579c26b None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:28.867995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516d484-427b-40b9-93ce-e61ab579c26b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:28.867995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516d484-427b-40b9-93ce-e61ab579c26b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:28.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516d484-427b-40b9-93ce-e61ab579c26b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:28.874883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 468/933] 10.222.0.33 () {56 vars in 1126 bytes} [Sun Sep 11 00:41:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:28.880526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d484-427b-40b9-93ce-e61ab579c26b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:28.884499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:28.994328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1d629-461c-4ea4-bc2a-34b8e1d3bfc3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:29.011393 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d484-427b-40b9-93ce-e61ab579c26b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:29.036754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45603b-dbec-44ca-8fcf-7f88b62b1afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:29.037691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45603b-dbec-44ca-8fcf-7f88b62b1afc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:29.038232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45603b-dbec-44ca-8fcf-7f88b62b1afc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:29.038506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45603b-dbec-44ca-8fcf-7f88b62b1afc None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:29.039434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45603b-dbec-44ca-8fcf-7f88b62b1afc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:29.039740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45603b-dbec-44ca-8fcf-7f88b62b1afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:29.041655 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45603b-dbec-44ca-8fcf-7f88b62b1afc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:29.048545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785316c-7e00-4a12-9d90-13bd1eb52cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:29.049430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785316c-7e00-4a12-9d90-13bd1eb52cdf None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:29.049710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785316c-7e00-4a12-9d90-13bd1eb52cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:29.049980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785316c-7e00-4a12-9d90-13bd1eb52cdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:29.050649 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785316c-7e00-4a12-9d90-13bd1eb52cdf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:29.051281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 466/934] 10.222.0.33 () {56 vars in 1115 bytes} [Sun Sep 11 00:41:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:29.052061 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785316c-7e00-4a12-9d90-13bd1eb52cdf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:29.063556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45603b-dbec-44ca-8fcf-7f88b62b1afc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:29.086704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 469/935] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:41:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:29.167606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:29.190648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45603b-dbec-44ca-8fcf-7f88b62b1afc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:29.236608 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cff64d-51d0-4376-9ac2-e72d5f2acf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:29.237274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff64d-51d0-4376-9ac2-e72d5f2acf39 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:29.237541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff64d-51d0-4376-9ac2-e72d5f2acf39 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:29.237820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff64d-51d0-4376-9ac2-e72d5f2acf39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:29.251376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cff64d-51d0-4376-9ac2-e72d5f2acf39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:29.253152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cff64d-51d0-4376-9ac2-e72d5f2acf39 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-96cff64d-51d0-4376-9ac2-e72d5f2acf39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:29.269208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:29.270184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:29.271129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:29.271129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:29.271129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:29.272172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 467/936] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:29.277780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785316c-7e00-4a12-9d90-13bd1eb52cdf None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:29.316194 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:29.393195 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785316c-7e00-4a12-9d90-13bd1eb52cdf None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:29.441043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c12be4-b19d-4130-a91f-1eb748a3d6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:29.441665 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c12be4-b19d-4130-a91f-1eb748a3d6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:29.441944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c12be4-b19d-4130-a91f-1eb748a3d6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:29.442217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c12be4-b19d-4130-a91f-1eb748a3d6f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:29.442900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c12be4-b19d-4130-a91f-1eb748a3d6f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:29.443204 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c12be4-b19d-4130-a91f-1eb748a3d6f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:29.444636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c12be4-b19d-4130-a91f-1eb748a3d6f8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:29.458283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 470/937] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:29.464630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cff64d-51d0-4376-9ac2-e72d5f2acf39 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:29.570607 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cff64d-51d0-4376-9ac2-e72d5f2acf39 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:29.598970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:29.608840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370cdd5-5cdc-49e7-b14b-ff53c4f31136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:29.609476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370cdd5-5cdc-49e7-b14b-ff53c4f31136 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:29.609754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370cdd5-5cdc-49e7-b14b-ff53c4f31136 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:29.610028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370cdd5-5cdc-49e7-b14b-ff53c4f31136 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:29.622643 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370cdd5-5cdc-49e7-b14b-ff53c4f31136 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:29.624396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370cdd5-5cdc-49e7-b14b-ff53c4f31136 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8370cdd5-5cdc-49e7-b14b-ff53c4f31136 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:29.640256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:29.641225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:29.642153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:29.642153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:29.642153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:29.642153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:29.642153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:29.642153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:29.642153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:29.642153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:29.642153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:41:29.642153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:29.642153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 468/938] 10.222.0.33 () {56 vars in 1117 bytes} [Sun Sep 11 00:41:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:29.647143 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c12be4-b19d-4130-a91f-1eb748a3d6f8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:29.749946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:29.756696 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c12be4-b19d-4130-a91f-1eb748a3d6f8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:29.792443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc68da-21a5-49ca-8d63-14c0e5d1a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:29.793049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc68da-21a5-49ca-8d63-14c0e5d1a2fb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:29.793326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc68da-21a5-49ca-8d63-14c0e5d1a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:29.793591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc68da-21a5-49ca-8d63-14c0e5d1a2fb None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:29.794316 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc68da-21a5-49ca-8d63-14c0e5d1a2fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:29.794616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc68da-21a5-49ca-8d63-14c0e5d1a2fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:29.796066 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc68da-21a5-49ca-8d63-14c0e5d1a2fb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:29.814367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 471/939] 10.222.0.33 () {56 vars in 1149 bytes} [Sun Sep 11 00:41:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:29.823855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370cdd5-5cdc-49e7-b14b-ff53c4f31136 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:29.933604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370cdd5-5cdc-49e7-b14b-ff53c4f31136 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:29.966713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5ab84-5df1-436e-94bc-01f39f93d990 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:29.967254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5ab84-5df1-436e-94bc-01f39f93d990 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:29.967254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5ab84-5df1-436e-94bc-01f39f93d990 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:29.968756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 472/940] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:29.972537 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a48a57-ee4c-46d2-971e-a1173405cd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:29.974244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3243fe7-f8f7-4997-9215-ec1abd185b34 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:29.974523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3243fe7-f8f7-4997-9215-ec1abd185b34 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:29.974825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3243fe7-f8f7-4997-9215-ec1abd185b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:29.975249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a48a57-ee4c-46d2-971e-a1173405cd24 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:29.975726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a48a57-ee4c-46d2-971e-a1173405cd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:29.976735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a48a57-ee4c-46d2-971e-a1173405cd24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:29.988183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a48a57-ee4c-46d2-971e-a1173405cd24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:29.989923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a48a57-ee4c-46d2-971e-a1173405cd24 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:29.995064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d3243fe7-f8f7-4997-9215-ec1abd185b34 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:29.996253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d3243fe7-f8f7-4997-9215-ec1abd185b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-58a48a57-ee4c-46d2-971e-a1173405cd24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:30.005946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:30.006912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:30.007909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:30.007909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:30.007909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:30.010030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 469/941] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:30.016079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a48a57-ee4c-46d2-971e-a1173405cd24 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:30.062062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:30.084902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 473/942] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:30.132874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a48a57-ee4c-46d2-971e-a1173405cd24 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:30.172710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affab47-6ffb-40b9-b1e9-bcdd8a874610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:30.173555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affab47-6ffb-40b9-b1e9-bcdd8a874610 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:30.174060 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affab47-6ffb-40b9-b1e9-bcdd8a874610 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:30.174486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affab47-6ffb-40b9-b1e9-bcdd8a874610 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:30.175313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affab47-6ffb-40b9-b1e9-bcdd8a874610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:30.175779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affab47-6ffb-40b9-b1e9-bcdd8a874610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:30.177291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affab47-6ffb-40b9-b1e9-bcdd8a874610 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:30.190680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 470/943] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:30.196637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3243fe7-f8f7-4997-9215-ec1abd185b34 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:30.279700 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:30.298945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3243fe7-f8f7-4997-9215-ec1abd185b34 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:30.334100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4858971-5498-40d8-b42d-c26348aa946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:30.334737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4858971-5498-40d8-b42d-c26348aa946e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:30.335078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4858971-5498-40d8-b42d-c26348aa946e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:30.335838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4858971-5498-40d8-b42d-c26348aa946e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:30.342660 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4858971-5498-40d8-b42d-c26348aa946e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:30.344108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4858971-5498-40d8-b42d-c26348aa946e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:30.354029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affab47-6ffb-40b9-b1e9-bcdd8a874610 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b4858971-5498-40d8-b42d-c26348aa946e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:30.355626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:30.356533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:30.357459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:30.357459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:30.357459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:30.357459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:30.357459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:30.357459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:30.357459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:30.357459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:30.357459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 474/944] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:30.364301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4858971-5498-40d8-b42d-c26348aa946e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:30.483661 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4858971-5498-40d8-b42d-c26348aa946e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:30.491757 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:30.495444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affab47-6ffb-40b9-b1e9-bcdd8a874610 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:30.528308 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75991d4d-74c4-4a7e-ba81-097bf63b81e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:30.529878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75991d4d-74c4-4a7e-ba81-097bf63b81e8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:30.530650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75991d4d-74c4-4a7e-ba81-097bf63b81e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:30.531160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75991d4d-74c4-4a7e-ba81-097bf63b81e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:30.532193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75991d4d-74c4-4a7e-ba81-097bf63b81e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:30.532749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75991d4d-74c4-4a7e-ba81-097bf63b81e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:30.534367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75991d4d-74c4-4a7e-ba81-097bf63b81e8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:30.541197 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5ab22-0716-47e9-aef5-cb06c82c267a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:30.541799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5ab22-0716-47e9-aef5-cb06c82c267a None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:30.542075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5ab22-0716-47e9-aef5-cb06c82c267a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:30.542343 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5ab22-0716-47e9-aef5-cb06c82c267a None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:30.543019 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5ab22-0716-47e9-aef5-cb06c82c267a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:30.544463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5ab22-0716-47e9-aef5-cb06c82c267a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:30.548540 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: WARNING keystone.server.flask.common [None req-77b5ab22-0716-47e9-aef5-cb06c82c267a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 11 00:41:30.550528 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 475/945] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:30.557523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75991d4d-74c4-4a7e-ba81-097bf63b81e8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:30.560787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:30.572064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.sql.core [None req-77b5ab22-0716-47e9-aef5-cb06c82c267a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 00:41:30.572064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 00:41:30.572064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [parameters: {'id': '5e15d60839b247bd9bd92ab1e191b75f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 00:41:30.572064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 00:41:30.582432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-77b5ab22-0716-47e9-aef5-cb06c82c267a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5e15d60839b247bd9bd92ab1e191b75f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5e15d60839b247bd9bd92ab1e191b75f. Sep 11 00:41:30.582432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:30.582432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:41:30.582432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:41:30.582432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:41:30.582432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:41:30.582432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:41:30.582432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:41:30.582432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:41:30.582432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:41:30.582432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:41:30.582432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:41:30.582432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 11 00:41:30.583342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application yield resource Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise self.value Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application session.commit() Sep 11 00:41:30.584299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.flush() Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application compat.raise_( Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 00:41:30.585833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 00:41:30.587661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:41:30.589958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [parameters: {'id': '5e15d60839b247bd9bd92ab1e191b75f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:30.592332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:30.594260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:30.596729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:30.596729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 11 00:41:30.596729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 11 00:41:30.596729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:30.596729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:30.596729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 11 00:41:30.596729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 11 00:41:30.596729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5e15d60839b247bd9bd92ab1e191b75f. Sep 11 00:41:30.596729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:30.596729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 471/946] 10.222.0.33 () {60 vars in 1140 bytes} [Sun Sep 11 00:41:30 2022] POST /identity/v3/projects => generated 262 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:30.596729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5ab22-0716-47e9-aef5-cb06c82c267a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:30.693963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75991d4d-74c4-4a7e-ba81-097bf63b81e8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:30.728088 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5ab22-0716-47e9-aef5-cb06c82c267a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:30.737582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e0edc-b03e-41fe-b9db-daf31e2335ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:30.738546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e0edc-b03e-41fe-b9db-daf31e2335ce None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:30.739440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e0edc-b03e-41fe-b9db-daf31e2335ce None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:30.739946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e0edc-b03e-41fe-b9db-daf31e2335ce None admin] PATH_INFO: `/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/f2c9025c666340aaaf2a664c88650942/roles/9f2d3d0a9ad045e7a84121e39319f1fc` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:30.743034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e0edc-b03e-41fe-b9db-daf31e2335ce None admin] RBAC: Authorizing `identity:create_grant(project_id=ce5275375bc1421cb3fe6e27d5f685fe, user_id=f2c9025c666340aaaf2a664c88650942, role_id=9f2d3d0a9ad045e7a84121e39319f1fc)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:30.744671 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e0edc-b03e-41fe-b9db-daf31e2335ce None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:30.768758 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 476/947] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:41:30 2022] PUT /identity/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/f2c9025c666340aaaf2a664c88650942/roles/9f2d3d0a9ad045e7a84121e39319f1fc => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:41:30.771525 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dac779-dec7-43e1-b6ef-f8472290d397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:30.772183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dac779-dec7-43e1-b6ef-f8472290d397 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:30.772461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dac779-dec7-43e1-b6ef-f8472290d397 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:30.772850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dac779-dec7-43e1-b6ef-f8472290d397 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:30.780615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dac779-dec7-43e1-b6ef-f8472290d397 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:30.782348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dac779-dec7-43e1-b6ef-f8472290d397 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-93dac779-dec7-43e1-b6ef-f8472290d397 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:30.795518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:30.796465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:30.797383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:30.797383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:30.797383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:30.797383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:30.797383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:30.797383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:30.797383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:30.797383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:30.797383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 472/948] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:30.803960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e0edc-b03e-41fe-b9db-daf31e2335ce None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:30.874194 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:30.918328 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e0edc-b03e-41fe-b9db-daf31e2335ce None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:30.959670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a246398-4907-4ae4-ae22-54fe845b7366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:30.960442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a246398-4907-4ae4-ae22-54fe845b7366 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:30.960776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a246398-4907-4ae4-ae22-54fe845b7366 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:30.961160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a246398-4907-4ae4-ae22-54fe845b7366 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:30.961906 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a246398-4907-4ae4-ae22-54fe845b7366 None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:30.962268 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a246398-4907-4ae4-ae22-54fe845b7366 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:30.963860 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a246398-4907-4ae4-ae22-54fe845b7366 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:30.987866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 477/949] 10.222.0.33 () {56 vars in 1112 bytes} [Sun Sep 11 00:41:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:31.051796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cb103-51d4-4ee1-bf09-dc8dfca7dffb None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:31.052116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cb103-51d4-4ee1-bf09-dc8dfca7dffb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:31.052337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cb103-51d4-4ee1-bf09-dc8dfca7dffb None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:31.058319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 473/950] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:31.064794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351a75e-c8e4-4259-b7b0-135879f67954 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:31.065077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351a75e-c8e4-4259-b7b0-135879f67954 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:31.065347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351a75e-c8e4-4259-b7b0-135879f67954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:31.087390 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7351a75e-c8e4-4259-b7b0-135879f67954 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:31.088603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7351a75e-c8e4-4259-b7b0-135879f67954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:31.162936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 478/951] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:31.434223 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c954b-8f8a-4ca7-8177-979d6fa26ab5 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:31.434517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c954b-8f8a-4ca7-8177-979d6fa26ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:31.434801 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c954b-8f8a-4ca7-8177-979d6fa26ab5 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:31.435560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cb103-51d4-4ee1-bf09-dc8dfca7dffb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:31.436432 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 479/952] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:31.441516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec098-f358-4644-bd6e-4c9eeddf56aa None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:31.441794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec098-f358-4644-bd6e-4c9eeddf56aa None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:31.442118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec098-f358-4644-bd6e-4c9eeddf56aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:31.456717 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:31.460945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2caec098-f358-4644-bd6e-4c9eeddf56aa None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:31.463615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2caec098-f358-4644-bd6e-4c9eeddf56aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:31.524019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:31.554763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 480/953] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:31.563062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cb103-51d4-4ee1-bf09-dc8dfca7dffb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:31.603893 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720efa4-1cb0-4207-b0f7-2a921f5e34be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:31.604531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720efa4-1cb0-4207-b0f7-2a921f5e34be None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:31.604815 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720efa4-1cb0-4207-b0f7-2a921f5e34be None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:31.605087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720efa4-1cb0-4207-b0f7-2a921f5e34be None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:31.605665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720efa4-1cb0-4207-b0f7-2a921f5e34be None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:31.607055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720efa4-1cb0-4207-b0f7-2a921f5e34be None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a720efa4-1cb0-4207-b0f7-2a921f5e34be None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:31.616681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:31.618908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:31.620302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 474/954] 10.222.0.33 () {56 vars in 1126 bytes} [Sun Sep 11 00:41:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:31.623983 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec098-f358-4644-bd6e-4c9eeddf56aa None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:31.728861 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec098-f358-4644-bd6e-4c9eeddf56aa None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:31.766512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861897de-f7ea-46e0-afac-1d10f2ea2cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:31.767470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861897de-f7ea-46e0-afac-1d10f2ea2cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:31.767922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861897de-f7ea-46e0-afac-1d10f2ea2cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:31.768363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861897de-f7ea-46e0-afac-1d10f2ea2cd3 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:31.769202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861897de-f7ea-46e0-afac-1d10f2ea2cd3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:31.769675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861897de-f7ea-46e0-afac-1d10f2ea2cd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:31.771229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861897de-f7ea-46e0-afac-1d10f2ea2cd3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:31.776818 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 481/955] 10.222.0.33 () {56 vars in 1122 bytes} [Sun Sep 11 00:41:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:31.784717 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720efa4-1cb0-4207-b0f7-2a921f5e34be None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:31.839174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861897de-f7ea-46e0-afac-1d10f2ea2cd3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:31.877347 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:31.889264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:31.902501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720efa4-1cb0-4207-b0f7-2a921f5e34be None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:31.948299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef88729-92b5-4781-8cee-a74f92a2bbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:31.949152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef88729-92b5-4781-8cee-a74f92a2bbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:31.949424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef88729-92b5-4781-8cee-a74f92a2bbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:31.949690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef88729-92b5-4781-8cee-a74f92a2bbc8 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:31.950370 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef88729-92b5-4781-8cee-a74f92a2bbc8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:31.950670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef88729-92b5-4781-8cee-a74f92a2bbc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:31.951030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861897de-f7ea-46e0-afac-1d10f2ea2cd3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:31.952062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef88729-92b5-4781-8cee-a74f92a2bbc8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:31.958400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 475/956] 10.222.0.33 () {56 vars in 1122 bytes} [Sun Sep 11 00:41:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:31.964842 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef88729-92b5-4781-8cee-a74f92a2bbc8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:31.995186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83919ade-aa84-49b3-ab10-3260efc3c4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:31.995908 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919ade-aa84-49b3-ab10-3260efc3c4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:31.996327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919ade-aa84-49b3-ab10-3260efc3c4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:31.996717 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919ade-aa84-49b3-ab10-3260efc3c4b4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:31.997390 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83919ade-aa84-49b3-ab10-3260efc3c4b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:31.998986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83919ade-aa84-49b3-ab10-3260efc3c4b4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-83919ade-aa84-49b3-ab10-3260efc3c4b4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:32.009515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:32.010599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:41:32.011454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:32.015869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 482/957] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:32.016962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83919ade-aa84-49b3-ab10-3260efc3c4b4 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:32.076977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef88729-92b5-4781-8cee-a74f92a2bbc8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:32.113817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e7e95-8c33-4d31-ba9e-c74ac2065495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:32.114906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7e95-8c33-4d31-ba9e-c74ac2065495 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:32.115335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7e95-8c33-4d31-ba9e-c74ac2065495 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:32.115752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7e95-8c33-4d31-ba9e-c74ac2065495 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:32.117115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e7e95-8c33-4d31-ba9e-c74ac2065495 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:32.118892 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e7e95-8c33-4d31-ba9e-c74ac2065495 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:32.127750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83919ade-aa84-49b3-ab10-3260efc3c4b4 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:32.136444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:32.142244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:32.145309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 476/958] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:41:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:32.177346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d81c25-d1f8-4e37-9adc-b4f87d028576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:32.177965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d81c25-d1f8-4e37-9adc-b4f87d028576 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:32.178239 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d81c25-d1f8-4e37-9adc-b4f87d028576 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:32.179127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d81c25-d1f8-4e37-9adc-b4f87d028576 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:32.179774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d81c25-d1f8-4e37-9adc-b4f87d028576 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:32.180070 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d81c25-d1f8-4e37-9adc-b4f87d028576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:32.181533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d81c25-d1f8-4e37-9adc-b4f87d028576 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:32.187673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 483/959] 10.222.0.33 () {56 vars in 1112 bytes} [Sun Sep 11 00:41:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:32.193372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e7e95-8c33-4d31-ba9e-c74ac2065495 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:32.313212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e7e95-8c33-4d31-ba9e-c74ac2065495 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:32.350946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c86e8b-58f5-425b-ae52-7a87ac8766b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:32.351923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c86e8b-58f5-425b-ae52-7a87ac8766b2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:32.352408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c86e8b-58f5-425b-ae52-7a87ac8766b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:32.352869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c86e8b-58f5-425b-ae52-7a87ac8766b2 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:32.353687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c86e8b-58f5-425b-ae52-7a87ac8766b2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:32.354179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c86e8b-58f5-425b-ae52-7a87ac8766b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:32.355767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c86e8b-58f5-425b-ae52-7a87ac8766b2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:32.360615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 477/960] 10.222.0.33 () {56 vars in 1112 bytes} [Sun Sep 11 00:41:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:33.083942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c3ceb-5c45-4f58-ba54-9ec689970916 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:33.084548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c3ceb-5c45-4f58-ba54-9ec689970916 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:33.084628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c3ceb-5c45-4f58-ba54-9ec689970916 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:33.086199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 484/961] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:33.091518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfffe8-76d5-4f33-a709-a8bb682f80dd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:33.091927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfffe8-76d5-4f33-a709-a8bb682f80dd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:33.092067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfffe8-76d5-4f33-a709-a8bb682f80dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:33.111064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-90cfffe8-76d5-4f33-a709-a8bb682f80dd None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:33.112556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-90cfffe8-76d5-4f33-a709-a8bb682f80dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:33.173185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:33.183396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 478/962] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:33.372962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b737694-bb2a-4d1d-be00-e042161e78f6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:33.373157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b737694-bb2a-4d1d-be00-e042161e78f6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:33.373423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b737694-bb2a-4d1d-be00-e042161e78f6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:33.375030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 485/963] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:33.380194 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233a0a6-d740-4eb5-8f60-8a9c41629694 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:33.380478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233a0a6-d740-4eb5-8f60-8a9c41629694 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:33.380747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233a0a6-d740-4eb5-8f60-8a9c41629694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:33.399479 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f233a0a6-d740-4eb5-8f60-8a9c41629694 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:33.400676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f233a0a6-d740-4eb5-8f60-8a9c41629694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:33.466911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b737694-bb2a-4d1d-be00-e042161e78f6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:33.473121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 479/964] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:33.581278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b737694-bb2a-4d1d-be00-e042161e78f6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:33.617195 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2ab22-ed16-44f7-aacc-3d0a54ec0b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:33.617826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2ab22-ed16-44f7-aacc-3d0a54ec0b4a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:33.618101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2ab22-ed16-44f7-aacc-3d0a54ec0b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:33.618373 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2ab22-ed16-44f7-aacc-3d0a54ec0b4a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:33.630508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2ab22-ed16-44f7-aacc-3d0a54ec0b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-0ca2ab22-ed16-44f7-aacc-3d0a54ec0b4a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:33.635399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:33.636343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:33.637203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:33.637203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:33.637203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:33.637203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:33.637203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:33.637203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:33.637203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:33.637203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:33.637203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:33.637203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:33.637203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:41:33.637203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:33.637203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 486/965] 10.222.0.33 () {56 vars in 1120 bytes} [Sun Sep 11 00:41:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:33.642778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233a0a6-d740-4eb5-8f60-8a9c41629694 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:33.746481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233a0a6-d740-4eb5-8f60-8a9c41629694 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:33.762237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2ab22-ed16-44f7-aacc-3d0a54ec0b4a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:33.778435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:33.794308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8667d23-e828-4c78-879b-6df009d122f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:33.794967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8667d23-e828-4c78-879b-6df009d122f6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:33.795247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8667d23-e828-4c78-879b-6df009d122f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:33.795517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8667d23-e828-4c78-879b-6df009d122f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:33.796180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8667d23-e828-4c78-879b-6df009d122f6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:33.796481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8667d23-e828-4c78-879b-6df009d122f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:33.798564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8667d23-e828-4c78-879b-6df009d122f6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:33.807157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:33.811831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 480/966] 10.222.0.33 () {56 vars in 1115 bytes} [Sun Sep 11 00:41:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:33.817454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8667d23-e828-4c78-879b-6df009d122f6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:33.901057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2ab22-ed16-44f7-aacc-3d0a54ec0b4a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:33.922301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8667d23-e828-4c78-879b-6df009d122f6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:33.941680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df286f3-8ef2-4e53-b9dd-d9440e479b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:33.942863 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df286f3-8ef2-4e53-b9dd-d9440e479b3e None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:33.943910 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df286f3-8ef2-4e53-b9dd-d9440e479b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:33.944407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df286f3-8ef2-4e53-b9dd-d9440e479b3e None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:33.945250 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df286f3-8ef2-4e53-b9dd-d9440e479b3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:33.947991 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df286f3-8ef2-4e53-b9dd-d9440e479b3e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:33.951041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: WARNING keystone.server.flask.common [None req-2df286f3-8ef2-4e53-b9dd-d9440e479b3e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 11 00:41:33.957938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671e2e4-5d30-4b75-8ba3-f79e07fb273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:33.958675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671e2e4-5d30-4b75-8ba3-f79e07fb273b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:33.959634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671e2e4-5d30-4b75-8ba3-f79e07fb273b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:33.959989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671e2e4-5d30-4b75-8ba3-f79e07fb273b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:33.967468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.sql.core [None req-2df286f3-8ef2-4e53-b9dd-d9440e479b3e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 00:41:33.967468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 00:41:33.967468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [parameters: {'user_id': 'e100a7eac3544f77b7397cb5acf51b68', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 00:41:33.967468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81701) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 00:41:33.972040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671e2e4-5d30-4b75-8ba3-f79e07fb273b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:33.973629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671e2e4-5d30-4b75-8ba3-f79e07fb273b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-2df286f3-8ef2-4e53-b9dd-d9440e479b3e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application result.read() Sep 11 00:41:33.988641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:41:33.989577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application yield resource Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise self.value Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application session.commit() Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 00:41:33.990608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self.session.flush() Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application compat.raise_( Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 00:41:33.991554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:41:33.992439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application result.read() Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:41:33.993325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e100a7eac3544f77b7397cb5acf51b68', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:33.994251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 11 00:41:33.997230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 11 00:41:33.999412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 11 00:41:33.999412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 11 00:41:33.999412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 00:41:33.999412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 00:41:33.999412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 00:41:33.999412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f671e2e4-5d30-4b75-8ba3-f79e07fb273b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:34.000241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:34.008850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:34.011072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:34.011072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:34.011072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:34.011072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 481/967] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:34.011072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671e2e4-5d30-4b75-8ba3-f79e07fb273b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:34.011741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 487/968] 10.222.0.33 () {60 vars in 1131 bytes} [Sun Sep 11 00:41:33 2022] POST /identity/v3/users => generated 160 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:34.016255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df286f3-8ef2-4e53-b9dd-d9440e479b3e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:34.039093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:34.106946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671e2e4-5d30-4b75-8ba3-f79e07fb273b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:34.141494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:34.143693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8910415-ce71-4548-9bbf-46b9fb1e5942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:34.144563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8910415-ce71-4548-9bbf-46b9fb1e5942 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:34.144977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8910415-ce71-4548-9bbf-46b9fb1e5942 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:34.145277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8910415-ce71-4548-9bbf-46b9fb1e5942 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:34.145928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8910415-ce71-4548-9bbf-46b9fb1e5942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:34.146183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8910415-ce71-4548-9bbf-46b9fb1e5942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:34.147828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8910415-ce71-4548-9bbf-46b9fb1e5942 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:34.158546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df286f3-8ef2-4e53-b9dd-d9440e479b3e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:34.165616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 482/969] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:34.167233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8910415-ce71-4548-9bbf-46b9fb1e5942 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:34.206018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363033b5-381d-47f8-bbed-2d7ae72b687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:34.206954 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363033b5-381d-47f8-bbed-2d7ae72b687a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:34.207400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363033b5-381d-47f8-bbed-2d7ae72b687a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:34.207834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363033b5-381d-47f8-bbed-2d7ae72b687a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:34.223428 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363033b5-381d-47f8-bbed-2d7ae72b687a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:34.225528 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363033b5-381d-47f8-bbed-2d7ae72b687a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-363033b5-381d-47f8-bbed-2d7ae72b687a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:34.242381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:34.243459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:34.244427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:34.244427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:34.244427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:34.244427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:34.244427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:34.244427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:34.244427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:34.244427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:34.244427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:41:34.244427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:34.252770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 488/970] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:41:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:34.252770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363033b5-381d-47f8-bbed-2d7ae72b687a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:34.281479 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:34.285332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8910415-ce71-4548-9bbf-46b9fb1e5942 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:34.322471 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c244b-b327-4ad2-9daa-fa4f074a8a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:34.323299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c244b-b327-4ad2-9daa-fa4f074a8a81 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:34.323677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c244b-b327-4ad2-9daa-fa4f074a8a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:34.324046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c244b-b327-4ad2-9daa-fa4f074a8a81 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:34.331731 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c244b-b327-4ad2-9daa-fa4f074a8a81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:34.333405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c244b-b327-4ad2-9daa-fa4f074a8a81 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-382c244b-b327-4ad2-9daa-fa4f074a8a81 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:34.346340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:34.347352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:34.348315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:34.348315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:34.348315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:34.348315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:34.348315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:34.348315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:34.348315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:34.348315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:34.348315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:41:34.348315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:34.350897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 483/971] 10.222.0.33 () {56 vars in 1117 bytes} [Sun Sep 11 00:41:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:34.352116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0e0d9-3589-46f9-ab87-d0ab63f2c79d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:34.352428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0e0d9-3589-46f9-ab87-d0ab63f2c79d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:34.352665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0e0d9-3589-46f9-ab87-d0ab63f2c79d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:34.353919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 484/972] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:34.354597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0e0d9-3589-46f9-ab87-d0ab63f2c79d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:34.391179 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363033b5-381d-47f8-bbed-2d7ae72b687a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:34.426029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b7600-f0c7-46af-9e21-23f89764c9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:34.426555 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7600-f0c7-46af-9e21-23f89764c9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:34.426878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7600-f0c7-46af-9e21-23f89764c9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:34.427155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7600-f0c7-46af-9e21-23f89764c9a4 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:34.428494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b7600-f0c7-46af-9e21-23f89764c9a4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:34.428790 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b7600-f0c7-46af-9e21-23f89764c9a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:34.430266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b7600-f0c7-46af-9e21-23f89764c9a4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:34.472048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 489/973] 10.222.0.33 () {56 vars in 1101 bytes} [Sun Sep 11 00:41:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:34.473405 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85749e4-0793-423c-bdb6-959f348151fe None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:34.473688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85749e4-0793-423c-bdb6-959f348151fe None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:34.473954 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85749e4-0793-423c-bdb6-959f348151fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:34.487622 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0e0d9-3589-46f9-ab87-d0ab63f2c79d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:34.496837 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c85749e4-0793-423c-bdb6-959f348151fe None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:34.498966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c85749e4-0793-423c-bdb6-959f348151fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:34.503168 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:34.545834 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6f683-d890-4798-831d-2343260352ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:34.546846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6f683-d890-4798-831d-2343260352ab None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:34.547625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6f683-d890-4798-831d-2343260352ab None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:34.548107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6f683-d890-4798-831d-2343260352ab None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:34.550084 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6f683-d890-4798-831d-2343260352ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:34.550660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6f683-d890-4798-831d-2343260352ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:34.552355 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6f683-d890-4798-831d-2343260352ab None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:34.583895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 485/974] 10.222.0.33 () {56 vars in 1149 bytes} [Sun Sep 11 00:41:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:34.585070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6f683-d890-4798-831d-2343260352ab None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:34.599001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 490/975] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:34.601617 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75a126-d650-4468-a9c6-b6009e5604fd None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:34.602348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75a126-d650-4468-a9c6-b6009e5604fd None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:34.602862 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75a126-d650-4468-a9c6-b6009e5604fd None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:34.605517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 491/976] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:34.607452 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:34.616923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e28af0-84a6-4d5a-b115-8abcd38db851 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:34.616923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e28af0-84a6-4d5a-b115-8abcd38db851 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:34.616923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e28af0-84a6-4d5a-b115-8abcd38db851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:34.636949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f7e28af0-84a6-4d5a-b115-8abcd38db851 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:34.638155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f7e28af0-84a6-4d5a-b115-8abcd38db851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:34.711786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6f683-d890-4798-831d-2343260352ab None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:34.730300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 492/977] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:34.754710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0166784-881f-4a92-bf89-decf4d428e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:34.755352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0166784-881f-4a92-bf89-decf4d428e5d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:34.755631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0166784-881f-4a92-bf89-decf4d428e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:34.755955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0166784-881f-4a92-bf89-decf4d428e5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:34.827220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0166784-881f-4a92-bf89-decf4d428e5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:34.828670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0166784-881f-4a92-bf89-decf4d428e5d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:34.846544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:34.880583 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e28af0-84a6-4d5a-b115-8abcd38db851 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:34.932396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 486/978] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:41:34 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:41:34.938170 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0166784-881f-4a92-bf89-decf4d428e5d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:34.948836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:34.980462 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e28af0-84a6-4d5a-b115-8abcd38db851 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:35.013649 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9edf-f627-42ea-af15-999c4d5a0275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:35.014269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9edf-f627-42ea-af15-999c4d5a0275 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:35.014543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9edf-f627-42ea-af15-999c4d5a0275 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:35.014840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9edf-f627-42ea-af15-999c4d5a0275 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:35.015420 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d9edf-f627-42ea-af15-999c4d5a0275 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:35.016766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d9edf-f627-42ea-af15-999c4d5a0275 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-892d9edf-f627-42ea-af15-999c4d5a0275 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:35.025812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:35.026822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:35.027659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 493/979] 10.222.0.33 () {56 vars in 1126 bytes} [Sun Sep 11 00:41:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:35.028464 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9edf-f627-42ea-af15-999c4d5a0275 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:35.041507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0166784-881f-4a92-bf89-decf4d428e5d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:35.058001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:35.076703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f36dd3-38cb-449d-95e3-87a00cbe4264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:35.077359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f36dd3-38cb-449d-95e3-87a00cbe4264 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:35.077634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f36dd3-38cb-449d-95e3-87a00cbe4264 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:35.077910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f36dd3-38cb-449d-95e3-87a00cbe4264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:35.088176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f36dd3-38cb-449d-95e3-87a00cbe4264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:35.089619 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f36dd3-38cb-449d-95e3-87a00cbe4264 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-06f36dd3-38cb-449d-95e3-87a00cbe4264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:35.104501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:35.105641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:35.106818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:35.106818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:35.106818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:35.110295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 487/980] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:35.111157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f36dd3-38cb-449d-95e3-87a00cbe4264 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:35.132033 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9edf-f627-42ea-af15-999c4d5a0275 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:35.164963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8a8ec-debd-4703-8880-ff5d5b88e6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:35.165532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8a8ec-debd-4703-8880-ff5d5b88e6f9 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:35.165804 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8a8ec-debd-4703-8880-ff5d5b88e6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:35.166066 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8a8ec-debd-4703-8880-ff5d5b88e6f9 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:35.166692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8a8ec-debd-4703-8880-ff5d5b88e6f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:35.168050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8a8ec-debd-4703-8880-ff5d5b88e6f9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:35.171323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:35.182844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 494/981] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:41:35 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:35.183615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8a8ec-debd-4703-8880-ff5d5b88e6f9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:35.223909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f36dd3-38cb-449d-95e3-87a00cbe4264 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:35.270143 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85d2e1-56ac-4d31-8e4d-81321034a15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:35.270789 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85d2e1-56ac-4d31-8e4d-81321034a15e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:35.271066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85d2e1-56ac-4d31-8e4d-81321034a15e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:35.271988 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85d2e1-56ac-4d31-8e4d-81321034a15e None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:35.272631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85d2e1-56ac-4d31-8e4d-81321034a15e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:35.272977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85d2e1-56ac-4d31-8e4d-81321034a15e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:35.274393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85d2e1-56ac-4d31-8e4d-81321034a15e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:35.281016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 488/982] 10.222.0.33 () {56 vars in 1122 bytes} [Sun Sep 11 00:41:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:35.287581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85d2e1-56ac-4d31-8e4d-81321034a15e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:35.309296 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8a8ec-debd-4703-8880-ff5d5b88e6f9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:35.318847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:35.354160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dd408-e5b1-4db2-b0e8-ee17ad34df47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:35.354797 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dd408-e5b1-4db2-b0e8-ee17ad34df47 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:35.355129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dd408-e5b1-4db2-b0e8-ee17ad34df47 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:35.355400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dd408-e5b1-4db2-b0e8-ee17ad34df47 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:35.356040 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dd408-e5b1-4db2-b0e8-ee17ad34df47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:35.356382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dd408-e5b1-4db2-b0e8-ee17ad34df47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:35.357753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dd408-e5b1-4db2-b0e8-ee17ad34df47 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:35.371493 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 495/983] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:35.377762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dd408-e5b1-4db2-b0e8-ee17ad34df47 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:35.401304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85d2e1-56ac-4d31-8e4d-81321034a15e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:35.440421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:35.442018 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fe839-fd8c-4c82-8f30-91e75a357bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:35.443554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fe839-fd8c-4c82-8f30-91e75a357bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:35.443890 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fe839-fd8c-4c82-8f30-91e75a357bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:35.444300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fe839-fd8c-4c82-8f30-91e75a357bc0 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:35.444942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fe839-fd8c-4c82-8f30-91e75a357bc0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:35.445557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fe839-fd8c-4c82-8f30-91e75a357bc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:35.446958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fe839-fd8c-4c82-8f30-91e75a357bc0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:35.456794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 489/984] 10.222.0.33 () {56 vars in 1122 bytes} [Sun Sep 11 00:41:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:35.457814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fe839-fd8c-4c82-8f30-91e75a357bc0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:35.495108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dd408-e5b1-4db2-b0e8-ee17ad34df47 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:35.532269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872bbef-c84f-4384-a35a-f1c5af9d30b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:35.532930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872bbef-c84f-4384-a35a-f1c5af9d30b0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:35.533209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872bbef-c84f-4384-a35a-f1c5af9d30b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:35.533479 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872bbef-c84f-4384-a35a-f1c5af9d30b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:35.541522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872bbef-c84f-4384-a35a-f1c5af9d30b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:35.542979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872bbef-c84f-4384-a35a-f1c5af9d30b0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:35.547061 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:35.556110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fe839-fd8c-4c82-8f30-91e75a357bc0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-1872bbef-c84f-4384-a35a-f1c5af9d30b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:35.557618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:35.558565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:35.559598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:35.559598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:35.559598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:35.559598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:35.559598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:35.559598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:35.559598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:35.559598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:35.559598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 496/985] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:35.564501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872bbef-c84f-4384-a35a-f1c5af9d30b0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:35.595984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526207a9-7eab-4fe0-b71b-98c13f9c9af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:35.596591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526207a9-7eab-4fe0-b71b-98c13f9c9af6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:35.596873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526207a9-7eab-4fe0-b71b-98c13f9c9af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:35.597147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526207a9-7eab-4fe0-b71b-98c13f9c9af6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:35.597846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526207a9-7eab-4fe0-b71b-98c13f9c9af6 None admin] RBAC: Adding query filter params (interface=admin, service_id=e36781d717e14042a0659a31aa4f9272, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:35.598161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526207a9-7eab-4fe0-b71b-98c13f9c9af6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:35.599630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526207a9-7eab-4fe0-b71b-98c13f9c9af6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:35.609026 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 490/986] 10.222.0.33 () {56 vars in 1249 bytes} [Sun Sep 11 00:41:35 2022] GET /identity/v3/endpoints?service_id=e36781d717e14042a0659a31aa4f9272&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:35.609978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526207a9-7eab-4fe0-b71b-98c13f9c9af6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:35.675175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872bbef-c84f-4384-a35a-f1c5af9d30b0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:35.690991 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:35.713958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb3d3c-4af1-467f-bfac-da232ffd6dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:35.714562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb3d3c-4af1-467f-bfac-da232ffd6dba None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:35.714870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb3d3c-4af1-467f-bfac-da232ffd6dba None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:35.715141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb3d3c-4af1-467f-bfac-da232ffd6dba None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:35.715826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb3d3c-4af1-467f-bfac-da232ffd6dba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:35.716126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb3d3c-4af1-467f-bfac-da232ffd6dba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:35.717176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526207a9-7eab-4fe0-b71b-98c13f9c9af6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:35.717546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb3d3c-4af1-467f-bfac-da232ffd6dba None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:35.729920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 497/987] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:35.735727 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb3d3c-4af1-467f-bfac-da232ffd6dba None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:35.754069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b1987-9156-4ff7-b561-176ea39d85a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:35.754670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b1987-9156-4ff7-b561-176ea39d85a5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:35.754972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b1987-9156-4ff7-b561-176ea39d85a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:35.755252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b1987-9156-4ff7-b561-176ea39d85a5 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:35.755897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b1987-9156-4ff7-b561-176ea39d85a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:35.757252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b1987-9156-4ff7-b561-176ea39d85a5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:35.763732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 491/988] 10.222.0.33 () {56 vars in 1087 bytes} [Sun Sep 11 00:41:35 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:41:35.843006 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb3d3c-4af1-467f-bfac-da232ffd6dba None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:35.878905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b32a4-3d8c-4cff-8cf2-b0f7da2247c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:35.879704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b32a4-3d8c-4cff-8cf2-b0f7da2247c9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:35.880077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b32a4-3d8c-4cff-8cf2-b0f7da2247c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:35.881047 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b32a4-3d8c-4cff-8cf2-b0f7da2247c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:35.881880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b32a4-3d8c-4cff-8cf2-b0f7da2247c9 None admin] RBAC: Adding query filter params (role.id=9f2d3d0a9ad045e7a84121e39319f1fc, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=f2c9025c666340aaaf2a664c88650942) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:35.882290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b32a4-3d8c-4cff-8cf2-b0f7da2247c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:35.883864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b32a4-3d8c-4cff-8cf2-b0f7da2247c9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:35.899073 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 498/989] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:41:35 2022] GET /identity/v3/role_assignments?user.id=f2c9025c666340aaaf2a664c88650942&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=9f2d3d0a9ad045e7a84121e39319f1fc => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:37.382474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d9ad7-c631-4a07-b84f-090060203e57 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:37.383026 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d9ad7-c631-4a07-b84f-090060203e57 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:37.383130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d9ad7-c631-4a07-b84f-090060203e57 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:37.384533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 492/990] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:37.389523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d8a2e-ae2c-4536-a3a1-6213a592ff61 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:37.389917 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d8a2e-ae2c-4536-a3a1-6213a592ff61 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:37.390088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d8a2e-ae2c-4536-a3a1-6213a592ff61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:37.408699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-744d8a2e-ae2c-4536-a3a1-6213a592ff61 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:37.409880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-744d8a2e-ae2c-4536-a3a1-6213a592ff61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:37.440361 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:37.480312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 499/991] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:37.746482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d9ad7-c631-4a07-b84f-090060203e57 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:37.769464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:37.855752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d9ad7-c631-4a07-b84f-090060203e57 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:37.889555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395859b-7654-431a-8367-e750b890c784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:37.890174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395859b-7654-431a-8367-e750b890c784 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:37.890444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395859b-7654-431a-8367-e750b890c784 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:37.890705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395859b-7654-431a-8367-e750b890c784 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:37.891297 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395859b-7654-431a-8367-e750b890c784 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:37.892670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395859b-7654-431a-8367-e750b890c784 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1395859b-7654-431a-8367-e750b890c784 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:37.901527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:37.902514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:37.903707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 493/992] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:37.908435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d8a2e-ae2c-4536-a3a1-6213a592ff61 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:37.925647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32002cb9-2486-457d-bc3c-cdaea77f122c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:37.926204 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32002cb9-2486-457d-bc3c-cdaea77f122c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:37.927046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32002cb9-2486-457d-bc3c-cdaea77f122c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:37.928494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 494/993] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:37.933384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c7248-a4b9-4aa1-b21d-f70ab2b43a3e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:37.933671 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c7248-a4b9-4aa1-b21d-f70ab2b43a3e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:37.933949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c7248-a4b9-4aa1-b21d-f70ab2b43a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:37.952317 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-180c7248-a4b9-4aa1-b21d-f70ab2b43a3e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:37.953499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-180c7248-a4b9-4aa1-b21d-f70ab2b43a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:38.018951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d8a2e-ae2c-4536-a3a1-6213a592ff61 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:38.027148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 495/994] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:38.055941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11a395-c801-4c9f-9444-e738ad8ef55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:38.056550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11a395-c801-4c9f-9444-e738ad8ef55b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:38.056866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11a395-c801-4c9f-9444-e738ad8ef55b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:38.057091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11a395-c801-4c9f-9444-e738ad8ef55b None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:38.057714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11a395-c801-4c9f-9444-e738ad8ef55b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:38.058013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11a395-c801-4c9f-9444-e738ad8ef55b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:38.059390 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11a395-c801-4c9f-9444-e738ad8ef55b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:38.069092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 500/995] 10.222.0.33 () {56 vars in 1112 bytes} [Sun Sep 11 00:41:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:38.070511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c7248-a4b9-4aa1-b21d-f70ab2b43a3e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:38.088467 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:38.109290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4545d00-ad6f-4cc7-8484-fcd9630ce88a None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:38.109568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4545d00-ad6f-4cc7-8484-fcd9630ce88a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:38.109842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4545d00-ad6f-4cc7-8484-fcd9630ce88a None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:38.111222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 501/996] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:38.116754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf61ca-176b-4d0e-8fa9-eeeca8798de4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:38.117041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf61ca-176b-4d0e-8fa9-eeeca8798de4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:38.117316 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf61ca-176b-4d0e-8fa9-eeeca8798de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:38.136248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-babf61ca-176b-4d0e-8fa9-eeeca8798de4 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:38.137421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-babf61ca-176b-4d0e-8fa9-eeeca8798de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:38.164122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:38.177668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c7248-a4b9-4aa1-b21d-f70ab2b43a3e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:38.209588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 502/997] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:38.214094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e9002-dac7-4e35-aed3-2cce685e0577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:38.215023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e9002-dac7-4e35-aed3-2cce685e0577 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:38.215508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e9002-dac7-4e35-aed3-2cce685e0577 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:38.216002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e9002-dac7-4e35-aed3-2cce685e0577 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:38.216820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e9002-dac7-4e35-aed3-2cce685e0577 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:38.217330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e9002-dac7-4e35-aed3-2cce685e0577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:38.218929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e9002-dac7-4e35-aed3-2cce685e0577 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:38.224987 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 496/998] 10.222.0.33 () {56 vars in 1112 bytes} [Sun Sep 11 00:41:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:38.230510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf61ca-176b-4d0e-8fa9-eeeca8798de4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:38.305172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e9002-dac7-4e35-aed3-2cce685e0577 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:38.330572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf61ca-176b-4d0e-8fa9-eeeca8798de4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:38.366695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96a73-47f6-4f2a-b2c5-f3fcd9c4959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:38.367312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96a73-47f6-4f2a-b2c5-f3fcd9c4959b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:38.367587 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96a73-47f6-4f2a-b2c5-f3fcd9c4959b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:38.367856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96a73-47f6-4f2a-b2c5-f3fcd9c4959b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:38.368538 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b96a73-47f6-4f2a-b2c5-f3fcd9c4959b None admin] RBAC: Adding query filter params (interface=public, service_id=5566b164bda04656a5d202ff3bcf6f89, region_id=RegionOne) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:38.368837 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b96a73-47f6-4f2a-b2c5-f3fcd9c4959b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:38.370171 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b96a73-47f6-4f2a-b2c5-f3fcd9c4959b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:38.375065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 503/999] 10.222.0.33 () {56 vars in 1251 bytes} [Sun Sep 11 00:41:38 2022] GET /identity/v3/endpoints?service_id=5566b164bda04656a5d202ff3bcf6f89&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:38.381200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96a73-47f6-4f2a-b2c5-f3fcd9c4959b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:38.389176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:38.410647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e9002-dac7-4e35-aed3-2cce685e0577 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:38.411871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:38.455148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c09bc-12c2-4c94-b168-4e4dc083a724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:38.455835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c09bc-12c2-4c94-b168-4e4dc083a724 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:38.456060 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c09bc-12c2-4c94-b168-4e4dc083a724 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:38.456326 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c09bc-12c2-4c94-b168-4e4dc083a724 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:38.456906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c09bc-12c2-4c94-b168-4e4dc083a724 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:38.458347 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c09bc-12c2-4c94-b168-4e4dc083a724 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6e9c09bc-12c2-4c94-b168-4e4dc083a724 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:38.467473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:38.468503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:38.469340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 497/1000] 10.222.0.33 () {56 vars in 1126 bytes} [Sun Sep 11 00:41:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:38.474916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c09bc-12c2-4c94-b168-4e4dc083a724 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:38.499177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96a73-47f6-4f2a-b2c5-f3fcd9c4959b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:38.533233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55467381-f657-4933-8c49-436e12609bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:38.533856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55467381-f657-4933-8c49-436e12609bec None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:38.534135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55467381-f657-4933-8c49-436e12609bec None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:38.534402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55467381-f657-4933-8c49-436e12609bec None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:38.535026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55467381-f657-4933-8c49-436e12609bec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:38.536896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55467381-f657-4933-8c49-436e12609bec None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:38.542970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 504/1001] 10.222.0.33 () {56 vars in 1087 bytes} [Sun Sep 11 00:41:38 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:41:38.543738 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55467381-f657-4933-8c49-436e12609bec None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:38.577337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c09bc-12c2-4c94-b168-4e4dc083a724 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:38.615872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238bb29-1476-4d7f-b43e-f5bbff3c5351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:38.616560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238bb29-1476-4d7f-b43e-f5bbff3c5351 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:38.616838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238bb29-1476-4d7f-b43e-f5bbff3c5351 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:38.617104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238bb29-1476-4d7f-b43e-f5bbff3c5351 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:38.617743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238bb29-1476-4d7f-b43e-f5bbff3c5351 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:38.618052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238bb29-1476-4d7f-b43e-f5bbff3c5351 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:38.619478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238bb29-1476-4d7f-b43e-f5bbff3c5351 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:38.629638 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 498/1002] 10.222.0.33 () {56 vars in 1122 bytes} [Sun Sep 11 00:41:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:38.631082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238bb29-1476-4d7f-b43e-f5bbff3c5351 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:38.642091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:38.653559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:38.666471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55467381-f657-4933-8c49-436e12609bec None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:38.707053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbd718-0b12-47ca-ada6-a25140cb1c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:38.708236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbd718-0b12-47ca-ada6-a25140cb1c7a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:38.708523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbd718-0b12-47ca-ada6-a25140cb1c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:38.708790 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbd718-0b12-47ca-ada6-a25140cb1c7a None admin] PATH_INFO: `/v3/services/image` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:38.709377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbd718-0b12-47ca-ada6-a25140cb1c7a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:38.710759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbd718-0b12-47ca-ada6-a25140cb1c7a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-c7cbd718-0b12-47ca-ada6-a25140cb1c7a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:38.722266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:38.724093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:38.725008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 505/1003] 10.222.0.33 () {56 vars in 1105 bytes} [Sun Sep 11 00:41:38 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:38.731741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbd718-0b12-47ca-ada6-a25140cb1c7a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:38.756631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238bb29-1476-4d7f-b43e-f5bbff3c5351 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:38.790870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8f3fd-68b0-4801-8d54-9b7cc55bb29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:38.791478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8f3fd-68b0-4801-8d54-9b7cc55bb29a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:38.791771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8f3fd-68b0-4801-8d54-9b7cc55bb29a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:38.792022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8f3fd-68b0-4801-8d54-9b7cc55bb29a None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:38.792638 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8f3fd-68b0-4801-8d54-9b7cc55bb29a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:38.792949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8f3fd-68b0-4801-8d54-9b7cc55bb29a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:38.794280 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8f3fd-68b0-4801-8d54-9b7cc55bb29a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:38.799302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 499/1004] 10.222.0.33 () {56 vars in 1122 bytes} [Sun Sep 11 00:41:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:38.804694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8f3fd-68b0-4801-8d54-9b7cc55bb29a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:38.851525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbd718-0b12-47ca-ada6-a25140cb1c7a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:38.877825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:38.887426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926633e8-e7e4-4c4e-b09f-3df956b3be18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:38.888118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926633e8-e7e4-4c4e-b09f-3df956b3be18 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:38.888398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926633e8-e7e4-4c4e-b09f-3df956b3be18 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:38.888667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926633e8-e7e4-4c4e-b09f-3df956b3be18 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:38.889297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926633e8-e7e4-4c4e-b09f-3df956b3be18 None admin] RBAC: Adding query filter params (name=image) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:38.889626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926633e8-e7e4-4c4e-b09f-3df956b3be18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:38.890986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926633e8-e7e4-4c4e-b09f-3df956b3be18 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:38.901090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 506/1005] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:38.902108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926633e8-e7e4-4c4e-b09f-3df956b3be18 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:38.917498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8f3fd-68b0-4801-8d54-9b7cc55bb29a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:38.921805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:38.951932 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5834f25-f058-464d-8dd4-6732a4fc998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:38.952575 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834f25-f058-464d-8dd4-6732a4fc998d None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:38.952848 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834f25-f058-464d-8dd4-6732a4fc998d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:38.953118 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834f25-f058-464d-8dd4-6732a4fc998d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:38.953773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5834f25-f058-464d-8dd4-6732a4fc998d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:38.955171 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5834f25-f058-464d-8dd4-6732a4fc998d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:38.982938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 500/1006] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:41:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:41:39.012643 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926633e8-e7e4-4c4e-b09f-3df956b3be18 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:39.060231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc57c9-a3c9-430a-8b0d-55c13364c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:39.060850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc57c9-a3c9-430a-8b0d-55c13364c0fe None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:39.061129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc57c9-a3c9-430a-8b0d-55c13364c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:39.061398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc57c9-a3c9-430a-8b0d-55c13364c0fe None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:39.062036 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc57c9-a3c9-430a-8b0d-55c13364c0fe None admin] RBAC: Adding query filter params (type=image) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:39.062337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc57c9-a3c9-430a-8b0d-55c13364c0fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:39.063773 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc57c9-a3c9-430a-8b0d-55c13364c0fe None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:39.075026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 507/1007] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:40.719039 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9ede7-86ba-4b8d-84ae-8646a1e6c3be None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:40.719549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9ede7-86ba-4b8d-84ae-8646a1e6c3be None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:40.719549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9ede7-86ba-4b8d-84ae-8646a1e6c3be None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:40.721059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 501/1008] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:40.726540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0316f54-5246-46d4-ab2b-c44f2333c3fe None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:40.727001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0316f54-5246-46d4-ab2b-c44f2333c3fe None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:40.727168 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0316f54-5246-46d4-ab2b-c44f2333c3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:40.745761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b0316f54-5246-46d4-ab2b-c44f2333c3fe None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:40.746946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b0316f54-5246-46d4-ab2b-c44f2333c3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:40.818149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 508/1009] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:41.091091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9ede7-86ba-4b8d-84ae-8646a1e6c3be None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:41.154651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c267-9ae5-4e71-9a2a-52c7bc5dbfb2 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:41.155019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c267-9ae5-4e71-9a2a-52c7bc5dbfb2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:41.155241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c267-9ae5-4e71-9a2a-52c7bc5dbfb2 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:41.156828 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 509/1010] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:41.162188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654facae-0c46-453d-9481-591ff0d41936 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:41.162467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654facae-0c46-453d-9481-591ff0d41936 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:41.162747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654facae-0c46-453d-9481-591ff0d41936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:41.180378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-654facae-0c46-453d-9481-591ff0d41936 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:41.181540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-654facae-0c46-453d-9481-591ff0d41936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:41.183523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:41.200541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9ede7-86ba-4b8d-84ae-8646a1e6c3be None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:41.231304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:41.238292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0658f1e-e784-46b6-bc92-81ca54653316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:41.238968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0658f1e-e784-46b6-bc92-81ca54653316 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:41.239396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0658f1e-e784-46b6-bc92-81ca54653316 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:41.240019 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0658f1e-e784-46b6-bc92-81ca54653316 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:41.240733 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0658f1e-e784-46b6-bc92-81ca54653316 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:41.242141 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0658f1e-e784-46b6-bc92-81ca54653316 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f0658f1e-e784-46b6-bc92-81ca54653316 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:41.251259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:41.257992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:41.258931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 502/1011] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:41.259747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9af9a-7211-48a1-abdc-b50cd943cb42 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:41.259747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9af9a-7211-48a1-abdc-b50cd943cb42 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:41.259747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9af9a-7211-48a1-abdc-b50cd943cb42 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:41.259747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 503/1012] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:41.260007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 510/1013] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:41.260081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9af9a-7211-48a1-abdc-b50cd943cb42 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:41.262339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93fcb3-614e-4650-9e5a-2dd789f05916 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:41.262659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93fcb3-614e-4650-9e5a-2dd789f05916 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:41.263029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93fcb3-614e-4650-9e5a-2dd789f05916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:41.282551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6f93fcb3-614e-4650-9e5a-2dd789f05916 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:41.283849 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6f93fcb3-614e-4650-9e5a-2dd789f05916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:41.352297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 511/1014] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:41.365054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9af9a-7211-48a1-abdc-b50cd943cb42 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:41.399896 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9e6b7-2281-4516-97ed-acbf0796baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:41.400499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9e6b7-2281-4516-97ed-acbf0796baa3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:41.400779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9e6b7-2281-4516-97ed-acbf0796baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:41.401049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9e6b7-2281-4516-97ed-acbf0796baa3 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:41.401668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9e6b7-2281-4516-97ed-acbf0796baa3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:41.401965 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9e6b7-2281-4516-97ed-acbf0796baa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:41.403355 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9e6b7-2281-4516-97ed-acbf0796baa3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:41.413524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 504/1015] 10.222.0.33 () {56 vars in 1112 bytes} [Sun Sep 11 00:41:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:41.418912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93fcb3-614e-4650-9e5a-2dd789f05916 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:41.492322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:41.524651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9e6b7-2281-4516-97ed-acbf0796baa3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:41.526894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93fcb3-614e-4650-9e5a-2dd789f05916 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:41.562590 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b25ba4-1093-4bc6-b6d1-f207d555ea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:41.563206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25ba4-1093-4bc6-b6d1-f207d555ea2a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:41.563478 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25ba4-1093-4bc6-b6d1-f207d555ea2a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:41.563740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25ba4-1093-4bc6-b6d1-f207d555ea2a None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:41.564350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b25ba4-1093-4bc6-b6d1-f207d555ea2a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:41.564645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b25ba4-1093-4bc6-b6d1-f207d555ea2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:41.565984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b25ba4-1093-4bc6-b6d1-f207d555ea2a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:41.571884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 512/1016] 10.222.0.33 () {56 vars in 1112 bytes} [Sun Sep 11 00:41:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:41.577307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b25ba4-1093-4bc6-b6d1-f207d555ea2a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:41.591914 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:41.636465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9e6b7-2281-4516-97ed-acbf0796baa3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:41.670936 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788e4f1-0194-4638-adf2-4f0d13f6275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:41.671558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788e4f1-0194-4638-adf2-4f0d13f6275a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:41.671836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788e4f1-0194-4638-adf2-4f0d13f6275a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:41.672104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788e4f1-0194-4638-adf2-4f0d13f6275a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:41.673191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788e4f1-0194-4638-adf2-4f0d13f6275a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:41.674617 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788e4f1-0194-4638-adf2-4f0d13f6275a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:41.676240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 505/1017] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:41.676981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788e4f1-0194-4638-adf2-4f0d13f6275a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:41.683528 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b25ba4-1093-4bc6-b6d1-f207d555ea2a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:41.713400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:41.718501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f6521-d42d-4bc4-b88b-1d8f5666080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:41.719124 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f6521-d42d-4bc4-b88b-1d8f5666080b None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:41.719406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f6521-d42d-4bc4-b88b-1d8f5666080b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:41.719676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f6521-d42d-4bc4-b88b-1d8f5666080b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:41.720327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f6521-d42d-4bc4-b88b-1d8f5666080b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:41.721672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f6521-d42d-4bc4-b88b-1d8f5666080b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:41.742276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 513/1018] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:41:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:41:41.743071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f6521-d42d-4bc4-b88b-1d8f5666080b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:41.783293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788e4f1-0194-4638-adf2-4f0d13f6275a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:41.812748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:41.829867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1882f-72bd-4a48-92b4-06d66226017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:41.830481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1882f-72bd-4a48-92b4-06d66226017e None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:41.830781 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1882f-72bd-4a48-92b4-06d66226017e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:41.831053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1882f-72bd-4a48-92b4-06d66226017e None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:41.832356 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1882f-72bd-4a48-92b4-06d66226017e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:41.833879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1882f-72bd-4a48-92b4-06d66226017e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:41.854770 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 506/1019] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:41:41 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:41.863532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f6521-d42d-4bc4-b88b-1d8f5666080b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:41.913892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e53add-c319-4e62-a59d-6090f3857e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:41.914432 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53add-c319-4e62-a59d-6090f3857e6b None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:41.914712 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53add-c319-4e62-a59d-6090f3857e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:41.915006 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53add-c319-4e62-a59d-6090f3857e6b None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:41.915670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e53add-c319-4e62-a59d-6090f3857e6b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:41.917206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e53add-c319-4e62-a59d-6090f3857e6b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:41.952136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 514/1020] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:41:41 2022] POST /identity/v3/projects => generated 311 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:44.044344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a690-f2a0-46f6-9133-65f544d6aee5 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:44.044912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a690-f2a0-46f6-9133-65f544d6aee5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:44.044912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a690-f2a0-46f6-9133-65f544d6aee5 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:44.046253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 507/1021] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:44.048951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b15443-8f5b-4dbd-9b9c-4d3178408cfb None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:44.049441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b15443-8f5b-4dbd-9b9c-4d3178408cfb None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:44.049518 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b15443-8f5b-4dbd-9b9c-4d3178408cfb None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:44.050987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 515/1022] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:44.052193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f6a4b-922a-4a29-8ad8-fa39b08f5f5e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:44.052474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f6a4b-922a-4a29-8ad8-fa39b08f5f5e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:44.052741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f6a4b-922a-4a29-8ad8-fa39b08f5f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:44.057044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1545a-84c3-4455-9895-d2a419d7faa2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:44.057632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1545a-84c3-4455-9895-d2a419d7faa2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:44.057885 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1545a-84c3-4455-9895-d2a419d7faa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:44.073615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e51f6a4b-922a-4a29-8ad8-fa39b08f5f5e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:44.074862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e51f6a4b-922a-4a29-8ad8-fa39b08f5f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:44.082425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a1d1545a-84c3-4455-9895-d2a419d7faa2 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:44.084430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a1d1545a-84c3-4455-9895-d2a419d7faa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:44.123741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:44.155674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 508/1023] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:44.174639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541b047-5d21-4127-9287-cc37c07d8069 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:44.178977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541b047-5d21-4127-9287-cc37c07d8069 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:44.179097 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 516/1024] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:44.179195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541b047-5d21-4127-9287-cc37c07d8069 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:44.179195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 509/1025] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:41:44.181772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c3738-f98a-4abf-bfd6-f61256b2a171 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:44.182060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c3738-f98a-4abf-bfd6-f61256b2a171 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:44.182332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c3738-f98a-4abf-bfd6-f61256b2a171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:44.201199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a61c3738-f98a-4abf-bfd6-f61256b2a171 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:44.202368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a61c3738-f98a-4abf-bfd6-f61256b2a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:44.268126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 517/1026] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:44.425380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541b047-5d21-4127-9287-cc37c07d8069 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:44.442831 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c3738-f98a-4abf-bfd6-f61256b2a171 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:44.533389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541b047-5d21-4127-9287-cc37c07d8069 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:44.540881 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:44.547126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c3738-f98a-4abf-bfd6-f61256b2a171 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:44.547780 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:44.571658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4496ea9-ff12-4abf-a737-92fa08fa4dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:44.572278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4496ea9-ff12-4abf-a737-92fa08fa4dce None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:44.572549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4496ea9-ff12-4abf-a737-92fa08fa4dce None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:44.572813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4496ea9-ff12-4abf-a737-92fa08fa4dce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:44.582950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979989a-a537-4070-bd5a-75d4f8ffb1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:44.583307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4496ea9-ff12-4abf-a737-92fa08fa4dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:44.583612 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979989a-a537-4070-bd5a-75d4f8ffb1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:44.583887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979989a-a537-4070-bd5a-75d4f8ffb1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:44.584149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979989a-a537-4070-bd5a-75d4f8ffb1b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:44.584714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979989a-a537-4070-bd5a-75d4f8ffb1b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:44.586052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979989a-a537-4070-bd5a-75d4f8ffb1b0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e4496ea9-ff12-4abf-a737-92fa08fa4dce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:44.588075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:44.589035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 510/1027] 10.222.0.33 () {56 vars in 1120 bytes} [Sun Sep 11 00:41:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:44.589898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4496ea9-ff12-4abf-a737-92fa08fa4dce None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d979989a-a537-4070-bd5a-75d4f8ffb1b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:44.596809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:44.598085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:44.599743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 518/1028] 10.222.0.33 () {56 vars in 1105 bytes} [Sun Sep 11 00:41:44 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:44.600788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979989a-a537-4070-bd5a-75d4f8ffb1b0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:44.689688 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4496ea9-ff12-4abf-a737-92fa08fa4dce None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:44.696357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979989a-a537-4070-bd5a-75d4f8ffb1b0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:44.723235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d590be3-7369-4bf7-88fd-cae49cf8adee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:44.723846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d590be3-7369-4bf7-88fd-cae49cf8adee None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:44.724115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d590be3-7369-4bf7-88fd-cae49cf8adee None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:44.724383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d590be3-7369-4bf7-88fd-cae49cf8adee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:44.725465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d590be3-7369-4bf7-88fd-cae49cf8adee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:44.726925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d590be3-7369-4bf7-88fd-cae49cf8adee None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:44.728444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 511/1029] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:44.728908 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c998417-0e04-4e18-8f00-ce962667972f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:44.729187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d590be3-7369-4bf7-88fd-cae49cf8adee None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:44.729498 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c998417-0e04-4e18-8f00-ce962667972f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:44.729777 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c998417-0e04-4e18-8f00-ce962667972f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:44.730150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c998417-0e04-4e18-8f00-ce962667972f None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:44.730840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c998417-0e04-4e18-8f00-ce962667972f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:44.731142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c998417-0e04-4e18-8f00-ce962667972f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:44.732469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c998417-0e04-4e18-8f00-ce962667972f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:44.741646 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 519/1030] 10.222.0.33 () {56 vars in 1115 bytes} [Sun Sep 11 00:41:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:44.741779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c998417-0e04-4e18-8f00-ce962667972f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:44.766666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:44.771189 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:44.829212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d590be3-7369-4bf7-88fd-cae49cf8adee None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:44.843483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c998417-0e04-4e18-8f00-ce962667972f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:44.862538 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1e9b7-4b79-4ea6-9fa6-a69058d4f209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:44.863177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1e9b7-4b79-4ea6-9fa6-a69058d4f209 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:44.863453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1e9b7-4b79-4ea6-9fa6-a69058d4f209 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:44.863724 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1e9b7-4b79-4ea6-9fa6-a69058d4f209 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:44.864345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1e9b7-4b79-4ea6-9fa6-a69058d4f209 None admin] RBAC: Adding query filter params (name=image) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:44.864644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1e9b7-4b79-4ea6-9fa6-a69058d4f209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:44.866017 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1e9b7-4b79-4ea6-9fa6-a69058d4f209 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:44.870668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 512/1031] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:44.871455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1e9b7-4b79-4ea6-9fa6-a69058d4f209 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:44.880059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14da1d-88b6-4826-be98-e3c27902406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:44.880665 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14da1d-88b6-4826-be98-e3c27902406d None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:44.880942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14da1d-88b6-4826-be98-e3c27902406d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:44.881211 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14da1d-88b6-4826-be98-e3c27902406d None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:44.881855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14da1d-88b6-4826-be98-e3c27902406d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:44.883295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14da1d-88b6-4826-be98-e3c27902406d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:44.904235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 520/1032] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:41:44 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:41:44.905047 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14da1d-88b6-4826-be98-e3c27902406d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:44.995379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:44.996727 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1e9b7-4b79-4ea6-9fa6-a69058d4f209 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:44.999395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:45.023044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14da1d-88b6-4826-be98-e3c27902406d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:45.037895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2c375-43cd-4fa0-8856-ee9f143947cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:45.038543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2c375-43cd-4fa0-8856-ee9f143947cb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:45.038869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2c375-43cd-4fa0-8856-ee9f143947cb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:45.039132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2c375-43cd-4fa0-8856-ee9f143947cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:45.052574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2c375-43cd-4fa0-8856-ee9f143947cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:45.054200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2c375-43cd-4fa0-8856-ee9f143947cb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:45.064776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f856d9-e3fa-4725-8756-c854de151e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:45.065999 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f856d9-e3fa-4725-8756-c854de151e2f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:45.066206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f856d9-e3fa-4725-8756-c854de151e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:45.066476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f856d9-e3fa-4725-8756-c854de151e2f None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:45.067255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f856d9-e3fa-4725-8756-c854de151e2f None admin] RBAC: Adding query filter params (type=image) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:45.067567 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f856d9-e3fa-4725-8756-c854de151e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:45.069423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f856d9-e3fa-4725-8756-c854de151e2f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-23f2c375-43cd-4fa0-8856-ee9f143947cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:45.072633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:45.073635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:45.074535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:45.074535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:45.074535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:45.074535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 513/1033] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:45.079625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2c375-43cd-4fa0-8856-ee9f143947cb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:45.082479 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 521/1034] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:45.083496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f856d9-e3fa-4725-8756-c854de151e2f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:45.195209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2c375-43cd-4fa0-8856-ee9f143947cb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:45.196779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f856d9-e3fa-4725-8756-c854de151e2f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:45.229735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd66c71-d7f4-41bc-8fd3-b15ba328b740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:45.230334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd66c71-d7f4-41bc-8fd3-b15ba328b740 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:45.230611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd66c71-d7f4-41bc-8fd3-b15ba328b740 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:45.230900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd66c71-d7f4-41bc-8fd3-b15ba328b740 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:45.231518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd66c71-d7f4-41bc-8fd3-b15ba328b740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:45.231801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd66c71-d7f4-41bc-8fd3-b15ba328b740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:45.231916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a60d9-da48-4f62-b978-8c7b67e660aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:45.232430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a60d9-da48-4f62-b978-8c7b67e660aa None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:45.232700 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a60d9-da48-4f62-b978-8c7b67e660aa None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:45.232978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a60d9-da48-4f62-b978-8c7b67e660aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:45.233279 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd66c71-d7f4-41bc-8fd3-b15ba328b740 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:45.233664 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a60d9-da48-4f62-b978-8c7b67e660aa None admin] RBAC: Adding query filter params (interface=public, service_id=3c107a440dc5499b9b666b5688256c46, region_id=RegionOne) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:45.233971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a60d9-da48-4f62-b978-8c7b67e660aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:45.235349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a60d9-da48-4f62-b978-8c7b67e660aa None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:45.241134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 522/1035] 10.222.0.33 () {56 vars in 1251 bytes} [Sun Sep 11 00:41:45 2022] GET /identity/v3/endpoints?service_id=3c107a440dc5499b9b666b5688256c46&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:45.250665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 514/1036] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:45.250986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a60d9-da48-4f62-b978-8c7b67e660aa None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:45.251876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd66c71-d7f4-41bc-8fd3-b15ba328b740 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:45.260617 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:45.271153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:45.357856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a60d9-da48-4f62-b978-8c7b67e660aa None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:45.359079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd66c71-d7f4-41bc-8fd3-b15ba328b740 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:45.394298 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b27d8-c896-4ab6-bdc8-389f1451d780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:45.394937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b27d8-c896-4ab6-bdc8-389f1451d780 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:45.395218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b27d8-c896-4ab6-bdc8-389f1451d780 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:45.395486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b27d8-c896-4ab6-bdc8-389f1451d780 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:45.396050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e177613-e9ca-4bf4-afa9-e8a5907efa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:45.396186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b27d8-c896-4ab6-bdc8-389f1451d780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:45.396678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e177613-e9ca-4bf4-afa9-e8a5907efa89 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:45.396951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e177613-e9ca-4bf4-afa9-e8a5907efa89 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:45.397214 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e177613-e9ca-4bf4-afa9-e8a5907efa89 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:45.397420 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b27d8-c896-4ab6-bdc8-389f1451d780 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:45.410782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 523/1037] 10.222.0.33 () {56 vars in 1087 bytes} [Sun Sep 11 00:41:45 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:41:45.414766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e177613-e9ca-4bf4-afa9-e8a5907efa89 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:45.414766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e177613-e9ca-4bf4-afa9-e8a5907efa89 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5e177613-e9ca-4bf4-afa9-e8a5907efa89 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:45.427418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:45.428461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:45.429430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:45.429430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:45.429430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:45.429430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:45.429430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:45.429430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:45.429430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:45.429430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:45.429430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:41:45.429430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:45.431070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 515/1038] 10.222.0.33 () {56 vars in 1093 bytes} [Sun Sep 11 00:41:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:45.434465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b27d8-c896-4ab6-bdc8-389f1451d780 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:45.517363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:45.552776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b27d8-c896-4ab6-bdc8-389f1451d780 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:45.591314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dab50-4d7a-4f3e-b744-d845cc9bb5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:45.591917 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dab50-4d7a-4f3e-b744-d845cc9bb5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:45.592191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dab50-4d7a-4f3e-b744-d845cc9bb5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:45.592459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dab50-4d7a-4f3e-b744-d845cc9bb5f1 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:45.593746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dab50-4d7a-4f3e-b744-d845cc9bb5f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:45.593746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dab50-4d7a-4f3e-b744-d845cc9bb5f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:45.594935 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dab50-4d7a-4f3e-b744-d845cc9bb5f1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:45.613504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 524/1039] 10.222.0.33 () {56 vars in 1133 bytes} [Sun Sep 11 00:41:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:45.619513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e177613-e9ca-4bf4-afa9-e8a5907efa89 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:45.700626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:45.725480 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e177613-e9ca-4bf4-afa9-e8a5907efa89 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:45.759609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760685b7-b289-4c2f-86b6-eefcf991d9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:45.760215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760685b7-b289-4c2f-86b6-eefcf991d9fd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:45.760486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760685b7-b289-4c2f-86b6-eefcf991d9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:45.760860 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760685b7-b289-4c2f-86b6-eefcf991d9fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:45.827658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760685b7-b289-4c2f-86b6-eefcf991d9fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:45.829013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760685b7-b289-4c2f-86b6-eefcf991d9fd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:45.906385 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:45.936015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 516/1040] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:41:45 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:41:45.937795 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dab50-4d7a-4f3e-b744-d845cc9bb5f1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:46.035862 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dab50-4d7a-4f3e-b744-d845cc9bb5f1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:46.062130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:46.071846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa72a56-f91e-46bb-9515-49e15f8526fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:46.072541 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa72a56-f91e-46bb-9515-49e15f8526fe None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:46.072735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa72a56-f91e-46bb-9515-49e15f8526fe None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:46.073100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa72a56-f91e-46bb-9515-49e15f8526fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:46.083371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa72a56-f91e-46bb-9515-49e15f8526fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:46.084719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa72a56-f91e-46bb-9515-49e15f8526fe None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-9fa72a56-f91e-46bb-9515-49e15f8526fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:46.099371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:46.100346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:46.106186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:46.106186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:46.106186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:46.106186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 525/1041] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:46.107796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760685b7-b289-4c2f-86b6-eefcf991d9fd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:46.207291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760685b7-b289-4c2f-86b6-eefcf991d9fd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:46.241424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112e4b4-1ae3-4691-99cd-5b166e2de554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:46.242022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112e4b4-1ae3-4691-99cd-5b166e2de554 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:46.242293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112e4b4-1ae3-4691-99cd-5b166e2de554 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:46.242553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112e4b4-1ae3-4691-99cd-5b166e2de554 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:46.243205 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112e4b4-1ae3-4691-99cd-5b166e2de554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:46.243500 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112e4b4-1ae3-4691-99cd-5b166e2de554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:46.244842 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112e4b4-1ae3-4691-99cd-5b166e2de554 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:46.260660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 517/1042] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:46.262451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa72a56-f91e-46bb-9515-49e15f8526fe None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:46.363411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa72a56-f91e-46bb-9515-49e15f8526fe None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:46.395543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cf4b5-02e2-4d53-9972-3388a6588472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:46.396154 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf4b5-02e2-4d53-9972-3388a6588472 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:46.396430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf4b5-02e2-4d53-9972-3388a6588472 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:46.396697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf4b5-02e2-4d53-9972-3388a6588472 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:46.403250 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cf4b5-02e2-4d53-9972-3388a6588472 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:46.404644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cf4b5-02e2-4d53-9972-3388a6588472 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b58cf4b5-02e2-4d53-9972-3388a6588472 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:46.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:46.416412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:46.425692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:46.425692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:46.425692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:46.425692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:46.425692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:46.425692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:46.425692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:46.425692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:46.425692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 526/1043] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:46.427847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112e4b4-1ae3-4691-99cd-5b166e2de554 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:46.466403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:46.531832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112e4b4-1ae3-4691-99cd-5b166e2de554 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:46.565518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f42d63-280c-4062-85c7-8e9ee545567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:46.566390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f42d63-280c-4062-85c7-8e9ee545567e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:46.566976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f42d63-280c-4062-85c7-8e9ee545567e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:46.567415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f42d63-280c-4062-85c7-8e9ee545567e None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:46.568515 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f42d63-280c-4062-85c7-8e9ee545567e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:46.569052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f42d63-280c-4062-85c7-8e9ee545567e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:46.570631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f42d63-280c-4062-85c7-8e9ee545567e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:46.587800 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 518/1044] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:46.589360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cf4b5-02e2-4d53-9972-3388a6588472 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:46.632826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:46.693497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cf4b5-02e2-4d53-9972-3388a6588472 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:46.727618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b8fbe-cd44-4965-b613-0a0a7b7148d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:46.728221 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b8fbe-cd44-4965-b613-0a0a7b7148d9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:46.728498 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b8fbe-cd44-4965-b613-0a0a7b7148d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:46.728769 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b8fbe-cd44-4965-b613-0a0a7b7148d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:46.729487 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b8fbe-cd44-4965-b613-0a0a7b7148d9 None admin] RBAC: Adding query filter params (role.id=9f2d3d0a9ad045e7a84121e39319f1fc, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=ab5f197fb09e422997434a1b2feb4567) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:46.729796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b8fbe-cd44-4965-b613-0a0a7b7148d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:46.731251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b8fbe-cd44-4965-b613-0a0a7b7148d9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:46.736790 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 527/1045] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:41:46 2022] GET /identity/v3/role_assignments?user.id=ab5f197fb09e422997434a1b2feb4567&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=9f2d3d0a9ad045e7a84121e39319f1fc => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:47.125745 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2938-abe3-4d13-8b7b-6859f3cc9ca9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:47.126267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2938-abe3-4d13-8b7b-6859f3cc9ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:47.126267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2938-abe3-4d13-8b7b-6859f3cc9ca9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:47.127854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 519/1046] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:47.132869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd3bde-37b8-4579-a516-f995a84bcf7b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:47.133250 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd3bde-37b8-4579-a516-f995a84bcf7b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:47.133445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd3bde-37b8-4579-a516-f995a84bcf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:47.152065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-38cd3bde-37b8-4579-a516-f995a84bcf7b None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:47.153242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-38cd3bde-37b8-4579-a516-f995a84bcf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:47.219966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 528/1047] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:47.487145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e2938-abe3-4d13-8b7b-6859f3cc9ca9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:47.583300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff9b90-3848-4dd4-b590-e002469c4265 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:47.583500 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:47.583586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff9b90-3848-4dd4-b590-e002469c4265 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:47.583845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff9b90-3848-4dd4-b590-e002469c4265 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:47.585190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 529/1048] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:41:47.591000 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db8f24-4a78-4648-acd1-dc0155eaa1d7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:47.591326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db8f24-4a78-4648-acd1-dc0155eaa1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:47.591540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db8f24-4a78-4648-acd1-dc0155eaa1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:47.592568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e2938-abe3-4d13-8b7b-6859f3cc9ca9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:47.609952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c5db8f24-4a78-4648-acd1-dc0155eaa1d7 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:47.611157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c5db8f24-4a78-4648-acd1-dc0155eaa1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:47.629556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906e564-6ae8-485d-a176-144a85ef82de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:47.630204 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e564-6ae8-485d-a176-144a85ef82de None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:47.630449 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e564-6ae8-485d-a176-144a85ef82de None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:47.630714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e564-6ae8-485d-a176-144a85ef82de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:47.639730 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:47.641220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906e564-6ae8-485d-a176-144a85ef82de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c906e564-6ae8-485d-a176-144a85ef82de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:47.646016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:47.647223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:47.648107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:47.648107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:47.648107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:47.648107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:47.648107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:47.648107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:47.648107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:47.648107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:47.648107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:47.648107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:47.648107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:47.648107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:47.648107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 520/1049] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:41:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:47.652839 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906e564-6ae8-485d-a176-144a85ef82de None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:47.688751 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 530/1050] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:47.750122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906e564-6ae8-485d-a176-144a85ef82de None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:47.787382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81467726-3387-42cc-b112-3e3be17eb46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:47.788041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81467726-3387-42cc-b112-3e3be17eb46f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:47.788314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81467726-3387-42cc-b112-3e3be17eb46f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:47.788581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81467726-3387-42cc-b112-3e3be17eb46f None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:47.789287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81467726-3387-42cc-b112-3e3be17eb46f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:47.789583 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81467726-3387-42cc-b112-3e3be17eb46f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:47.791023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81467726-3387-42cc-b112-3e3be17eb46f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:47.805255 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 521/1051] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:41:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:47.806410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db8f24-4a78-4648-acd1-dc0155eaa1d7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:47.905913 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db8f24-4a78-4648-acd1-dc0155eaa1d7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:47.941137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a671c66-8ed2-423f-88c5-589446dce9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:47.941691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a671c66-8ed2-423f-88c5-589446dce9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:47.941970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a671c66-8ed2-423f-88c5-589446dce9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:47.942503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a671c66-8ed2-423f-88c5-589446dce9b9 None admin] PATH_INFO: `/v3/users/647525157f9c452e846913eb8ead14d6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:47.956368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a671c66-8ed2-423f-88c5-589446dce9b9 None admin] RBAC: Authorizing `identity:get_user(user_id=647525157f9c452e846913eb8ead14d6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:47.957805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a671c66-8ed2-423f-88c5-589446dce9b9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:47.959629 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 531/1052] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:41:47 2022] GET /identity/v3/users/647525157f9c452e846913eb8ead14d6 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:47.965093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81467726-3387-42cc-b112-3e3be17eb46f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:47.970166 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a671c66-8ed2-423f-88c5-589446dce9b9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:47.989062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:47.996615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:48.075839 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81467726-3387-42cc-b112-3e3be17eb46f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:48.078937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a671c66-8ed2-423f-88c5-589446dce9b9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:48.110835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d43c6-6198-43d8-ba66-ac096da9d10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:48.111503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d43c6-6198-43d8-ba66-ac096da9d10e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:48.111785 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d43c6-6198-43d8-ba66-ac096da9d10e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:48.112057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d43c6-6198-43d8-ba66-ac096da9d10e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:48.114308 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7128e-42fb-4825-852d-3ec3f5b7f771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:48.114955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7128e-42fb-4825-852d-3ec3f5b7f771 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:48.115230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7128e-42fb-4825-852d-3ec3f5b7f771 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:48.116120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7128e-42fb-4825-852d-3ec3f5b7f771 None admin] PATH_INFO: `/v3/services/image` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:48.116120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7128e-42fb-4825-852d-3ec3f5b7f771 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:48.117374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7128e-42fb-4825-852d-3ec3f5b7f771 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d7f7128e-42fb-4825-852d-3ec3f5b7f771 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:48.126115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:48.127707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:48.128565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 532/1053] 10.222.0.33 () {56 vars in 1105 bytes} [Sun Sep 11 00:41:47 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:48.133691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7128e-42fb-4825-852d-3ec3f5b7f771 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:48.184251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d43c6-6198-43d8-ba66-ac096da9d10e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:48.185711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d43c6-6198-43d8-ba66-ac096da9d10e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:48.204758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:48.228431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:48.244836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7128e-42fb-4825-852d-3ec3f5b7f771 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:48.280135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23980d-ebd6-4b00-af13-8b620e127bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:48.280740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23980d-ebd6-4b00-af13-8b620e127bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:48.281017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23980d-ebd6-4b00-af13-8b620e127bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:48.281288 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23980d-ebd6-4b00-af13-8b620e127bd9 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:48.281911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23980d-ebd6-4b00-af13-8b620e127bd9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:48.282209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23980d-ebd6-4b00-af13-8b620e127bd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:48.284305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23980d-ebd6-4b00-af13-8b620e127bd9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:48.294762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 533/1054] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:48.297598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23980d-ebd6-4b00-af13-8b620e127bd9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:48.303430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 522/1055] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:41:47 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 00:41:48.304408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d43c6-6198-43d8-ba66-ac096da9d10e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:48.404091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d43c6-6198-43d8-ba66-ac096da9d10e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:48.407494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23980d-ebd6-4b00-af13-8b620e127bd9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:48.422947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:48.441903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59658a-70cd-4a75-b860-b659f963cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:48.443059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59658a-70cd-4a75-b860-b659f963cd4c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:48.443511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59658a-70cd-4a75-b860-b659f963cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:48.443930 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59658a-70cd-4a75-b860-b659f963cd4c None admin] PATH_INFO: `/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:48.445186 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59658a-70cd-4a75-b860-b659f963cd4c None admin] RBAC: Authorizing `identity:get_project(project_id=5d11be18d05c48e6bb8e75e5ec21e418)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:48.446793 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59658a-70cd-4a75-b860-b659f963cd4c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:48.448944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 523/1056] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:41:48 2022] GET /identity/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:48.454536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59658a-70cd-4a75-b860-b659f963cd4c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:48.456398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2d8c2-9b5e-4546-9100-b6983af1cb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:48.456957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2d8c2-9b5e-4546-9100-b6983af1cb32 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:48.457236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2d8c2-9b5e-4546-9100-b6983af1cb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:48.457506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2d8c2-9b5e-4546-9100-b6983af1cb32 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:48.458335 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2d8c2-9b5e-4546-9100-b6983af1cb32 None admin] RBAC: Adding query filter params (type=image) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:48.459518 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2d8c2-9b5e-4546-9100-b6983af1cb32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:48.460886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2d8c2-9b5e-4546-9100-b6983af1cb32 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:48.471478 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 534/1057] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:48.472924 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2d8c2-9b5e-4546-9100-b6983af1cb32 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:48.489529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:48.561232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59658a-70cd-4a75-b860-b659f963cd4c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:48.581054 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2d8c2-9b5e-4546-9100-b6983af1cb32 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:48.598899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0a697-5b4f-47cf-947f-a3fee3a95b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:48.599715 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0a697-5b4f-47cf-947f-a3fee3a95b73 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:48.599836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0a697-5b4f-47cf-947f-a3fee3a95b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:48.600036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0a697-5b4f-47cf-947f-a3fee3a95b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:48.600759 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0a697-5b4f-47cf-947f-a3fee3a95b73 None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=5d11be18d05c48e6bb8e75e5ec21e418, user.id=647525157f9c452e846913eb8ead14d6) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:48.601061 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0a697-5b4f-47cf-947f-a3fee3a95b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:48.602486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0a697-5b4f-47cf-947f-a3fee3a95b73 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:48.608637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 524/1058] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:41:48 2022] GET /identity/v3/role_assignments?user.id=647525157f9c452e846913eb8ead14d6&scope.project.id=5d11be18d05c48e6bb8e75e5ec21e418&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:48.629038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a93034-f658-442a-ac0f-fbcb540c0412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:48.629665 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a93034-f658-442a-ac0f-fbcb540c0412 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:48.629942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a93034-f658-442a-ac0f-fbcb540c0412 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:48.630210 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a93034-f658-442a-ac0f-fbcb540c0412 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:48.630919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a93034-f658-442a-ac0f-fbcb540c0412 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:48.632321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a93034-f658-442a-ac0f-fbcb540c0412 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:48.654189 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 535/1059] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:41:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:41:48.893271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482defed-cc18-4e18-b028-5327bd9fcab5 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:48.893549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482defed-cc18-4e18-b028-5327bd9fcab5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:48.893825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482defed-cc18-4e18-b028-5327bd9fcab5 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:48.895365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 525/1060] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:48.900476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd84ea7-3ee1-4aee-afd9-24aceef74c77 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:48.901007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd84ea7-3ee1-4aee-afd9-24aceef74c77 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:48.901561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd84ea7-3ee1-4aee-afd9-24aceef74c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:48.920631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ebd84ea7-3ee1-4aee-afd9-24aceef74c77 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:48.922088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ebd84ea7-3ee1-4aee-afd9-24aceef74c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:48.989964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:49.003198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 536/1061] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:49.265189 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482defed-cc18-4e18-b028-5327bd9fcab5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:49.317963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:49.369654 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482defed-cc18-4e18-b028-5327bd9fcab5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:49.403726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0612e58-e415-4662-b437-ba51ff58131f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:49.404360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0612e58-e415-4662-b437-ba51ff58131f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:49.404630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0612e58-e415-4662-b437-ba51ff58131f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:49.404893 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0612e58-e415-4662-b437-ba51ff58131f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:49.415318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0612e58-e415-4662-b437-ba51ff58131f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c0612e58-e415-4662-b437-ba51ff58131f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:49.420071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:49.420998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:49.421844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:49.421844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:49.421844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:49.421844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:49.421844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:49.421844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:49.421844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:49.421844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:49.421844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:49.421844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:49.421844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:41:49.421844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:49.426830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 526/1062] 10.222.0.33 () {56 vars in 1120 bytes} [Sun Sep 11 00:41:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:49.429926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd84ea7-3ee1-4aee-afd9-24aceef74c77 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:49.535361 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd84ea7-3ee1-4aee-afd9-24aceef74c77 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:49.569326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0fff4-c7c6-4529-8917-ecffd1b13d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:49.569941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0fff4-c7c6-4529-8917-ecffd1b13d27 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:49.570217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0fff4-c7c6-4529-8917-ecffd1b13d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:49.570487 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0fff4-c7c6-4529-8917-ecffd1b13d27 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:49.571205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0fff4-c7c6-4529-8917-ecffd1b13d27 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:49.571510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0fff4-c7c6-4529-8917-ecffd1b13d27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:49.572907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0fff4-c7c6-4529-8917-ecffd1b13d27 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:49.586810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 537/1063] 10.222.0.33 () {56 vars in 1115 bytes} [Sun Sep 11 00:41:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:49.588132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0612e58-e415-4662-b437-ba51ff58131f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:49.687002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0612e58-e415-4662-b437-ba51ff58131f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:49.698111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:49.722663 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bf634-10d8-4d49-878e-0e1e6aff84d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:49.723312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bf634-10d8-4d49-878e-0e1e6aff84d1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:49.723591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bf634-10d8-4d49-878e-0e1e6aff84d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:49.723860 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bf634-10d8-4d49-878e-0e1e6aff84d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:49.733819 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bf634-10d8-4d49-878e-0e1e6aff84d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:49.735281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bf634-10d8-4d49-878e-0e1e6aff84d1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4f4bf634-10d8-4d49-878e-0e1e6aff84d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:49.749674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:49.750675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:49.756889 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:49.756889 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:49.756889 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:49.756889 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 527/1064] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:49.757127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0fff4-c7c6-4529-8917-ecffd1b13d27 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:49.814884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:49.864093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0fff4-c7c6-4529-8917-ecffd1b13d27 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:49.903684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1c6c4-182a-48b7-8057-cc4a35621a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:49.904641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1c6c4-182a-48b7-8057-cc4a35621a15 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:49.905016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1c6c4-182a-48b7-8057-cc4a35621a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:49.905377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1c6c4-182a-48b7-8057-cc4a35621a15 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:49.906289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1c6c4-182a-48b7-8057-cc4a35621a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:49.906760 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1c6c4-182a-48b7-8057-cc4a35621a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:49.908416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1c6c4-182a-48b7-8057-cc4a35621a15 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:49.925527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 538/1065] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:49.926333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bf634-10d8-4d49-878e-0e1e6aff84d1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:50.026024 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bf634-10d8-4d49-878e-0e1e6aff84d1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:50.059435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834902ed-b608-4c71-bd8e-08bd1467fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:50.060050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834902ed-b608-4c71-bd8e-08bd1467fca2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:50.060320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834902ed-b608-4c71-bd8e-08bd1467fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:50.060661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834902ed-b608-4c71-bd8e-08bd1467fca2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:50.068833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834902ed-b608-4c71-bd8e-08bd1467fca2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:50.070195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834902ed-b608-4c71-bd8e-08bd1467fca2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-834902ed-b608-4c71-bd8e-08bd1467fca2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:50.081064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:50.082005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:50.088006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:50.088006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:50.088006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:50.088006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:50.088006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:50.088006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:50.088006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:50.088006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:50.088006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:41:50.088006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:50.088006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 528/1066] 10.222.0.33 () {56 vars in 1093 bytes} [Sun Sep 11 00:41:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:50.088609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1c6c4-182a-48b7-8057-cc4a35621a15 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:50.186074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1c6c4-182a-48b7-8057-cc4a35621a15 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:50.205500 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:50.223783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3589b-2fe5-4639-b709-c47ec7d4f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:50.224381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3589b-2fe5-4639-b709-c47ec7d4f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:50.224653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3589b-2fe5-4639-b709-c47ec7d4f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:50.224917 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3589b-2fe5-4639-b709-c47ec7d4f7b6 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:50.225635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3589b-2fe5-4639-b709-c47ec7d4f7b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:50.225932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3589b-2fe5-4639-b709-c47ec7d4f7b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:50.227373 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3589b-2fe5-4639-b709-c47ec7d4f7b6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:50.248611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 539/1067] 10.222.0.33 () {56 vars in 1133 bytes} [Sun Sep 11 00:41:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:50.250048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834902ed-b608-4c71-bd8e-08bd1467fca2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:50.275681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:50.353676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834902ed-b608-4c71-bd8e-08bd1467fca2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:50.386657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b908c3e-f1b8-4d0f-88f2-b24c53a407ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:50.387310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b908c3e-f1b8-4d0f-88f2-b24c53a407ea None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:50.387584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b908c3e-f1b8-4d0f-88f2-b24c53a407ea None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:50.387862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b908c3e-f1b8-4d0f-88f2-b24c53a407ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:50.398229 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b908c3e-f1b8-4d0f-88f2-b24c53a407ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:50.399770 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b908c3e-f1b8-4d0f-88f2-b24c53a407ea None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4b908c3e-f1b8-4d0f-88f2-b24c53a407ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:50.414373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:50.420083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:50.421073 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:50.421073 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:50.421073 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:50.421073 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 529/1068] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:50.425363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3589b-2fe5-4639-b709-c47ec7d4f7b6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:50.526936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3589b-2fe5-4639-b709-c47ec7d4f7b6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:50.561363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488484a-7978-4225-8f76-b3e994086aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:50.562375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488484a-7978-4225-8f76-b3e994086aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:50.562981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488484a-7978-4225-8f76-b3e994086aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:50.563478 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488484a-7978-4225-8f76-b3e994086aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:50.564907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488484a-7978-4225-8f76-b3e994086aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:50.565399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488484a-7978-4225-8f76-b3e994086aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:50.567200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488484a-7978-4225-8f76-b3e994086aa9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:50.583026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 540/1069] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:50.584190 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b908c3e-f1b8-4d0f-88f2-b24c53a407ea None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:50.662359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:50.692042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b908c3e-f1b8-4d0f-88f2-b24c53a407ea None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:50.725692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5013b8-db7c-448b-8fcc-d72741abfcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:50.726310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5013b8-db7c-448b-8fcc-d72741abfcbe None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:50.726584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5013b8-db7c-448b-8fcc-d72741abfcbe None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:50.726891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5013b8-db7c-448b-8fcc-d72741abfcbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:50.733354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5013b8-db7c-448b-8fcc-d72741abfcbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:50.734810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5013b8-db7c-448b-8fcc-d72741abfcbe None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2b5013b8-db7c-448b-8fcc-d72741abfcbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:50.745847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:50.751912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:50.752935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:50.752935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:50.752935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:50.752935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:50.752935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:50.752935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:50.752935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:50.752935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:50.752935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 530/1070] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:50.753445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488484a-7978-4225-8f76-b3e994086aa9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:50.777231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76212f-7e7b-43c9-8d72-96f0700d2817 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:50.777578 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76212f-7e7b-43c9-8d72-96f0700d2817 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:50.777774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76212f-7e7b-43c9-8d72-96f0700d2817 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:50.779195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 531/1071] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:50.785454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15478b49-7c6a-4124-8009-ded819958d20 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:50.785794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15478b49-7c6a-4124-8009-ded819958d20 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:50.785997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15478b49-7c6a-4124-8009-ded819958d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:50.798437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:50.805011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-15478b49-7c6a-4124-8009-ded819958d20 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:50.806547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-15478b49-7c6a-4124-8009-ded819958d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:50.869131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488484a-7978-4225-8f76-b3e994086aa9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:50.881107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 532/1072] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:50.884647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce559de5-24e5-4e97-b86c-c352bb456acb None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:50.885365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce559de5-24e5-4e97-b86c-c352bb456acb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:50.885854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce559de5-24e5-4e97-b86c-c352bb456acb None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:50.887772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 533/1073] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:50.893576 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf56eb-0177-40bd-a970-707d78b3b5f9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:50.894503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf56eb-0177-40bd-a970-707d78b3b5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:50.895224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf56eb-0177-40bd-a970-707d78b3b5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:50.904460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662513a-5b84-4505-ab27-e737492b5561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:50.905083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662513a-5b84-4505-ab27-e737492b5561 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:50.905363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662513a-5b84-4505-ab27-e737492b5561 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:50.905631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662513a-5b84-4505-ab27-e737492b5561 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:50.906312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662513a-5b84-4505-ab27-e737492b5561 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:50.906612 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662513a-5b84-4505-ab27-e737492b5561 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:50.908131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662513a-5b84-4505-ab27-e737492b5561 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:50.918124 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-90cf56eb-0177-40bd-a970-707d78b3b5f9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:50.919272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-90cf56eb-0177-40bd-a970-707d78b3b5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:50.920637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 541/1074] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:50.926770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662513a-5b84-4505-ab27-e737492b5561 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:50.981754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:50.992925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 534/1075] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:51.028791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:51.035839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662513a-5b84-4505-ab27-e737492b5561 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:51.070644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe10b6-c973-428d-b2e6-631ecac45bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:51.071320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe10b6-c973-428d-b2e6-631ecac45bdd None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:51.071595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe10b6-c973-428d-b2e6-631ecac45bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:51.071863 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe10b6-c973-428d-b2e6-631ecac45bdd None admin] PATH_INFO: `/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/ab5f197fb09e422997434a1b2feb4567/roles/9f2d3d0a9ad045e7a84121e39319f1fc` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:51.073988 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe10b6-c973-428d-b2e6-631ecac45bdd None admin] RBAC: Authorizing `identity:create_grant(project_id=ce5275375bc1421cb3fe6e27d5f685fe, user_id=ab5f197fb09e422997434a1b2feb4567, role_id=9f2d3d0a9ad045e7a84121e39319f1fc)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:51.075433 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe10b6-c973-428d-b2e6-631ecac45bdd None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:51.098762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 542/1076] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:41:50 2022] PUT /identity/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/ab5f197fb09e422997434a1b2feb4567/roles/9f2d3d0a9ad045e7a84121e39319f1fc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:41:51.149830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf56eb-0177-40bd-a970-707d78b3b5f9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:51.260021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf56eb-0177-40bd-a970-707d78b3b5f9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:51.264235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe10b6-c973-428d-b2e6-631ecac45bdd None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:51.299167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba0bc2-4357-4954-a7b6-df8a7c067568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:51.301171 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba0bc2-4357-4954-a7b6-df8a7c067568 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:51.301776 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba0bc2-4357-4954-a7b6-df8a7c067568 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:51.302288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba0bc2-4357-4954-a7b6-df8a7c067568 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:51.314497 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba0bc2-4357-4954-a7b6-df8a7c067568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6bba0bc2-4357-4954-a7b6-df8a7c067568 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:51.319646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:51.320662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:51.321568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:51.321568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:51.321568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:51.321568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:51.321568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:51.321568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:51.321568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:51.321568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:51.321568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:51.321568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:51.321568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:51.321568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:51.321568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 535/1077] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:41:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:51.326563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba0bc2-4357-4954-a7b6-df8a7c067568 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:51.380981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe10b6-c973-428d-b2e6-631ecac45bdd None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:51.382806 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:51.418803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b601d5-07c9-4486-8e7e-cb8f3cb21f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:51.419553 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b601d5-07c9-4486-8e7e-cb8f3cb21f98 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:51.419927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b601d5-07c9-4486-8e7e-cb8f3cb21f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:51.420291 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b601d5-07c9-4486-8e7e-cb8f3cb21f98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:51.435939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba0bc2-4357-4954-a7b6-df8a7c067568 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:51.447037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:51.476177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd84cbe-69ce-48ec-b617-c190465a1ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:51.476816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd84cbe-69ce-48ec-b617-c190465a1ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:51.477095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd84cbe-69ce-48ec-b617-c190465a1ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:51.477365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd84cbe-69ce-48ec-b617-c190465a1ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:51.478022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd84cbe-69ce-48ec-b617-c190465a1ce8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:51.478321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd84cbe-69ce-48ec-b617-c190465a1ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:51.479729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd84cbe-69ce-48ec-b617-c190465a1ce8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:51.489402 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 536/1078] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:41:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:51.494874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd84cbe-69ce-48ec-b617-c190465a1ce8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:51.495837 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b601d5-07c9-4486-8e7e-cb8f3cb21f98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:51.497483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b601d5-07c9-4486-8e7e-cb8f3cb21f98 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:51.601411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd84cbe-69ce-48ec-b617-c190465a1ce8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:51.605569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 543/1079] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:41:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:41:51.611592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b601d5-07c9-4486-8e7e-cb8f3cb21f98 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:51.620966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:51.641052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3286f-fb10-494c-a964-2708dab49513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:51.642206 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3286f-fb10-494c-a964-2708dab49513 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:51.642481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3286f-fb10-494c-a964-2708dab49513 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:51.642765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3286f-fb10-494c-a964-2708dab49513 None admin] PATH_INFO: `/v3/users/647525157f9c452e846913eb8ead14d6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:51.643893 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3286f-fb10-494c-a964-2708dab49513 None admin] RBAC: Authorizing `identity:get_user(user_id=647525157f9c452e846913eb8ead14d6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:51.645304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3286f-fb10-494c-a964-2708dab49513 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:51.646883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 537/1080] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:41:51 2022] GET /identity/v3/users/647525157f9c452e846913eb8ead14d6 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:51.652407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3286f-fb10-494c-a964-2708dab49513 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:51.677669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:51.725459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b601d5-07c9-4486-8e7e-cb8f3cb21f98 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:51.757107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3286f-fb10-494c-a964-2708dab49513 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:51.761457 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37138b-ca6c-4320-8570-78939caf70e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:51.762087 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37138b-ca6c-4320-8570-78939caf70e6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:51.762364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37138b-ca6c-4320-8570-78939caf70e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:51.762631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37138b-ca6c-4320-8570-78939caf70e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:51.773077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37138b-ca6c-4320-8570-78939caf70e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:51.774517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37138b-ca6c-4320-8570-78939caf70e6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-cb37138b-ca6c-4320-8570-78939caf70e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:51.790783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:51.791803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:51.792719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:51.792719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:51.792719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:51.792719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 544/1081] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:51.797611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37138b-ca6c-4320-8570-78939caf70e6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:51.798768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c414531-d734-4685-90e3-24b8587b9031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:51.799410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c414531-d734-4685-90e3-24b8587b9031 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:51.799688 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c414531-d734-4685-90e3-24b8587b9031 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:51.799961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c414531-d734-4685-90e3-24b8587b9031 None admin] PATH_INFO: `/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:51.801866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c414531-d734-4685-90e3-24b8587b9031 None admin] RBAC: Authorizing `identity:get_project(project_id=5d11be18d05c48e6bb8e75e5ec21e418)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:51.802521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c414531-d734-4685-90e3-24b8587b9031 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:51.809318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 538/1082] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:41:51 2022] GET /identity/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:51.809828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c414531-d734-4685-90e3-24b8587b9031 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:51.865403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:51.901810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37138b-ca6c-4320-8570-78939caf70e6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:51.911292 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:51.917765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c414531-d734-4685-90e3-24b8587b9031 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:51.937602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64876838-998e-4ff0-ad96-83569609e083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:51.938211 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64876838-998e-4ff0-ad96-83569609e083 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:51.939074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64876838-998e-4ff0-ad96-83569609e083 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:51.939358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64876838-998e-4ff0-ad96-83569609e083 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:51.939967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64876838-998e-4ff0-ad96-83569609e083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:51.940270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64876838-998e-4ff0-ad96-83569609e083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:51.941882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64876838-998e-4ff0-ad96-83569609e083 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:51.953400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c28b0-d1d7-4682-9a98-bbf3e4ae7b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:51.954235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 545/1083] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:51.954360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c28b0-d1d7-4682-9a98-bbf3e4ae7b17 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:51.954446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c28b0-d1d7-4682-9a98-bbf3e4ae7b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:51.954752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c28b0-d1d7-4682-9a98-bbf3e4ae7b17 None admin] PATH_INFO: `/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418/users/647525157f9c452e846913eb8ead14d6/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:51.956850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c28b0-d1d7-4682-9a98-bbf3e4ae7b17 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d11be18d05c48e6bb8e75e5ec21e418, user_id=647525157f9c452e846913eb8ead14d6, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:51.958361 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c28b0-d1d7-4682-9a98-bbf3e4ae7b17 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:51.982832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 539/1084] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:41:51 2022] PUT /identity/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418/users/647525157f9c452e846913eb8ead14d6/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:41:53.245342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e32c-a1a0-42e8-900f-5056b39501a6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:53.245903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e32c-a1a0-42e8-900f-5056b39501a6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:53.246008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e32c-a1a0-42e8-900f-5056b39501a6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:53.247325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 546/1085] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:53.252626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1034-1d9d-46d7-a54d-963fcb78d951 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:53.253021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1034-1d9d-46d7-a54d-963fcb78d951 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:53.253288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1034-1d9d-46d7-a54d-963fcb78d951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:53.271658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b93f1034-1d9d-46d7-a54d-963fcb78d951 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:53.272847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b93f1034-1d9d-46d7-a54d-963fcb78d951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:53.337587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 540/1086] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:53.602264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195e32c-a1a0-42e8-900f-5056b39501a6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:53.700085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195e32c-a1a0-42e8-900f-5056b39501a6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:53.733226 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec6bae-e213-443a-97fb-83af091715c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:53.733853 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec6bae-e213-443a-97fb-83af091715c9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:53.734126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec6bae-e213-443a-97fb-83af091715c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:53.734394 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec6bae-e213-443a-97fb-83af091715c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:53.744392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec6bae-e213-443a-97fb-83af091715c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-22ec6bae-e213-443a-97fb-83af091715c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:53.749157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:53.750270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:53.751273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:53.751273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:53.751273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:53.751273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:53.751273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:53.751273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:53.751273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:53.751273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:53.751273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:53.751273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:53.751273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:41:53.751273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:53.751273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 547/1087] 10.222.0.33 () {56 vars in 1120 bytes} [Sun Sep 11 00:41:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:53.756102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f1034-1d9d-46d7-a54d-963fcb78d951 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:53.798827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:53.855992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f1034-1d9d-46d7-a54d-963fcb78d951 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:53.889362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3cc40-3fd3-450a-b25a-1241da606a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:53.889962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3cc40-3fd3-450a-b25a-1241da606a83 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:53.890236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3cc40-3fd3-450a-b25a-1241da606a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:53.890502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3cc40-3fd3-450a-b25a-1241da606a83 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:53.891214 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3cc40-3fd3-450a-b25a-1241da606a83 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:53.891514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3cc40-3fd3-450a-b25a-1241da606a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:53.892892 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3cc40-3fd3-450a-b25a-1241da606a83 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:53.900589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 541/1088] 10.222.0.33 () {56 vars in 1115 bytes} [Sun Sep 11 00:41:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:53.906286 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec6bae-e213-443a-97fb-83af091715c9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:53.942223 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:54.011266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec6bae-e213-443a-97fb-83af091715c9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:54.046494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6d6bc-0978-4a3f-bd78-6cbc0198a796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:54.047161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6d6bc-0978-4a3f-bd78-6cbc0198a796 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:54.047982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6d6bc-0978-4a3f-bd78-6cbc0198a796 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:54.048255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6d6bc-0978-4a3f-bd78-6cbc0198a796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:54.059602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6d6bc-0978-4a3f-bd78-6cbc0198a796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:54.061051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6d6bc-0978-4a3f-bd78-6cbc0198a796 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-6ea6d6bc-0978-4a3f-bd78-6cbc0198a796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:54.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:54.081884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:54.082872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:54.082872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:54.082872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:54.082872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 548/1089] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:54.083101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3cc40-3fd3-450a-b25a-1241da606a83 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:54.150241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391771d-eddf-49b3-b2bd-25ad4a8b6b5d None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:54.150445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391771d-eddf-49b3-b2bd-25ad4a8b6b5d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:54.150697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391771d-eddf-49b3-b2bd-25ad4a8b6b5d None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:54.152099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 549/1090] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:41:54.157504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66104fd-1d6d-4545-9da9-9935bfeb6255 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:54.157778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66104fd-1d6d-4545-9da9-9935bfeb6255 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:54.158046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66104fd-1d6d-4545-9da9-9935bfeb6255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:54.176261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f66104fd-1d6d-4545-9da9-9935bfeb6255 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:54.177437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f66104fd-1d6d-4545-9da9-9935bfeb6255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:54.181602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3cc40-3fd3-450a-b25a-1241da606a83 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:54.183909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:54.215675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584d54d-842e-411e-a89b-7f7552dec488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:54.216288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d54d-842e-411e-a89b-7f7552dec488 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:54.216563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d54d-842e-411e-a89b-7f7552dec488 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:54.216827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d54d-842e-411e-a89b-7f7552dec488 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:54.217462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584d54d-842e-411e-a89b-7f7552dec488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:54.217763 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584d54d-842e-411e-a89b-7f7552dec488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:54.219868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584d54d-842e-411e-a89b-7f7552dec488 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:54.231803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 542/1091] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:54.237755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584d54d-842e-411e-a89b-7f7552dec488 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:54.251384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 550/1092] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:41:54.333234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584d54d-842e-411e-a89b-7f7552dec488 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:54.366336 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d2e86-af10-4d2c-a8c0-7580bc355ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:54.366986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d2e86-af10-4d2c-a8c0-7580bc355ded None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:54.367262 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d2e86-af10-4d2c-a8c0-7580bc355ded None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:54.367528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d2e86-af10-4d2c-a8c0-7580bc355ded None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:54.374326 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d2e86-af10-4d2c-a8c0-7580bc355ded None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:54.376347 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d2e86-af10-4d2c-a8c0-7580bc355ded None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b36d2e86-af10-4d2c-a8c0-7580bc355ded None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:41:54.387592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:54.388718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:54.389876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:54.389876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:54.389876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:41:54.389876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:41:54.389876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:41:54.389876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:41:54.389876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:41:54.389876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:41:54.389876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:41:54.389876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:54.390904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 543/1093] 10.222.0.33 () {56 vars in 1093 bytes} [Sun Sep 11 00:41:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:54.394381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66104fd-1d6d-4545-9da9-9935bfeb6255 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:54.406272 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:54.492648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66104fd-1d6d-4545-9da9-9935bfeb6255 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:54.521719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d2e86-af10-4d2c-a8c0-7580bc355ded None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:54.525670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0bb7b-0351-4ed6-b45f-8e019cd77475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:54.526270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0bb7b-0351-4ed6-b45f-8e019cd77475 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:54.526544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0bb7b-0351-4ed6-b45f-8e019cd77475 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:54.526842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0bb7b-0351-4ed6-b45f-8e019cd77475 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:54.527564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0bb7b-0351-4ed6-b45f-8e019cd77475 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:54.527868 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0bb7b-0351-4ed6-b45f-8e019cd77475 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:54.529278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0bb7b-0351-4ed6-b45f-8e019cd77475 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:54.545887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 551/1094] 10.222.0.33 () {56 vars in 1133 bytes} [Sun Sep 11 00:41:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:54.549730 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:54.552300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0bb7b-0351-4ed6-b45f-8e019cd77475 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:54.620521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:54.629361 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d2e86-af10-4d2c-a8c0-7580bc355ded None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:54.652977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0bb7b-0351-4ed6-b45f-8e019cd77475 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:54.661666 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b718c-4094-4473-b5fa-e3325cf3508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:54.662234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b718c-4094-4473-b5fa-e3325cf3508e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:54.662509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b718c-4094-4473-b5fa-e3325cf3508e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:54.662816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b718c-4094-4473-b5fa-e3325cf3508e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:54.674289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b718c-4094-4473-b5fa-e3325cf3508e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1c0b718c-4094-4473-b5fa-e3325cf3508e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:41:54.679102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:54.680176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:54.681027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:54.681027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:54.681027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:54.681027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:54.681027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:41:54.681027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:41:54.681027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:41:54.681027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:41:54.681027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:41:54.681027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:41:54.681027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:41:54.681027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:41:54.681027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 544/1095] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:41:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:54.686179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b718c-4094-4473-b5fa-e3325cf3508e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:54.688763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132366e-dd00-4521-b7eb-bb0442099548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:54.689362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132366e-dd00-4521-b7eb-bb0442099548 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:54.689638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132366e-dd00-4521-b7eb-bb0442099548 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:54.689914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132366e-dd00-4521-b7eb-bb0442099548 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:54.755947 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132366e-dd00-4521-b7eb-bb0442099548 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:54.757384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132366e-dd00-4521-b7eb-bb0442099548 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:54.767155 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:54.783806 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b718c-4094-4473-b5fa-e3325cf3508e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:54.817011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8959ad9-ec7b-4f90-a6d7-f1623c8db34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:54.817596 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8959ad9-ec7b-4f90-a6d7-f1623c8db34e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:54.817865 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8959ad9-ec7b-4f90-a6d7-f1623c8db34e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:54.818126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8959ad9-ec7b-4f90-a6d7-f1623c8db34e None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:54.818860 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8959ad9-ec7b-4f90-a6d7-f1623c8db34e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:54.819158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8959ad9-ec7b-4f90-a6d7-f1623c8db34e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:54.820060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:54.820500 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8959ad9-ec7b-4f90-a6d7-f1623c8db34e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:54.829065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 545/1096] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:41:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:54.834978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8959ad9-ec7b-4f90-a6d7-f1623c8db34e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:54.853637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 552/1097] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:41:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 00:41:54.859364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132366e-dd00-4521-b7eb-bb0442099548 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:54.936809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8959ad9-ec7b-4f90-a6d7-f1623c8db34e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:54.963539 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132366e-dd00-4521-b7eb-bb0442099548 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:54.971972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef98d7-e9b5-43f0-a265-71aff3664bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:54.972603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef98d7-e9b5-43f0-a265-71aff3664bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:54.972874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef98d7-e9b5-43f0-a265-71aff3664bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:54.973183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef98d7-e9b5-43f0-a265-71aff3664bc8 None admin] PATH_INFO: `/v3/users/647525157f9c452e846913eb8ead14d6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:54.974318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef98d7-e9b5-43f0-a265-71aff3664bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=647525157f9c452e846913eb8ead14d6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:54.975765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef98d7-e9b5-43f0-a265-71aff3664bc8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:54.977482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 546/1098] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:41:54 2022] GET /identity/v3/users/647525157f9c452e846913eb8ead14d6 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:54.983209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef98d7-e9b5-43f0-a265-71aff3664bc8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:54.997670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5833406-8bf9-434d-afa5-9c2e11a3031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:54.998288 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5833406-8bf9-434d-afa5-9c2e11a3031c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:54.998559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5833406-8bf9-434d-afa5-9c2e11a3031c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:54.998852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5833406-8bf9-434d-afa5-9c2e11a3031c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:54.999356 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:55.008891 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5833406-8bf9-434d-afa5-9c2e11a3031c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:55.010312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5833406-8bf9-434d-afa5-9c2e11a3031c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-f5833406-8bf9-434d-afa5-9c2e11a3031c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:41:55.024489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:55.025458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:41:55.026946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:41:55.026946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:41:55.026946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:55.026946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 553/1099] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:41:55.031122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5833406-8bf9-434d-afa5-9c2e11a3031c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:55.052524 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:55.083602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef98d7-e9b5-43f0-a265-71aff3664bc8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:55.117504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65f787-34a4-4755-8714-aa66f4e098c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:55.118104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65f787-34a4-4755-8714-aa66f4e098c2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:55.118375 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65f787-34a4-4755-8714-aa66f4e098c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:55.118637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65f787-34a4-4755-8714-aa66f4e098c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:55.129834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5833406-8bf9-434d-afa5-9c2e11a3031c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:55.161973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886aed1-fea6-446a-8adb-768f881f5380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:55.162572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886aed1-fea6-446a-8adb-768f881f5380 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:55.162874 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886aed1-fea6-446a-8adb-768f881f5380 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:55.163144 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886aed1-fea6-446a-8adb-768f881f5380 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:55.163771 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886aed1-fea6-446a-8adb-768f881f5380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:55.164068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886aed1-fea6-446a-8adb-768f881f5380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:55.165425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886aed1-fea6-446a-8adb-768f881f5380 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:55.177202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 554/1100] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:55.182837 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886aed1-fea6-446a-8adb-768f881f5380 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:55.183925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65f787-34a4-4755-8714-aa66f4e098c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:55.185360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65f787-34a4-4755-8714-aa66f4e098c2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:55.200267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:55.266770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:55.286149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886aed1-fea6-446a-8adb-768f881f5380 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:55.290163 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 547/1101] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:41:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:41:55.296062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65f787-34a4-4755-8714-aa66f4e098c2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:55.319864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0e3f0-631f-476d-9aee-eaa9eea25335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:55.320486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0e3f0-631f-476d-9aee-eaa9eea25335 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:55.320760 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0e3f0-631f-476d-9aee-eaa9eea25335 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:55.321026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0e3f0-631f-476d-9aee-eaa9eea25335 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:55.327525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0e3f0-631f-476d-9aee-eaa9eea25335 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:55.329464 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0e3f0-631f-476d-9aee-eaa9eea25335 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b5f0e3f0-631f-476d-9aee-eaa9eea25335 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:41:55.340336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:41:55.341307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:41:55.342588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:41:55.342588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:41:55.342588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:41:55.342588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:41:55.342588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:41:55.342588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:41:55.342588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:41:55.342588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:41:55.342588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 555/1102] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:41:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:41:55.347681 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0e3f0-631f-476d-9aee-eaa9eea25335 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:55.392178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65f787-34a4-4755-8714-aa66f4e098c2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:55.406523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:55.431569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830f91f-781d-41b2-addc-1097f5bb7e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:55.432202 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830f91f-781d-41b2-addc-1097f5bb7e33 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:55.432474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830f91f-781d-41b2-addc-1097f5bb7e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:55.432743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830f91f-781d-41b2-addc-1097f5bb7e33 None admin] PATH_INFO: `/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:55.433859 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830f91f-781d-41b2-addc-1097f5bb7e33 None admin] RBAC: Authorizing `identity:get_project(project_id=5d11be18d05c48e6bb8e75e5ec21e418)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:55.435321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830f91f-781d-41b2-addc-1097f5bb7e33 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:55.437132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 548/1103] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:41:55 2022] GET /identity/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:55.443692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830f91f-781d-41b2-addc-1097f5bb7e33 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:55.447321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0e3f0-631f-476d-9aee-eaa9eea25335 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:55.480662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251261ab-9ffb-4a95-a4fd-0c59bf466d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:55.481248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251261ab-9ffb-4a95-a4fd-0c59bf466d3a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:55.481522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251261ab-9ffb-4a95-a4fd-0c59bf466d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:55.481789 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251261ab-9ffb-4a95-a4fd-0c59bf466d3a None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:55.482472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251261ab-9ffb-4a95-a4fd-0c59bf466d3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:55.482792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251261ab-9ffb-4a95-a4fd-0c59bf466d3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:55.484183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251261ab-9ffb-4a95-a4fd-0c59bf466d3a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:55.492890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:55.497862 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 556/1104] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:41:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:55.504180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251261ab-9ffb-4a95-a4fd-0c59bf466d3a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:55.541108 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830f91f-781d-41b2-addc-1097f5bb7e33 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:55.580503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e597fe-33c2-471a-83d4-f82460bf781e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:55.581101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e597fe-33c2-471a-83d4-f82460bf781e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:55.581399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e597fe-33c2-471a-83d4-f82460bf781e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:55.581661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e597fe-33c2-471a-83d4-f82460bf781e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:55.582370 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e597fe-33c2-471a-83d4-f82460bf781e None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=5d11be18d05c48e6bb8e75e5ec21e418, user.id=647525157f9c452e846913eb8ead14d6) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:55.582670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e597fe-33c2-471a-83d4-f82460bf781e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:55.584120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e597fe-33c2-471a-83d4-f82460bf781e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:55.589749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 549/1105] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:41:55 2022] GET /identity/v3/role_assignments?user.id=647525157f9c452e846913eb8ead14d6&scope.project.id=5d11be18d05c48e6bb8e75e5ec21e418&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:55.607380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251261ab-9ffb-4a95-a4fd-0c59bf466d3a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:55.644202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd4df1-9f94-44e8-97f8-48c745ee1db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:55.644822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd4df1-9f94-44e8-97f8-48c745ee1db3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:55.645095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd4df1-9f94-44e8-97f8-48c745ee1db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:55.645358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd4df1-9f94-44e8-97f8-48c745ee1db3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:55.646126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd4df1-9f94-44e8-97f8-48c745ee1db3 None admin] RBAC: Adding query filter params (role.id=9f2d3d0a9ad045e7a84121e39319f1fc, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=ab5f197fb09e422997434a1b2feb4567) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:41:55.646430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd4df1-9f94-44e8-97f8-48c745ee1db3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:55.647926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd4df1-9f94-44e8-97f8-48c745ee1db3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:55.654513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 557/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:41:55 2022] GET /identity/v3/role_assignments?user.id=ab5f197fb09e422997434a1b2feb4567&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=9f2d3d0a9ad045e7a84121e39319f1fc => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:41:57.747244 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77811a-7b8e-4adc-ae15-e4f32303803e None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:57.747772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77811a-7b8e-4adc-ae15-e4f32303803e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:57.747772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77811a-7b8e-4adc-ae15-e4f32303803e None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:57.749106 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 550/1107] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:57.754852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111687f-72e6-49d2-b875-61da8dad75b7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:57.755255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111687f-72e6-49d2-b875-61da8dad75b7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:57.755402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111687f-72e6-49d2-b875-61da8dad75b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:57.773545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6111687f-72e6-49d2-b875-61da8dad75b7 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:57.774714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6111687f-72e6-49d2-b875-61da8dad75b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:57.830611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:57.839051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 558/1108] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:41:58.105012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77811a-7b8e-4adc-ae15-e4f32303803e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:58.151296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:41:58.203408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77811a-7b8e-4adc-ae15-e4f32303803e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:58.235650 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe68756-7b12-47d1-bdda-f0e489912628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:58.236253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68756-7b12-47d1-bdda-f0e489912628 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:58.236523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68756-7b12-47d1-bdda-f0e489912628 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:58.236785 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68756-7b12-47d1-bdda-f0e489912628 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:58.237863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe68756-7b12-47d1-bdda-f0e489912628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:58.239299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe68756-7b12-47d1-bdda-f0e489912628 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:58.240801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 551/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:41:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:58.246392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111687f-72e6-49d2-b875-61da8dad75b7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:58.340800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111687f-72e6-49d2-b875-61da8dad75b7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:58.376592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f713206-d1a1-4038-be4c-716d094bb225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:58.377134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f713206-d1a1-4038-be4c-716d094bb225 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:58.377410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f713206-d1a1-4038-be4c-716d094bb225 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:58.377674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f713206-d1a1-4038-be4c-716d094bb225 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:58.378313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f713206-d1a1-4038-be4c-716d094bb225 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:58.379755 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f713206-d1a1-4038-be4c-716d094bb225 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:58.400742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 559/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:41:58 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:00.553235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201013ae-660a-4098-a76f-011f6ee516c7 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:00.553774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201013ae-660a-4098-a76f-011f6ee516c7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:00.553774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201013ae-660a-4098-a76f-011f6ee516c7 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:00.555147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 552/1111] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:00.560389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063882-ab81-4ce7-8c3a-507c65ca4bc6 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:00.560783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063882-ab81-4ce7-8c3a-507c65ca4bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:00.560934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063882-ab81-4ce7-8c3a-507c65ca4bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:00.579492 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-da063882-ab81-4ce7-8c3a-507c65ca4bc6 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:00.580650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-da063882-ab81-4ce7-8c3a-507c65ca4bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:00.624128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:00.645857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 560/1112] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:00.911951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201013ae-660a-4098-a76f-011f6ee516c7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:01.010188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201013ae-660a-4098-a76f-011f6ee516c7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:01.023580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:01.043292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934ca8c-161c-4e96-8508-746c96cf24ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:01.043905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934ca8c-161c-4e96-8508-746c96cf24ff None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:01.044179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934ca8c-161c-4e96-8508-746c96cf24ff None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:01.044445 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934ca8c-161c-4e96-8508-746c96cf24ff None admin] PATH_INFO: `/v3/roles/5e35afebe51a448a9ee3ed338209d739` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:01.045806 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934ca8c-161c-4e96-8508-746c96cf24ff None admin] RBAC: Authorizing `identity:get_role(role_id=5e35afebe51a448a9ee3ed338209d739)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:01.047782 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934ca8c-161c-4e96-8508-746c96cf24ff None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:01.049077 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 553/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:00 2022] GET /identity/v3/roles/5e35afebe51a448a9ee3ed338209d739 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:01.054855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da063882-ab81-4ce7-8c3a-507c65ca4bc6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:01.152814 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da063882-ab81-4ce7-8c3a-507c65ca4bc6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:01.184708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348dae1-75cc-408e-bf11-680ebd958439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:01.185257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348dae1-75cc-408e-bf11-680ebd958439 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:01.185531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348dae1-75cc-408e-bf11-680ebd958439 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:01.185794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348dae1-75cc-408e-bf11-680ebd958439 None admin] PATH_INFO: `/v3/users/e27f1053900d43588e854ff212d08299` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:01.200035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348dae1-75cc-408e-bf11-680ebd958439 None admin] RBAC: Authorizing `identity:get_user(user_id=e27f1053900d43588e854ff212d08299)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:01.201458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348dae1-75cc-408e-bf11-680ebd958439 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:01.203565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 561/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:01 2022] GET /identity/v3/users/e27f1053900d43588e854ff212d08299 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:01.209269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934ca8c-161c-4e96-8508-746c96cf24ff None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:01.305035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934ca8c-161c-4e96-8508-746c96cf24ff None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:01.338008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf8721-9618-4886-b63d-b0e62ae9893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:01.338612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8721-9618-4886-b63d-b0e62ae9893b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:01.338921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8721-9618-4886-b63d-b0e62ae9893b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:01.339193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8721-9618-4886-b63d-b0e62ae9893b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:01.385590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:01.403967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf8721-9618-4886-b63d-b0e62ae9893b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:01.405921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf8721-9618-4886-b63d-b0e62ae9893b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:01.500475 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 554/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:42:01.506264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348dae1-75cc-408e-bf11-680ebd958439 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:01.544190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:01.601527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348dae1-75cc-408e-bf11-680ebd958439 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:01.634447 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d49e3-56a4-47f4-9bef-19ffd1b6693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:01.635083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d49e3-56a4-47f4-9bef-19ffd1b6693b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:01.635358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d49e3-56a4-47f4-9bef-19ffd1b6693b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:01.635622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d49e3-56a4-47f4-9bef-19ffd1b6693b None admin] PATH_INFO: `/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:01.636721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d49e3-56a4-47f4-9bef-19ffd1b6693b None admin] RBAC: Authorizing `identity:get_project(project_id=5d11be18d05c48e6bb8e75e5ec21e418)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:01.638125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d49e3-56a4-47f4-9bef-19ffd1b6693b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:01.639759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 562/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:01 2022] GET /identity/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:01.645728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf8721-9618-4886-b63d-b0e62ae9893b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:01.727368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:01.745422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf8721-9618-4886-b63d-b0e62ae9893b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:01.777415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdc454-9fa8-4840-9a82-f26f2d417c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:01.777945 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdc454-9fa8-4840-9a82-f26f2d417c77 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:01.778219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdc454-9fa8-4840-9a82-f26f2d417c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:01.778485 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdc454-9fa8-4840-9a82-f26f2d417c77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:01.779223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdc454-9fa8-4840-9a82-f26f2d417c77 None admin] RBAC: Adding query filter params (role.id=5e35afebe51a448a9ee3ed338209d739, scope.project.id=5d11be18d05c48e6bb8e75e5ec21e418, user.id=e27f1053900d43588e854ff212d08299) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:01.779524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdc454-9fa8-4840-9a82-f26f2d417c77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:01.781450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdc454-9fa8-4840-9a82-f26f2d417c77 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:01.786637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 555/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:01 2022] GET /identity/v3/role_assignments?user.id=e27f1053900d43588e854ff212d08299&scope.project.id=5d11be18d05c48e6bb8e75e5ec21e418&role.id=5e35afebe51a448a9ee3ed338209d739 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:03.883387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d6340-cbe8-4e01-ae50-0399871ce80c None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:03.883930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d6340-cbe8-4e01-ae50-0399871ce80c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:03.883930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d6340-cbe8-4e01-ae50-0399871ce80c None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:03.885256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 563/1118] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:03.890895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab34e3-1a40-4570-a709-2982f5468bcf None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:03.891337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab34e3-1a40-4570-a709-2982f5468bcf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:03.891433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab34e3-1a40-4570-a709-2982f5468bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:03.909053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7bab34e3-1a40-4570-a709-2982f5468bcf None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:03.910219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7bab34e3-1a40-4570-a709-2982f5468bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:03.973808 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 556/1119] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:04.240575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d6340-cbe8-4e01-ae50-0399871ce80c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:04.336216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d6340-cbe8-4e01-ae50-0399871ce80c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:04.343725 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:04.368920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a51704-94af-4921-8ab4-1cde10ab67a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:04.369528 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a51704-94af-4921-8ab4-1cde10ab67a1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:04.369797 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a51704-94af-4921-8ab4-1cde10ab67a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:04.370059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a51704-94af-4921-8ab4-1cde10ab67a1 None admin] PATH_INFO: `/v3/roles/5e35afebe51a448a9ee3ed338209d739` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:04.371431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a51704-94af-4921-8ab4-1cde10ab67a1 None admin] RBAC: Authorizing `identity:get_role(role_id=5e35afebe51a448a9ee3ed338209d739)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:04.372770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a51704-94af-4921-8ab4-1cde10ab67a1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:04.374074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 564/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:04 2022] GET /identity/v3/roles/5e35afebe51a448a9ee3ed338209d739 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:04.379681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab34e3-1a40-4570-a709-2982f5468bcf None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:04.454506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:04.476496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab34e3-1a40-4570-a709-2982f5468bcf None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:04.508861 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dec53-9bc9-4033-b97a-9a4acf12642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:04.509424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dec53-9bc9-4033-b97a-9a4acf12642f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:04.509697 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dec53-9bc9-4033-b97a-9a4acf12642f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:04.509961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dec53-9bc9-4033-b97a-9a4acf12642f None admin] PATH_INFO: `/v3/users/e27f1053900d43588e854ff212d08299` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:04.511086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536dec53-9bc9-4033-b97a-9a4acf12642f None admin] RBAC: Authorizing `identity:get_user(user_id=e27f1053900d43588e854ff212d08299)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:04.512508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536dec53-9bc9-4033-b97a-9a4acf12642f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:04.514117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 557/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:04 2022] GET /identity/v3/users/e27f1053900d43588e854ff212d08299 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:04.520329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a51704-94af-4921-8ab4-1cde10ab67a1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:04.614228 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a51704-94af-4921-8ab4-1cde10ab67a1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:04.647083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba4ddf-c2e6-44cd-8ae4-b4c46a809fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:04.647691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba4ddf-c2e6-44cd-8ae4-b4c46a809fcd None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:04.647968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba4ddf-c2e6-44cd-8ae4-b4c46a809fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:04.648236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba4ddf-c2e6-44cd-8ae4-b4c46a809fcd None admin] PATH_INFO: `/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:04.649329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba4ddf-c2e6-44cd-8ae4-b4c46a809fcd None admin] RBAC: Authorizing `identity:get_project(project_id=5d11be18d05c48e6bb8e75e5ec21e418)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:04.650829 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba4ddf-c2e6-44cd-8ae4-b4c46a809fcd None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:04.652403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 565/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:04 2022] GET /identity/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:04.658055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dec53-9bc9-4033-b97a-9a4acf12642f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:04.753466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dec53-9bc9-4033-b97a-9a4acf12642f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:04.786058 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d6f45-ade2-4a39-aec5-d0e78f588159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:04.786635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d6f45-ade2-4a39-aec5-d0e78f588159 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:04.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d6f45-ade2-4a39-aec5-d0e78f588159 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:04.787201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d6f45-ade2-4a39-aec5-d0e78f588159 None admin] PATH_INFO: `/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418/users/e27f1053900d43588e854ff212d08299/roles/5e35afebe51a448a9ee3ed338209d739` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:04.789288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d6f45-ade2-4a39-aec5-d0e78f588159 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d11be18d05c48e6bb8e75e5ec21e418, user_id=e27f1053900d43588e854ff212d08299, role_id=5e35afebe51a448a9ee3ed338209d739)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:04.791038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d6f45-ade2-4a39-aec5-d0e78f588159 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:04.803818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 558/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:42:04 2022] PUT /identity/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418/users/e27f1053900d43588e854ff212d08299/roles/5e35afebe51a448a9ee3ed338209d739 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:42:06.905653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6f38-8898-4f14-b858-302c744c81e5 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:06.906213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6f38-8898-4f14-b858-302c744c81e5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:06.906213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6f38-8898-4f14-b858-302c744c81e5 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:06.907523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 566/1124] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:06.912792 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ac95-dc8b-4683-802d-d30f58e7a368 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:06.913223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ac95-dc8b-4683-802d-d30f58e7a368 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:06.913318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ac95-dc8b-4683-802d-d30f58e7a368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:06.920474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:06.931993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0ab1ac95-dc8b-4683-802d-d30f58e7a368 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:06.933161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0ab1ac95-dc8b-4683-802d-d30f58e7a368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:06.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 559/1125] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:07.264545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae6f38-8898-4f14-b858-302c744c81e5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:07.307184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:07.362041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae6f38-8898-4f14-b858-302c744c81e5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:07.394053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa25b16-eb0c-4ee2-b31e-78534dccaf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:07.394652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa25b16-eb0c-4ee2-b31e-78534dccaf41 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:07.394952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa25b16-eb0c-4ee2-b31e-78534dccaf41 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:07.395217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa25b16-eb0c-4ee2-b31e-78534dccaf41 None admin] PATH_INFO: `/v3/roles/5e35afebe51a448a9ee3ed338209d739` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:07.396559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa25b16-eb0c-4ee2-b31e-78534dccaf41 None admin] RBAC: Authorizing `identity:get_role(role_id=5e35afebe51a448a9ee3ed338209d739)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:07.397893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa25b16-eb0c-4ee2-b31e-78534dccaf41 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:07.399196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 567/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:07 2022] GET /identity/v3/roles/5e35afebe51a448a9ee3ed338209d739 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:07.405348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1ac95-dc8b-4683-802d-d30f58e7a368 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:07.499750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1ac95-dc8b-4683-802d-d30f58e7a368 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:07.532682 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c728ab-fcec-4098-a81b-39684c5fde09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:07.533245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c728ab-fcec-4098-a81b-39684c5fde09 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:07.533523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c728ab-fcec-4098-a81b-39684c5fde09 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:07.533791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c728ab-fcec-4098-a81b-39684c5fde09 None admin] PATH_INFO: `/v3/users/e27f1053900d43588e854ff212d08299` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:07.534922 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c728ab-fcec-4098-a81b-39684c5fde09 None admin] RBAC: Authorizing `identity:get_user(user_id=e27f1053900d43588e854ff212d08299)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:07.536353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c728ab-fcec-4098-a81b-39684c5fde09 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:07.537909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 560/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:07 2022] GET /identity/v3/users/e27f1053900d43588e854ff212d08299 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:07.543562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa25b16-eb0c-4ee2-b31e-78534dccaf41 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:07.638897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa25b16-eb0c-4ee2-b31e-78534dccaf41 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:07.649090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:07.672674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd958d48-060a-4c6a-ad78-6f00da7ecefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:07.673262 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd958d48-060a-4c6a-ad78-6f00da7ecefc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:07.673539 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd958d48-060a-4c6a-ad78-6f00da7ecefc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:07.673810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd958d48-060a-4c6a-ad78-6f00da7ecefc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:07.739279 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd958d48-060a-4c6a-ad78-6f00da7ecefc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:07.740710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd958d48-060a-4c6a-ad78-6f00da7ecefc None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:07.834478 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 568/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:42:07.840341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c728ab-fcec-4098-a81b-39684c5fde09 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:07.843784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:07.942345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c728ab-fcec-4098-a81b-39684c5fde09 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:07.974557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbc6a6-b9bc-4859-9189-b72f959f3b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:07.975213 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbc6a6-b9bc-4859-9189-b72f959f3b12 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:07.975473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbc6a6-b9bc-4859-9189-b72f959f3b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:07.975743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbc6a6-b9bc-4859-9189-b72f959f3b12 None admin] PATH_INFO: `/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:07.976856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbc6a6-b9bc-4859-9189-b72f959f3b12 None admin] RBAC: Authorizing `identity:get_project(project_id=5d11be18d05c48e6bb8e75e5ec21e418)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:07.978286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbc6a6-b9bc-4859-9189-b72f959f3b12 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:07.979935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 561/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:07 2022] GET /identity/v3/projects/5d11be18d05c48e6bb8e75e5ec21e418 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:07.987429 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd958d48-060a-4c6a-ad78-6f00da7ecefc None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:08.002404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:08.086992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd958d48-060a-4c6a-ad78-6f00da7ecefc None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:08.119361 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7658b-d07b-40aa-95d6-37108221deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:08.119943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7658b-d07b-40aa-95d6-37108221deca None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:08.120218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7658b-d07b-40aa-95d6-37108221deca None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:08.120484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7658b-d07b-40aa-95d6-37108221deca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:08.121190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7658b-d07b-40aa-95d6-37108221deca None admin] RBAC: Adding query filter params (role.id=5e35afebe51a448a9ee3ed338209d739, scope.project.id=5d11be18d05c48e6bb8e75e5ec21e418, user.id=e27f1053900d43588e854ff212d08299) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:08.121490 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7658b-d07b-40aa-95d6-37108221deca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:08.123452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7658b-d07b-40aa-95d6-37108221deca None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:08.128933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 569/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:07 2022] GET /identity/v3/role_assignments?user.id=e27f1053900d43588e854ff212d08299&scope.project.id=5d11be18d05c48e6bb8e75e5ec21e418&role.id=5e35afebe51a448a9ee3ed338209d739 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:10.257063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6ebeb-7bf4-479b-8a0d-b2f58b42c289 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:10.257593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6ebeb-7bf4-479b-8a0d-b2f58b42c289 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:10.257593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6ebeb-7bf4-479b-8a0d-b2f58b42c289 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:10.258959 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 562/1131] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:10.264574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c38ba7-e2e5-4c08-8f69-b09d96e69b01 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:10.265003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c38ba7-e2e5-4c08-8f69-b09d96e69b01 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:10.265118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c38ba7-e2e5-4c08-8f69-b09d96e69b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:10.283193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e7c38ba7-e2e5-4c08-8f69-b09d96e69b01 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:10.284346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e7c38ba7-e2e5-4c08-8f69-b09d96e69b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:10.347309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 570/1132] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:10.623104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6ebeb-7bf4-479b-8a0d-b2f58b42c289 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:10.691537 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:10.722815 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6ebeb-7bf4-479b-8a0d-b2f58b42c289 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:10.755176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f4c09-3da9-473d-88cd-626818248446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:10.755783 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f4c09-3da9-473d-88cd-626818248446 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:10.756051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f4c09-3da9-473d-88cd-626818248446 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:10.756314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f4c09-3da9-473d-88cd-626818248446 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:10.757386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f4c09-3da9-473d-88cd-626818248446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:10.758823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f4c09-3da9-473d-88cd-626818248446 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:10.760343 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 563/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:10.766140 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c38ba7-e2e5-4c08-8f69-b09d96e69b01 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:10.769163 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:10.860756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c38ba7-e2e5-4c08-8f69-b09d96e69b01 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:10.892641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3f220-062c-472b-b3d0-3a2f4ffc1f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:10.893168 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3f220-062c-472b-b3d0-3a2f4ffc1f51 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:10.893439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3f220-062c-472b-b3d0-3a2f4ffc1f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:10.893704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3f220-062c-472b-b3d0-3a2f4ffc1f51 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:10.894340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3f220-062c-472b-b3d0-3a2f4ffc1f51 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:10.895762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3f220-062c-472b-b3d0-3a2f4ffc1f51 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:10.921137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 571/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:42:10 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:13.125483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfb6a7-93b3-4051-9395-eff973668e51 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:13.126017 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfb6a7-93b3-4051-9395-eff973668e51 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:13.126017 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfb6a7-93b3-4051-9395-eff973668e51 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:13.127395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 564/1135] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:13.132495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4624c-b492-4b0e-925a-5d2ff70a9175 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:13.132914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4624c-b492-4b0e-925a-5d2ff70a9175 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:13.133027 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4624c-b492-4b0e-925a-5d2ff70a9175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:13.151116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9fc4624c-b492-4b0e-925a-5d2ff70a9175 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:13.152281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9fc4624c-b492-4b0e-925a-5d2ff70a9175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:13.200743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:13.217482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 572/1136] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:13.487171 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfb6a7-93b3-4051-9395-eff973668e51 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:13.584269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfb6a7-93b3-4051-9395-eff973668e51 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:13.616786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd365a4-63c8-4c87-829f-0d353c423bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:13.617423 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd365a4-63c8-4c87-829f-0d353c423bac None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:13.617697 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd365a4-63c8-4c87-829f-0d353c423bac None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:13.617962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd365a4-63c8-4c87-829f-0d353c423bac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:13.619069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd365a4-63c8-4c87-829f-0d353c423bac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:13.620483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd365a4-63c8-4c87-829f-0d353c423bac None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:13.622506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 565/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:13.628025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4624c-b492-4b0e-925a-5d2ff70a9175 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:13.723104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4624c-b492-4b0e-925a-5d2ff70a9175 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:13.755893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf812ed1-3fa7-4ba8-9dce-98f96d0ad7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:13.756487 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf812ed1-3fa7-4ba8-9dce-98f96d0ad7f6 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:13.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf812ed1-3fa7-4ba8-9dce-98f96d0ad7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:13.757037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf812ed1-3fa7-4ba8-9dce-98f96d0ad7f6 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:13.757678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf812ed1-3fa7-4ba8-9dce-98f96d0ad7f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:13.759125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf812ed1-3fa7-4ba8-9dce-98f96d0ad7f6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:13.780310 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 573/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:42:13 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:15.940743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4bee-ba44-4ba3-99fc-2fffa3a64c1b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:15.941295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4bee-ba44-4ba3-99fc-2fffa3a64c1b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:15.941295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4bee-ba44-4ba3-99fc-2fffa3a64c1b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:15.942610 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 566/1139] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:15.948106 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f09d79-fb68-4895-a326-475d94ca2c44 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:15.948515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f09d79-fb68-4895-a326-475d94ca2c44 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:15.948657 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f09d79-fb68-4895-a326-475d94ca2c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:15.967020 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-40f09d79-fb68-4895-a326-475d94ca2c44 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:15.968194 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-40f09d79-fb68-4895-a326-475d94ca2c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:16.001889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:16.033154 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 574/1140] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:16.302505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c4bee-ba44-4ba3-99fc-2fffa3a64c1b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:16.311300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:16.400917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c4bee-ba44-4ba3-99fc-2fffa3a64c1b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:16.433816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f3995-f0d4-4645-ba5a-6e2cc1b5b1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:16.435014 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f3995-f0d4-4645-ba5a-6e2cc1b5b1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:16.435291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f3995-f0d4-4645-ba5a-6e2cc1b5b1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:16.435560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f3995-f0d4-4645-ba5a-6e2cc1b5b1a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:16.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f3995-f0d4-4645-ba5a-6e2cc1b5b1a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0f1f3995-f0d4-4645-ba5a-6e2cc1b5b1a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:16.450521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:16.451631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:16.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:16.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:16.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:16.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:16.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:16.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:16.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:16.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:16.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:16.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:16.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:16.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:42:16.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 567/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:16.457741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f09d79-fb68-4895-a326-475d94ca2c44 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:16.557306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f09d79-fb68-4895-a326-475d94ca2c44 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:16.589346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27ae6f-12af-4f25-8b9f-22017cb417d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:16.589932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27ae6f-12af-4f25-8b9f-22017cb417d5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:16.590208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27ae6f-12af-4f25-8b9f-22017cb417d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:16.591007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27ae6f-12af-4f25-8b9f-22017cb417d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:16.591653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27ae6f-12af-4f25-8b9f-22017cb417d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:16.591950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27ae6f-12af-4f25-8b9f-22017cb417d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:16.593293 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27ae6f-12af-4f25-8b9f-22017cb417d5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:16.601025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 575/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:16.607553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f3995-f0d4-4645-ba5a-6e2cc1b5b1a9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:16.670953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:16.703918 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f3995-f0d4-4645-ba5a-6e2cc1b5b1a9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:16.736441 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95132ad-c9f3-4a50-bf41-8e84a4d2f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:16.737048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95132ad-c9f3-4a50-bf41-8e84a4d2f523 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:16.737322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95132ad-c9f3-4a50-bf41-8e84a4d2f523 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:16.737590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95132ad-c9f3-4a50-bf41-8e84a4d2f523 None admin] PATH_INFO: `/v3/users/6bb7a725f02142d2a4af3bbaa3d07b6f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:16.750573 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95132ad-c9f3-4a50-bf41-8e84a4d2f523 None admin] RBAC: Authorizing `identity:get_user(user_id=6bb7a725f02142d2a4af3bbaa3d07b6f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:16.752017 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95132ad-c9f3-4a50-bf41-8e84a4d2f523 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:16.753569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 568/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:16 2022] GET /identity/v3/users/6bb7a725f02142d2a4af3bbaa3d07b6f => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:16.759229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27ae6f-12af-4f25-8b9f-22017cb417d5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:16.792569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:16.855497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27ae6f-12af-4f25-8b9f-22017cb417d5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:16.887666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525d642-35a8-4d7c-9dce-a6274418be6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:16.888245 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525d642-35a8-4d7c-9dce-a6274418be6b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:16.888521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525d642-35a8-4d7c-9dce-a6274418be6b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:16.888793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525d642-35a8-4d7c-9dce-a6274418be6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:16.952443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525d642-35a8-4d7c-9dce-a6274418be6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:16.953864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525d642-35a8-4d7c-9dce-a6274418be6b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:16.985796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:17.048919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 576/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:42:17.054850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95132ad-c9f3-4a50-bf41-8e84a4d2f523 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:17.150281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95132ad-c9f3-4a50-bf41-8e84a4d2f523 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:17.172906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:17.183265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd46e47-030f-4343-9384-74ed0361c313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:17.183872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd46e47-030f-4343-9384-74ed0361c313 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:17.184722 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd46e47-030f-4343-9384-74ed0361c313 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:17.184991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd46e47-030f-4343-9384-74ed0361c313 None admin] PATH_INFO: `/v3/projects/fb71a649eb3541e1a4159aa62c9d5d25` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:17.186073 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd46e47-030f-4343-9384-74ed0361c313 None admin] RBAC: Authorizing `identity:get_project(project_id=fb71a649eb3541e1a4159aa62c9d5d25)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:17.187507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd46e47-030f-4343-9384-74ed0361c313 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:17.189346 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 569/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:17 2022] GET /identity/v3/projects/fb71a649eb3541e1a4159aa62c9d5d25 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:17.195319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525d642-35a8-4d7c-9dce-a6274418be6b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:17.288990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525d642-35a8-4d7c-9dce-a6274418be6b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:17.322403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab616ca-cd2f-4996-a0a8-6c2a181b1f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:17.323037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab616ca-cd2f-4996-a0a8-6c2a181b1f5a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:17.323319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab616ca-cd2f-4996-a0a8-6c2a181b1f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:17.323589 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab616ca-cd2f-4996-a0a8-6c2a181b1f5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:17.324307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab616ca-cd2f-4996-a0a8-6c2a181b1f5a None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=fb71a649eb3541e1a4159aa62c9d5d25, user.id=6bb7a725f02142d2a4af3bbaa3d07b6f) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:17.324610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab616ca-cd2f-4996-a0a8-6c2a181b1f5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:17.326022 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab616ca-cd2f-4996-a0a8-6c2a181b1f5a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:17.327747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:17.332172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 577/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:17 2022] GET /identity/v3/role_assignments?user.id=6bb7a725f02142d2a4af3bbaa3d07b6f&scope.project.id=fb71a649eb3541e1a4159aa62c9d5d25&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:19.415924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93ea35-1c9e-4ad6-9d30-8079aee36ee9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.416449 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93ea35-1c9e-4ad6-9d30-8079aee36ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.416449 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93ea35-1c9e-4ad6-9d30-8079aee36ee9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.417805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 570/1147] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:19.423408 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3223cc0-4807-4ead-9cc7-991aaafd4552 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.423792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3223cc0-4807-4ead-9cc7-991aaafd4552 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.423953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3223cc0-4807-4ead-9cc7-991aaafd4552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.442704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e3223cc0-4807-4ead-9cc7-991aaafd4552 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:19.443879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e3223cc0-4807-4ead-9cc7-991aaafd4552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:19.507346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 578/1148] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:19.774738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93ea35-1c9e-4ad6-9d30-8079aee36ee9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:19.873104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93ea35-1c9e-4ad6-9d30-8079aee36ee9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:19.906078 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abab4eb-23df-476d-93ab-1c5e14260c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:19.906688 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abab4eb-23df-476d-93ab-1c5e14260c52 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.906991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abab4eb-23df-476d-93ab-1c5e14260c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.907257 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abab4eb-23df-476d-93ab-1c5e14260c52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.916917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abab4eb-23df-476d-93ab-1c5e14260c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4abab4eb-23df-476d-93ab-1c5e14260c52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:19.921743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:19.922934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:19.924070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:19.924070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:19.924070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:19.924070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:19.924070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:19.924070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:19.924070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:19.924070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:19.924070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:19.924070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:19.924070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:19.924070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:42:19.924070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 571/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:19.928836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3223cc0-4807-4ead-9cc7-991aaafd4552 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:20.023641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3223cc0-4807-4ead-9cc7-991aaafd4552 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:20.049461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:20.057080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daae43-0307-4380-bbc7-918928f4ed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:20.057666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daae43-0307-4380-bbc7-918928f4ed8d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:20.057939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daae43-0307-4380-bbc7-918928f4ed8d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:20.058203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daae43-0307-4380-bbc7-918928f4ed8d None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:20.059440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daae43-0307-4380-bbc7-918928f4ed8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:20.059738 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daae43-0307-4380-bbc7-918928f4ed8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:20.061083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daae43-0307-4380-bbc7-918928f4ed8d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:20.069015 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 579/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:20.074717 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abab4eb-23df-476d-93ab-1c5e14260c52 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:20.126525 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:20.171791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abab4eb-23df-476d-93ab-1c5e14260c52 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:20.204728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927e1ab-c9e0-47fc-8e72-a36fc9f82366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:20.205337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927e1ab-c9e0-47fc-8e72-a36fc9f82366 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:20.205611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927e1ab-c9e0-47fc-8e72-a36fc9f82366 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:20.205878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927e1ab-c9e0-47fc-8e72-a36fc9f82366 None admin] PATH_INFO: `/v3/users/6bb7a725f02142d2a4af3bbaa3d07b6f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:20.206990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927e1ab-c9e0-47fc-8e72-a36fc9f82366 None admin] RBAC: Authorizing `identity:get_user(user_id=6bb7a725f02142d2a4af3bbaa3d07b6f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:20.208404 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927e1ab-c9e0-47fc-8e72-a36fc9f82366 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:20.209944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 572/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:20 2022] GET /identity/v3/users/6bb7a725f02142d2a4af3bbaa3d07b6f => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:20.216077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daae43-0307-4380-bbc7-918928f4ed8d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:20.320037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daae43-0307-4380-bbc7-918928f4ed8d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:20.352305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a76f4-695c-48aa-aa9a-9298d7cc1f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:20.352916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a76f4-695c-48aa-aa9a-9298d7cc1f20 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:20.353192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a76f4-695c-48aa-aa9a-9298d7cc1f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:20.353462 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a76f4-695c-48aa-aa9a-9298d7cc1f20 None admin] PATH_INFO: `/v3/projects/fb71a649eb3541e1a4159aa62c9d5d25` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:20.354554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a76f4-695c-48aa-aa9a-9298d7cc1f20 None admin] RBAC: Authorizing `identity:get_project(project_id=fb71a649eb3541e1a4159aa62c9d5d25)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:20.356666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a76f4-695c-48aa-aa9a-9298d7cc1f20 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:20.358294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 580/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:20 2022] GET /identity/v3/projects/fb71a649eb3541e1a4159aa62c9d5d25 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:20.364427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927e1ab-c9e0-47fc-8e72-a36fc9f82366 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:20.461673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927e1ab-c9e0-47fc-8e72-a36fc9f82366 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:20.481986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:20.495737 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308072f4-1b50-4d09-940a-7e4ded31f0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:20.496425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308072f4-1b50-4d09-940a-7e4ded31f0f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:20.496699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308072f4-1b50-4d09-940a-7e4ded31f0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:20.496965 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308072f4-1b50-4d09-940a-7e4ded31f0f6 None admin] PATH_INFO: `/v3/projects/fb71a649eb3541e1a4159aa62c9d5d25/users/6bb7a725f02142d2a4af3bbaa3d07b6f/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:20.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308072f4-1b50-4d09-940a-7e4ded31f0f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb71a649eb3541e1a4159aa62c9d5d25, user_id=6bb7a725f02142d2a4af3bbaa3d07b6f, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:20.500263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308072f4-1b50-4d09-940a-7e4ded31f0f6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:20.512590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 573/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:42:20 2022] PUT /identity/v3/projects/fb71a649eb3541e1a4159aa62c9d5d25/users/6bb7a725f02142d2a4af3bbaa3d07b6f/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:42:22.605803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d880c3-83e4-4e2a-bf7b-4702615bd75d None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:22.606409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d880c3-83e4-4e2a-bf7b-4702615bd75d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:22.606409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d880c3-83e4-4e2a-bf7b-4702615bd75d None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:22.607717 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 581/1154] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:22.612884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229c192-cd37-45c1-b444-873f6d961360 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:22.613284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229c192-cd37-45c1-b444-873f6d961360 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:22.613426 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229c192-cd37-45c1-b444-873f6d961360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:22.631004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0229c192-cd37-45c1-b444-873f6d961360 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:22.632174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0229c192-cd37-45c1-b444-873f6d961360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:22.699530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 574/1155] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:22.967275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d880c3-83e4-4e2a-bf7b-4702615bd75d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:23.024245 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:23.066584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d880c3-83e4-4e2a-bf7b-4702615bd75d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:23.099762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2f58f-72cc-4863-87a9-22c3c0a4a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:23.100373 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2f58f-72cc-4863-87a9-22c3c0a4a36a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:23.100648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2f58f-72cc-4863-87a9-22c3c0a4a36a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:23.100917 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2f58f-72cc-4863-87a9-22c3c0a4a36a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:23.110669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2f58f-72cc-4863-87a9-22c3c0a4a36a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-0df2f58f-72cc-4863-87a9-22c3c0a4a36a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:23.115460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:23.116676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:23.117775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:23.117775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:23.117775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:23.117775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:23.117775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:23.117775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:23.117775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:23.117775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:23.117775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:23.117775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:23.117775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:23.117775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:42:23.117775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 582/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:23.122546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229c192-cd37-45c1-b444-873f6d961360 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:23.218090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229c192-cd37-45c1-b444-873f6d961360 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:23.228818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:23.252557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed7eaf-25fd-4449-9f17-6b4dbcc0a45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:23.253142 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed7eaf-25fd-4449-9f17-6b4dbcc0a45b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:23.253413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed7eaf-25fd-4449-9f17-6b4dbcc0a45b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:23.253678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed7eaf-25fd-4449-9f17-6b4dbcc0a45b None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:23.254323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed7eaf-25fd-4449-9f17-6b4dbcc0a45b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:23.254620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed7eaf-25fd-4449-9f17-6b4dbcc0a45b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:23.255998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed7eaf-25fd-4449-9f17-6b4dbcc0a45b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:23.264243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 575/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:23.270036 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2f58f-72cc-4863-87a9-22c3c0a4a36a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:23.365492 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2f58f-72cc-4863-87a9-22c3c0a4a36a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:23.382332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:23.399548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298e428-ad3e-44f6-916a-b13278cc2a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:23.400297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298e428-ad3e-44f6-916a-b13278cc2a96 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:23.400583 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298e428-ad3e-44f6-916a-b13278cc2a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:23.400852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298e428-ad3e-44f6-916a-b13278cc2a96 None admin] PATH_INFO: `/v3/users/6bb7a725f02142d2a4af3bbaa3d07b6f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:23.401973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298e428-ad3e-44f6-916a-b13278cc2a96 None admin] RBAC: Authorizing `identity:get_user(user_id=6bb7a725f02142d2a4af3bbaa3d07b6f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:23.403475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298e428-ad3e-44f6-916a-b13278cc2a96 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:23.405058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 583/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:23 2022] GET /identity/v3/users/6bb7a725f02142d2a4af3bbaa3d07b6f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:23.410778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed7eaf-25fd-4449-9f17-6b4dbcc0a45b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:23.506376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed7eaf-25fd-4449-9f17-6b4dbcc0a45b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:23.538207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42ad66-81ec-4a1c-a7d5-f7f90afbcaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:23.538826 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ad66-81ec-4a1c-a7d5-f7f90afbcaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:23.539104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ad66-81ec-4a1c-a7d5-f7f90afbcaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:23.539367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ad66-81ec-4a1c-a7d5-f7f90afbcaf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:23.578140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:23.603708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42ad66-81ec-4a1c-a7d5-f7f90afbcaf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:23.605723 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42ad66-81ec-4a1c-a7d5-f7f90afbcaf4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:23.699458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 576/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:42:23.705298 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298e428-ad3e-44f6-916a-b13278cc2a96 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:23.801121 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298e428-ad3e-44f6-916a-b13278cc2a96 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:23.833452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65241dc6-fdc3-4e37-a694-440b71e5b07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:23.834061 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65241dc6-fdc3-4e37-a694-440b71e5b07a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:23.834336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65241dc6-fdc3-4e37-a694-440b71e5b07a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:23.834604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65241dc6-fdc3-4e37-a694-440b71e5b07a None admin] PATH_INFO: `/v3/projects/fb71a649eb3541e1a4159aa62c9d5d25` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:23.835726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65241dc6-fdc3-4e37-a694-440b71e5b07a None admin] RBAC: Authorizing `identity:get_project(project_id=fb71a649eb3541e1a4159aa62c9d5d25)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:23.837151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65241dc6-fdc3-4e37-a694-440b71e5b07a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:23.838761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 584/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:23 2022] GET /identity/v3/projects/fb71a649eb3541e1a4159aa62c9d5d25 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:23.845285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42ad66-81ec-4a1c-a7d5-f7f90afbcaf4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:23.911854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:23.940516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42ad66-81ec-4a1c-a7d5-f7f90afbcaf4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:23.976926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe7376-f738-4c1d-ad72-d7ffa8033a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:23.977518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe7376-f738-4c1d-ad72-d7ffa8033a02 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:23.977797 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe7376-f738-4c1d-ad72-d7ffa8033a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:23.978064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe7376-f738-4c1d-ad72-d7ffa8033a02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:23.978807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe7376-f738-4c1d-ad72-d7ffa8033a02 None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=fb71a649eb3541e1a4159aa62c9d5d25, user.id=6bb7a725f02142d2a4af3bbaa3d07b6f) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:23.979110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe7376-f738-4c1d-ad72-d7ffa8033a02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:23.981166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe7376-f738-4c1d-ad72-d7ffa8033a02 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:23.986942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 577/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:23 2022] GET /identity/v3/role_assignments?user.id=6bb7a725f02142d2a4af3bbaa3d07b6f&scope.project.id=fb71a649eb3541e1a4159aa62c9d5d25&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:26.135836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d55f8f-cda5-4ceb-bcef-d86d31a91b19 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.136878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d55f8f-cda5-4ceb-bcef-d86d31a91b19 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.136878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d55f8f-cda5-4ceb-bcef-d86d31a91b19 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.138242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 585/1162] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:26.143474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b20dd-1cb3-423b-b10a-fce428ec1241 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.143881 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b20dd-1cb3-423b-b10a-fce428ec1241 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.144018 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b20dd-1cb3-423b-b10a-fce428ec1241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.162210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-989b20dd-1cb3-423b-b10a-fce428ec1241 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:26.163411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-989b20dd-1cb3-423b-b10a-fce428ec1241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:26.227324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 578/1163] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:26.507962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d55f8f-cda5-4ceb-bcef-d86d31a91b19 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:26.562741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:26.607261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d55f8f-cda5-4ceb-bcef-d86d31a91b19 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:26.640354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e4fe1-13c4-4a95-bffa-0662b9bf5abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:26.640976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e4fe1-13c4-4a95-bffa-0662b9bf5abb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.641252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e4fe1-13c4-4a95-bffa-0662b9bf5abb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.641518 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e4fe1-13c4-4a95-bffa-0662b9bf5abb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.709081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e4fe1-13c4-4a95-bffa-0662b9bf5abb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:26.710429 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e4fe1-13c4-4a95-bffa-0662b9bf5abb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:26.761903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:26.805086 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 586/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:42:26.811121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b20dd-1cb3-423b-b10a-fce428ec1241 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:26.873253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:26.907040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b20dd-1cb3-423b-b10a-fce428ec1241 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:26.939688 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddde41-2019-4c8e-bec6-0ff739dfad31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:26.940301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddde41-2019-4c8e-bec6-0ff739dfad31 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.940577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddde41-2019-4c8e-bec6-0ff739dfad31 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.940845 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddde41-2019-4c8e-bec6-0ff739dfad31 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.947256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddde41-2019-4c8e-bec6-0ff739dfad31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:26.948730 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddde41-2019-4c8e-bec6-0ff739dfad31 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-fcddde41-2019-4c8e-bec6-0ff739dfad31 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:26.960603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:26.961897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:42:26.963087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 579/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Sun Sep 11 00:42:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:26.968059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e4fe1-13c4-4a95-bffa-0662b9bf5abb None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:27.073229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e4fe1-13c4-4a95-bffa-0662b9bf5abb None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:27.107831 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55ecca-fcfa-4c1c-89fa-2f937cf1511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:27.108507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55ecca-fcfa-4c1c-89fa-2f937cf1511f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:27.108909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55ecca-fcfa-4c1c-89fa-2f937cf1511f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:27.109310 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55ecca-fcfa-4c1c-89fa-2f937cf1511f None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:27.109943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55ecca-fcfa-4c1c-89fa-2f937cf1511f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:27.110237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55ecca-fcfa-4c1c-89fa-2f937cf1511f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:27.111607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55ecca-fcfa-4c1c-89fa-2f937cf1511f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:27.118446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 587/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Sun Sep 11 00:42:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:29.212236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f50468-9323-4f4e-b2c0-f855ed417884 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:29.212793 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f50468-9323-4f4e-b2c0-f855ed417884 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:29.212793 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f50468-9323-4f4e-b2c0-f855ed417884 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:29.214602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 580/1167] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:29.219712 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02766be8-b09b-47bb-92f9-34d706f8a094 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:29.220098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02766be8-b09b-47bb-92f9-34d706f8a094 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:29.220255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02766be8-b09b-47bb-92f9-34d706f8a094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:29.238458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-02766be8-b09b-47bb-92f9-34d706f8a094 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:29.239642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-02766be8-b09b-47bb-92f9-34d706f8a094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:29.252279 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:29.303488 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 588/1168] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:29.570267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f50468-9323-4f4e-b2c0-f855ed417884 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:29.666637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f50468-9323-4f4e-b2c0-f855ed417884 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:29.691036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:29.699752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273273a0-83bd-44ef-be63-8490350b37da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:29.700341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273273a0-83bd-44ef-be63-8490350b37da None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:29.700615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273273a0-83bd-44ef-be63-8490350b37da None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:29.700881 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273273a0-83bd-44ef-be63-8490350b37da None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:29.701546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273273a0-83bd-44ef-be63-8490350b37da None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:29.702931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273273a0-83bd-44ef-be63-8490350b37da None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:29.718032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 581/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Sun Sep 11 00:42:29 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:31.870389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa169a-5d25-469f-bea3-b5cc01001094 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:31.870946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa169a-5d25-469f-bea3-b5cc01001094 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:31.870946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa169a-5d25-469f-bea3-b5cc01001094 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:31.872283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 589/1170] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:31.877496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63241e-4700-4f62-aa4a-933acf4e42e0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:31.877933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63241e-4700-4f62-aa4a-933acf4e42e0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:31.878034 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63241e-4700-4f62-aa4a-933acf4e42e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:31.896388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5c63241e-4700-4f62-aa4a-933acf4e42e0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:31.897563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5c63241e-4700-4f62-aa4a-933acf4e42e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:31.973678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 582/1171] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:32.236753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa169a-5d25-469f-bea3-b5cc01001094 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:32.333222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa169a-5d25-469f-bea3-b5cc01001094 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:32.365816 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd252bd-749d-459f-b038-9f5826fc4cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:32.366412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd252bd-749d-459f-b038-9f5826fc4cdf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:32.366682 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd252bd-749d-459f-b038-9f5826fc4cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:32.366979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd252bd-749d-459f-b038-9f5826fc4cdf None admin] PATH_INFO: `/v3/domains/675541b6a4174b558205ff8b9f1f30b9` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:32.376858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd252bd-749d-459f-b038-9f5826fc4cdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=675541b6a4174b558205ff8b9f1f30b9)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:32.378262 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd252bd-749d-459f-b038-9f5826fc4cdf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:32.379821 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 590/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Sun Sep 11 00:42:32 2022] GET /identity/v3/domains/675541b6a4174b558205ff8b9f1f30b9 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:32.385575 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63241e-4700-4f62-aa4a-933acf4e42e0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:32.483392 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63241e-4700-4f62-aa4a-933acf4e42e0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:32.500081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:32.518341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a313d-7e7e-471c-ab36-44a7285163fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:32.518973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a313d-7e7e-471c-ab36-44a7285163fa None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:32.519249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a313d-7e7e-471c-ab36-44a7285163fa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:32.519515 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a313d-7e7e-471c-ab36-44a7285163fa None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:32.520161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a313d-7e7e-471c-ab36-44a7285163fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:32.521588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a313d-7e7e-471c-ab36-44a7285163fa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:32.546656 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 583/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:42:32 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:42:34.680323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64c247-0f28-49ca-864f-5033182a1617 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.680828 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64c247-0f28-49ca-864f-5033182a1617 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.680828 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64c247-0f28-49ca-864f-5033182a1617 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.682094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 591/1174] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:34.688067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b941cc-2509-4cfd-b262-cf6754cf8756 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.688499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b941cc-2509-4cfd-b262-cf6754cf8756 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.688598 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b941cc-2509-4cfd-b262-cf6754cf8756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.706868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-80b941cc-2509-4cfd-b262-cf6754cf8756 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:34.708040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-80b941cc-2509-4cfd-b262-cf6754cf8756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:34.771515 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 584/1175] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:35.040714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64c247-0f28-49ca-864f-5033182a1617 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:35.051931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:35.139628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64c247-0f28-49ca-864f-5033182a1617 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:35.172787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebb72c-b721-4a85-961e-9f73837337ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:35.173400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebb72c-b721-4a85-961e-9f73837337ac None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:35.173679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebb72c-b721-4a85-961e-9f73837337ac None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:35.173951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebb72c-b721-4a85-961e-9f73837337ac None admin] PATH_INFO: `/v3/domains/675541b6a4174b558205ff8b9f1f30b9` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:35.175088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebb72c-b721-4a85-961e-9f73837337ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=675541b6a4174b558205ff8b9f1f30b9)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:35.176505 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebb72c-b721-4a85-961e-9f73837337ac None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:35.178046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 592/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Sun Sep 11 00:42:35 2022] GET /identity/v3/domains/675541b6a4174b558205ff8b9f1f30b9 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:35.184208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b941cc-2509-4cfd-b262-cf6754cf8756 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:35.274593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:35.279031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b941cc-2509-4cfd-b262-cf6754cf8756 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:35.312563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5b921-520b-4e1b-a7eb-e4580fc645c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:35.313089 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5b921-520b-4e1b-a7eb-e4580fc645c3 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:35.313361 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5b921-520b-4e1b-a7eb-e4580fc645c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:35.313627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5b921-520b-4e1b-a7eb-e4580fc645c3 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:35.314255 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5b921-520b-4e1b-a7eb-e4580fc645c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:35.315692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5b921-520b-4e1b-a7eb-e4580fc645c3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:35.336768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 585/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:42:35 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:37.502405 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899ef2-774c-4c1d-9091-59f7818a27ac None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:37.502937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899ef2-774c-4c1d-9091-59f7818a27ac None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:37.503055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899ef2-774c-4c1d-9091-59f7818a27ac None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:37.504288 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 593/1178] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:37.509403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2261-5cdc-4e40-8295-eb0400762f5e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:37.509774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2261-5cdc-4e40-8295-eb0400762f5e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:37.509941 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2261-5cdc-4e40-8295-eb0400762f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:37.528127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6b0a2261-5cdc-4e40-8295-eb0400762f5e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:37.529299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6b0a2261-5cdc-4e40-8295-eb0400762f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:37.594069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 586/1179] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:37.864132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19899ef2-774c-4c1d-9091-59f7818a27ac None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:37.938288 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:37.960621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19899ef2-774c-4c1d-9091-59f7818a27ac None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:37.992571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520d7f4-3789-44b4-a667-98339c1d2c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:37.993169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520d7f4-3789-44b4-a667-98339c1d2c4b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:37.993440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520d7f4-3789-44b4-a667-98339c1d2c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:37.993703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520d7f4-3789-44b4-a667-98339c1d2c4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.003935 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520d7f4-3789-44b4-a667-98339c1d2c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d520d7f4-3789-44b4-a667-98339c1d2c4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:38.008626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:38.009686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:38.010921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:38.010921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:38.010921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:38.010921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:38.010921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:38.010921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:38.010921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:38.010921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:38.010921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:38.010921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:38.010921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:38.010921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:42:38.010921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 594/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:38.015600 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2261-5cdc-4e40-8295-eb0400762f5e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:38.097427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:38.113865 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2261-5cdc-4e40-8295-eb0400762f5e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:38.146624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ad23d-6952-4e63-83bd-155845bf653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:38.147182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ad23d-6952-4e63-83bd-155845bf653c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.147453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ad23d-6952-4e63-83bd-155845bf653c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.147714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ad23d-6952-4e63-83bd-155845bf653c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.148363 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ad23d-6952-4e63-83bd-155845bf653c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:38.148658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ad23d-6952-4e63-83bd-155845bf653c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:38.150007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ad23d-6952-4e63-83bd-155845bf653c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:38.157663 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 587/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:38.163631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520d7f4-3789-44b4-a667-98339c1d2c4b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:38.259427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520d7f4-3789-44b4-a667-98339c1d2c4b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:38.292383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e3f48-6dc0-4db2-8c2e-6338ef341174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:38.293002 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e3f48-6dc0-4db2-8c2e-6338ef341174 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.293278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e3f48-6dc0-4db2-8c2e-6338ef341174 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.293544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e3f48-6dc0-4db2-8c2e-6338ef341174 None admin] PATH_INFO: `/v3/users/4fc5190a881b4f5b9c98891b8c4a66a8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.296230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:38.306781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e3f48-6dc0-4db2-8c2e-6338ef341174 None admin] RBAC: Authorizing `identity:get_user(user_id=4fc5190a881b4f5b9c98891b8c4a66a8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:38.308205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e3f48-6dc0-4db2-8c2e-6338ef341174 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:38.309782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 595/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:38 2022] GET /identity/v3/users/4fc5190a881b4f5b9c98891b8c4a66a8 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:38.315756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ad23d-6952-4e63-83bd-155845bf653c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:38.411846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ad23d-6952-4e63-83bd-155845bf653c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:38.444521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234043-d958-4b57-b9ff-86e7fa65931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:38.445111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234043-d958-4b57-b9ff-86e7fa65931e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.445391 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234043-d958-4b57-b9ff-86e7fa65931e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.445657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234043-d958-4b57-b9ff-86e7fa65931e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.460247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:38.516500 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94234043-d958-4b57-b9ff-86e7fa65931e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:38.517958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94234043-d958-4b57-b9ff-86e7fa65931e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:38.611454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 588/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 00:42:38.617384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e3f48-6dc0-4db2-8c2e-6338ef341174 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:38.714720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e3f48-6dc0-4db2-8c2e-6338ef341174 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:38.747624 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba01f8-0bc0-4e65-85e8-753a1d103fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:38.748230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba01f8-0bc0-4e65-85e8-753a1d103fab None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.748503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba01f8-0bc0-4e65-85e8-753a1d103fab None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.748768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba01f8-0bc0-4e65-85e8-753a1d103fab None admin] PATH_INFO: `/v3/projects/14e3b313cabd49d68d4750f9c616721f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.749854 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba01f8-0bc0-4e65-85e8-753a1d103fab None admin] RBAC: Authorizing `identity:get_project(project_id=14e3b313cabd49d68d4750f9c616721f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:38.751285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba01f8-0bc0-4e65-85e8-753a1d103fab None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:38.752863 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 596/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:38 2022] GET /identity/v3/projects/14e3b313cabd49d68d4750f9c616721f => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:38.759038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234043-d958-4b57-b9ff-86e7fa65931e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:38.803529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:38.856424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234043-d958-4b57-b9ff-86e7fa65931e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:38.889127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd05be-678b-4557-be83-948b6c45f594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:38.889710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd05be-678b-4557-be83-948b6c45f594 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.889987 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd05be-678b-4557-be83-948b6c45f594 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.890257 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd05be-678b-4557-be83-948b6c45f594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.890992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd05be-678b-4557-be83-948b6c45f594 None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=14e3b313cabd49d68d4750f9c616721f, user.id=4fc5190a881b4f5b9c98891b8c4a66a8) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:38.891297 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd05be-678b-4557-be83-948b6c45f594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:38.892724 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd05be-678b-4557-be83-948b6c45f594 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:38.897911 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 589/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:38 2022] GET /identity/v3/role_assignments?user.id=4fc5190a881b4f5b9c98891b8c4a66a8&scope.project.id=14e3b313cabd49d68d4750f9c616721f&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:40.991264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87d095-94eb-4ffd-bab1-c5f976621bc3 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:40.991796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87d095-94eb-4ffd-bab1-c5f976621bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:40.991796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87d095-94eb-4ffd-bab1-c5f976621bc3 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:40.993124 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 597/1186] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:40.998873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e98f-e4f9-43df-b557-d9b4ac233d76 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:40.999314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e98f-e4f9-43df-b557-d9b4ac233d76 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:40.999454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e98f-e4f9-43df-b557-d9b4ac233d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:41.017214 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9256e98f-e4f9-43df-b557-d9b4ac233d76 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:41.018389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9256e98f-e4f9-43df-b557-d9b4ac233d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:41.083194 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 590/1187] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:41.350205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87d095-94eb-4ffd-bab1-c5f976621bc3 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:41.409867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:41.449197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87d095-94eb-4ffd-bab1-c5f976621bc3 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:41.482093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744f75e-db3a-4f49-9ba2-ab62a798caf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:41.482690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744f75e-db3a-4f49-9ba2-ab62a798caf1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:41.482990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744f75e-db3a-4f49-9ba2-ab62a798caf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:41.483258 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744f75e-db3a-4f49-9ba2-ab62a798caf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:41.492951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744f75e-db3a-4f49-9ba2-ab62a798caf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-3744f75e-db3a-4f49-9ba2-ab62a798caf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:41.497699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:41.498845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:41.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:41.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:41.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:41.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:41.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:41.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:41.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:41.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:41.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:41.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:41.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:41.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:42:41.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 598/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:41.504800 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e98f-e4f9-43df-b557-d9b4ac233d76 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:41.546634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:41.605476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e98f-e4f9-43df-b557-d9b4ac233d76 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:41.637719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42c849-06ae-4d0f-a249-74ac7ac918e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:41.638308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42c849-06ae-4d0f-a249-74ac7ac918e1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:41.638582 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42c849-06ae-4d0f-a249-74ac7ac918e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:41.638892 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42c849-06ae-4d0f-a249-74ac7ac918e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:41.639532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42c849-06ae-4d0f-a249-74ac7ac918e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:41.639828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42c849-06ae-4d0f-a249-74ac7ac918e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:41.641176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42c849-06ae-4d0f-a249-74ac7ac918e1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:41.648832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 591/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:41.655357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744f75e-db3a-4f49-9ba2-ab62a798caf1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:41.751360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744f75e-db3a-4f49-9ba2-ab62a798caf1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:41.772880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:41.784364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180cc79-68d4-48d1-9038-0f3895f65fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:41.784966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180cc79-68d4-48d1-9038-0f3895f65fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:41.785240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180cc79-68d4-48d1-9038-0f3895f65fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:41.785507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180cc79-68d4-48d1-9038-0f3895f65fb2 None admin] PATH_INFO: `/v3/users/4fc5190a881b4f5b9c98891b8c4a66a8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:41.786590 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180cc79-68d4-48d1-9038-0f3895f65fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=4fc5190a881b4f5b9c98891b8c4a66a8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:41.788021 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180cc79-68d4-48d1-9038-0f3895f65fb2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:41.789538 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 599/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:41 2022] GET /identity/v3/users/4fc5190a881b4f5b9c98891b8c4a66a8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:41.795802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42c849-06ae-4d0f-a249-74ac7ac918e1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:41.896969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42c849-06ae-4d0f-a249-74ac7ac918e1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:41.898411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:41.931434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0c247-fccd-4b5c-9305-4b8146aebdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:41.932643 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c247-fccd-4b5c-9305-4b8146aebdfe None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:41.932918 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c247-fccd-4b5c-9305-4b8146aebdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:41.933187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c247-fccd-4b5c-9305-4b8146aebdfe None admin] PATH_INFO: `/v3/projects/14e3b313cabd49d68d4750f9c616721f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:41.934292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0c247-fccd-4b5c-9305-4b8146aebdfe None admin] RBAC: Authorizing `identity:get_project(project_id=14e3b313cabd49d68d4750f9c616721f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:41.935756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0c247-fccd-4b5c-9305-4b8146aebdfe None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:41.937629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 592/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:41 2022] GET /identity/v3/projects/14e3b313cabd49d68d4750f9c616721f => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:41.943517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180cc79-68d4-48d1-9038-0f3895f65fb2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:42.038633 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180cc79-68d4-48d1-9038-0f3895f65fb2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:42.071400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34bdd2-39ba-4293-8fdd-eaf6716a3a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:42.072092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34bdd2-39ba-4293-8fdd-eaf6716a3a4f None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:42.072416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34bdd2-39ba-4293-8fdd-eaf6716a3a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:42.072687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34bdd2-39ba-4293-8fdd-eaf6716a3a4f None admin] PATH_INFO: `/v3/projects/14e3b313cabd49d68d4750f9c616721f/users/4fc5190a881b4f5b9c98891b8c4a66a8/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:42.074545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34bdd2-39ba-4293-8fdd-eaf6716a3a4f None admin] RBAC: Authorizing `identity:create_grant(project_id=14e3b313cabd49d68d4750f9c616721f, user_id=4fc5190a881b4f5b9c98891b8c4a66a8, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:42.075982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34bdd2-39ba-4293-8fdd-eaf6716a3a4f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:42.088572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 600/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:42:41 2022] PUT /identity/v3/projects/14e3b313cabd49d68d4750f9c616721f/users/4fc5190a881b4f5b9c98891b8c4a66a8/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:42:44.219640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3fca-d6d5-47b1-a8d7-50316284ab66 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:44.220208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3fca-d6d5-47b1-a8d7-50316284ab66 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:44.220208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3fca-d6d5-47b1-a8d7-50316284ab66 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:44.221506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 593/1193] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:44.226639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fb6ac-55ae-4bee-b396-f6a0bedfa422 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:44.227074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fb6ac-55ae-4bee-b396-f6a0bedfa422 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:44.227221 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fb6ac-55ae-4bee-b396-f6a0bedfa422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:44.245417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-615fb6ac-55ae-4bee-b396-f6a0bedfa422 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:44.246572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-615fb6ac-55ae-4bee-b396-f6a0bedfa422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:44.290280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:44.312175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 601/1194] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:42:44.589401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f3fca-d6d5-47b1-a8d7-50316284ab66 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:44.686632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f3fca-d6d5-47b1-a8d7-50316284ab66 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:44.718258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7340a2-4a14-43dc-bf28-61f84e414220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:44.718885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7340a2-4a14-43dc-bf28-61f84e414220 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:44.719156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7340a2-4a14-43dc-bf28-61f84e414220 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:44.719423 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7340a2-4a14-43dc-bf28-61f84e414220 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:44.730000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7340a2-4a14-43dc-bf28-61f84e414220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6d7340a2-4a14-43dc-bf28-61f84e414220 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:44.734761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:44.735903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:44.736926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:44.736926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:44.736926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:44.736926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:44.736926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:44.736926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:44.736926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:44.736926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:44.736926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:44.736926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:44.736926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:44.736926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:42:44.736926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 594/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:44.741781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fb6ac-55ae-4bee-b396-f6a0bedfa422 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:44.841626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fb6ac-55ae-4bee-b396-f6a0bedfa422 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:44.874874 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6b1f0-2b7e-42ed-97b9-42f4643468d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:44.875464 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b1f0-2b7e-42ed-97b9-42f4643468d2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:44.875742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b1f0-2b7e-42ed-97b9-42f4643468d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:44.876011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b1f0-2b7e-42ed-97b9-42f4643468d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:44.876658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6b1f0-2b7e-42ed-97b9-42f4643468d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:44.876957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6b1f0-2b7e-42ed-97b9-42f4643468d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:44.878301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6b1f0-2b7e-42ed-97b9-42f4643468d2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:44.886095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 602/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:44.891960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7340a2-4a14-43dc-bf28-61f84e414220 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:44.921958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:44.989741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7340a2-4a14-43dc-bf28-61f84e414220 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:45.021737 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a61cd-7f7d-4efa-8f45-55f48e63ff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:45.022348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a61cd-7f7d-4efa-8f45-55f48e63ff33 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:45.022623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a61cd-7f7d-4efa-8f45-55f48e63ff33 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:45.022924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a61cd-7f7d-4efa-8f45-55f48e63ff33 None admin] PATH_INFO: `/v3/users/4fc5190a881b4f5b9c98891b8c4a66a8` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:45.024022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a61cd-7f7d-4efa-8f45-55f48e63ff33 None admin] RBAC: Authorizing `identity:get_user(user_id=4fc5190a881b4f5b9c98891b8c4a66a8)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:45.025951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a61cd-7f7d-4efa-8f45-55f48e63ff33 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:45.027535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 595/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:44 2022] GET /identity/v3/users/4fc5190a881b4f5b9c98891b8c4a66a8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:45.033153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6b1f0-2b7e-42ed-97b9-42f4643468d2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:45.075321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:45.129244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6b1f0-2b7e-42ed-97b9-42f4643468d2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:45.160953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada5bab-313d-47f6-9411-a1bb88efc89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:45.161540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada5bab-313d-47f6-9411-a1bb88efc89a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:45.161813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada5bab-313d-47f6-9411-a1bb88efc89a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:45.162079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada5bab-313d-47f6-9411-a1bb88efc89a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:45.225255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada5bab-313d-47f6-9411-a1bb88efc89a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:45.226699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada5bab-313d-47f6-9411-a1bb88efc89a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:45.265409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:45.320451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 603/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:42:45.326292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a61cd-7f7d-4efa-8f45-55f48e63ff33 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:45.418118 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:45.421957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a61cd-7f7d-4efa-8f45-55f48e63ff33 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:45.457507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee93cfc-a649-4af5-b9bc-a3f212e48ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:45.458151 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee93cfc-a649-4af5-b9bc-a3f212e48ffc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:45.458429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee93cfc-a649-4af5-b9bc-a3f212e48ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:45.458743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee93cfc-a649-4af5-b9bc-a3f212e48ffc None admin] PATH_INFO: `/v3/projects/14e3b313cabd49d68d4750f9c616721f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:45.459860 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee93cfc-a649-4af5-b9bc-a3f212e48ffc None admin] RBAC: Authorizing `identity:get_project(project_id=14e3b313cabd49d68d4750f9c616721f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:45.461285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee93cfc-a649-4af5-b9bc-a3f212e48ffc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:45.462937 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 596/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:45 2022] GET /identity/v3/projects/14e3b313cabd49d68d4750f9c616721f => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:45.469137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada5bab-313d-47f6-9411-a1bb88efc89a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:45.565511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada5bab-313d-47f6-9411-a1bb88efc89a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:45.598409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8cd73-fec6-4b86-acfb-f5c6ab7b6a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:45.599017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8cd73-fec6-4b86-acfb-f5c6ab7b6a6e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:45.599296 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8cd73-fec6-4b86-acfb-f5c6ab7b6a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:45.599563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8cd73-fec6-4b86-acfb-f5c6ab7b6a6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:45.600276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8cd73-fec6-4b86-acfb-f5c6ab7b6a6e None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=14e3b313cabd49d68d4750f9c616721f, user.id=4fc5190a881b4f5b9c98891b8c4a66a8) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:45.600581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8cd73-fec6-4b86-acfb-f5c6ab7b6a6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:45.601975 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8cd73-fec6-4b86-acfb-f5c6ab7b6a6e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:45.608042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 604/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:45 2022] GET /identity/v3/role_assignments?user.id=4fc5190a881b4f5b9c98891b8c4a66a8&scope.project.id=14e3b313cabd49d68d4750f9c616721f&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:55.451675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=17 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:55.605512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:40.799516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca5519-5d0c-4e65-81f1-6f1d24f82db0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:40.800236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca5519-5d0c-4e65-81f1-6f1d24f82db0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:40.800236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca5519-5d0c-4e65-81f1-6f1d24f82db0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:40.801538 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 597/1201] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:43:40.807445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bc6d8-5def-4ec6-8ba3-dce92b52c4a3 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:40.807939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bc6d8-5def-4ec6-8ba3-dce92b52c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:40.808038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bc6d8-5def-4ec6-8ba3-dce92b52c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:40.828155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ec1bc6d8-5def-4ec6-8ba3-dce92b52c4a3 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:40.829471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ec1bc6d8-5def-4ec6-8ba3-dce92b52c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:40.911959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 605/1202] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:43:41.184365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca5519-5d0c-4e65-81f1-6f1d24f82db0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:41.322802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca5519-5d0c-4e65-81f1-6f1d24f82db0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:41.368488 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59602af-1462-47a6-8750-ce2a0144a05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:41.369168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59602af-1462-47a6-8750-ce2a0144a05c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:41.369450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59602af-1462-47a6-8750-ce2a0144a05c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:41.369724 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59602af-1462-47a6-8750-ce2a0144a05c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:41.382364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59602af-1462-47a6-8750-ce2a0144a05c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:41.384060 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59602af-1462-47a6-8750-ce2a0144a05c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f59602af-1462-47a6-8750-ce2a0144a05c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:41.403728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:41.404927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:41.410059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:41.410059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:41.410059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:43:41.410059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 598/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:41.412997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bc6d8-5def-4ec6-8ba3-dce92b52c4a3 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:41.552338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bc6d8-5def-4ec6-8ba3-dce92b52c4a3 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:41.583336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:41.590513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0cc01-d29a-4c97-84a3-6dabaeb86572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:41.591131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0cc01-d29a-4c97-84a3-6dabaeb86572 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:41.591380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0cc01-d29a-4c97-84a3-6dabaeb86572 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:41.591740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0cc01-d29a-4c97-84a3-6dabaeb86572 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:41.592394 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0cc01-d29a-4c97-84a3-6dabaeb86572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:41.592653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0cc01-d29a-4c97-84a3-6dabaeb86572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:41.593987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0cc01-d29a-4c97-84a3-6dabaeb86572 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:41.611989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 606/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:41.612906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59602af-1462-47a6-8750-ce2a0144a05c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:41.691729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:41.760902 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59602af-1462-47a6-8750-ce2a0144a05c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:41.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cef47a-44fe-4cc2-b320-8e4c9789343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:41.800335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cef47a-44fe-4cc2-b320-8e4c9789343e None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:41.800530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cef47a-44fe-4cc2-b320-8e4c9789343e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:41.800786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cef47a-44fe-4cc2-b320-8e4c9789343e None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:41.801480 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cef47a-44fe-4cc2-b320-8e4c9789343e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:41.802998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cef47a-44fe-4cc2-b320-8e4c9789343e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:41.843010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 599/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Sun Sep 11 00:43:41 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:43:44.301963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a2380-26b3-42d7-bf80-96220312f9b0 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:44.304364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a2380-26b3-42d7-bf80-96220312f9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:44.304364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a2380-26b3-42d7-bf80-96220312f9b0 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:44.304364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 607/1206] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:44.310854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a1e30-aaf0-4340-8d42-becbb2552b6b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:44.311319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a1e30-aaf0-4340-8d42-becbb2552b6b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:44.311420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a1e30-aaf0-4340-8d42-becbb2552b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:44.333801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ec5a1e30-aaf0-4340-8d42-becbb2552b6b None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:44.334501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ec5a1e30-aaf0-4340-8d42-becbb2552b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:44.418817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 600/1207] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:43:44.719748 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a2380-26b3-42d7-bf80-96220312f9b0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:44.872374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a2380-26b3-42d7-bf80-96220312f9b0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:44.922906 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404300e0-0fc1-467b-8b13-0fb87f2e7a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:44.923537 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404300e0-0fc1-467b-8b13-0fb87f2e7a5b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:44.923823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404300e0-0fc1-467b-8b13-0fb87f2e7a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:44.924108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404300e0-0fc1-467b-8b13-0fb87f2e7a5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:44.940126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404300e0-0fc1-467b-8b13-0fb87f2e7a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-404300e0-0fc1-467b-8b13-0fb87f2e7a5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:44.945255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:44.946559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:44.947638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:44.947638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:44.947638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:44.947638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:44.947638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:44.947638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:44.947638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:44.947638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:44.947638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:44.947638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:44.947638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:44.947638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:43:44.951277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 608/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:44.952890 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a1e30-aaf0-4340-8d42-becbb2552b6b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:45.000050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:45.095418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a1e30-aaf0-4340-8d42-becbb2552b6b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:45.145691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cac61-03c0-4b85-9583-a4d943609d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:45.145691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cac61-03c0-4b85-9583-a4d943609d52 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:45.145691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cac61-03c0-4b85-9583-a4d943609d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:45.145691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cac61-03c0-4b85-9583-a4d943609d52 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:45.146104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cac61-03c0-4b85-9583-a4d943609d52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:45.146104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cac61-03c0-4b85-9583-a4d943609d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:45.147013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cac61-03c0-4b85-9583-a4d943609d52 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:45.157821 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 601/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:45.163849 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404300e0-0fc1-467b-8b13-0fb87f2e7a5b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:45.221840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:45.277605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404300e0-0fc1-467b-8b13-0fb87f2e7a5b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:45.318735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a00c7-61ed-439b-8913-471c3e6a7816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:45.319568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a00c7-61ed-439b-8913-471c3e6a7816 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:45.320011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a00c7-61ed-439b-8913-471c3e6a7816 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:45.320426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a00c7-61ed-439b-8913-471c3e6a7816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:45.333128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a00c7-61ed-439b-8913-471c3e6a7816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:45.334634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a00c7-61ed-439b-8913-471c3e6a7816 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b67a00c7-61ed-439b-8913-471c3e6a7816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:45.353043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:45.354077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:45.355082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:45.355082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:45.355082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:43:45.355082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 609/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:45.360546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cac61-03c0-4b85-9583-a4d943609d52 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:45.501626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:45.504823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cac61-03c0-4b85-9583-a4d943609d52 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:45.544254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b61f79-6693-4ba7-bd2c-030016d304de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:45.545599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b61f79-6693-4ba7-bd2c-030016d304de None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:45.546126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b61f79-6693-4ba7-bd2c-030016d304de None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:45.546562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b61f79-6693-4ba7-bd2c-030016d304de None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:45.547566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b61f79-6693-4ba7-bd2c-030016d304de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:45.548000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b61f79-6693-4ba7-bd2c-030016d304de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:45.549652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b61f79-6693-4ba7-bd2c-030016d304de None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:45.564159 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 602/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:45.570442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a00c7-61ed-439b-8913-471c3e6a7816 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:45.685539 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a00c7-61ed-439b-8913-471c3e6a7816 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:45.687484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:45.726953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d44116-4f06-4184-9971-1a3c16850f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:45.727743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d44116-4f06-4184-9971-1a3c16850f61 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:45.728093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d44116-4f06-4184-9971-1a3c16850f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:45.728418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d44116-4f06-4184-9971-1a3c16850f61 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:45.737099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d44116-4f06-4184-9971-1a3c16850f61 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:45.738590 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d44116-4f06-4184-9971-1a3c16850f61 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-96d44116-4f06-4184-9971-1a3c16850f61 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:45.753467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:45.754937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:45.761068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:45.761068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:45.761068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:45.761068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:45.761068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:45.761068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:45.761068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:45.761068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:45.761068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:43:45.761068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:43:45.761068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 610/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:45.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b61f79-6693-4ba7-bd2c-030016d304de None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:45.887430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b61f79-6693-4ba7-bd2c-030016d304de None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:45.928024 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87524a8-2b5d-4e3f-b500-bddbf8792b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:45.929168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87524a8-2b5d-4e3f-b500-bddbf8792b51 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:45.929428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87524a8-2b5d-4e3f-b500-bddbf8792b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:45.929736 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87524a8-2b5d-4e3f-b500-bddbf8792b51 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:45.930614 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87524a8-2b5d-4e3f-b500-bddbf8792b51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:45.930951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87524a8-2b5d-4e3f-b500-bddbf8792b51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:45.932439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87524a8-2b5d-4e3f-b500-bddbf8792b51 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:45.952516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 603/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Sun Sep 11 00:43:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:45.958491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d44116-4f06-4184-9971-1a3c16850f61 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:46.074611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d44116-4f06-4184-9971-1a3c16850f61 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:46.118641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c74bd8-ab8a-4b29-8069-2137187857d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:46.119575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c74bd8-ab8a-4b29-8069-2137187857d3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.119851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c74bd8-ab8a-4b29-8069-2137187857d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.120122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c74bd8-ab8a-4b29-8069-2137187857d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.159995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:46.207147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c74bd8-ab8a-4b29-8069-2137187857d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:46.209507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c74bd8-ab8a-4b29-8069-2137187857d3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:46.333549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 611/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 00:43:46.335247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87524a8-2b5d-4e3f-b500-bddbf8792b51 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:46.357798 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:46.454140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87524a8-2b5d-4e3f-b500-bddbf8792b51 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:46.492086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874648b6-4f31-4bac-b508-da57c3d87006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:46.492734 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874648b6-4f31-4bac-b508-da57c3d87006 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.493591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874648b6-4f31-4bac-b508-da57c3d87006 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.493892 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874648b6-4f31-4bac-b508-da57c3d87006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.506711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874648b6-4f31-4bac-b508-da57c3d87006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:46.508388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874648b6-4f31-4bac-b508-da57c3d87006 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-874648b6-4f31-4bac-b508-da57c3d87006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:46.525875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:46.527153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:46.528081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:46.528081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:46.528081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:43:46.528081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 604/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:46.532855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c74bd8-ab8a-4b29-8069-2137187857d3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:46.600710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:46.641242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c74bd8-ab8a-4b29-8069-2137187857d3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:46.680751 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f55b4-12ab-4576-a919-dd20ecb4df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:46.681497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f55b4-12ab-4576-a919-dd20ecb4df51 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.681874 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f55b4-12ab-4576-a919-dd20ecb4df51 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.682237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f55b4-12ab-4576-a919-dd20ecb4df51 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.683021 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f55b4-12ab-4576-a919-dd20ecb4df51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:46.683418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f55b4-12ab-4576-a919-dd20ecb4df51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:46.684888 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f55b4-12ab-4576-a919-dd20ecb4df51 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:46.701405 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 612/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:46.702607 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874648b6-4f31-4bac-b508-da57c3d87006 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:46.793200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:46.828998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874648b6-4f31-4bac-b508-da57c3d87006 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:46.872333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad775e32-5a1f-4858-96ae-0eacd9577db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:46.873137 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad775e32-5a1f-4858-96ae-0eacd9577db3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.873514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad775e32-5a1f-4858-96ae-0eacd9577db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.873907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad775e32-5a1f-4858-96ae-0eacd9577db3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.881773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad775e32-5a1f-4858-96ae-0eacd9577db3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:46.883517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad775e32-5a1f-4858-96ae-0eacd9577db3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ad775e32-5a1f-4858-96ae-0eacd9577db3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:46.896409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:46.897620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:46.898760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:46.898760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:46.898760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:46.898760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:46.898760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:46.898760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:46.898760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:46.898760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:43:46.899477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 605/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:46.905311 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f55b4-12ab-4576-a919-dd20ecb4df51 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:47.019875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f55b4-12ab-4576-a919-dd20ecb4df51 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:47.043443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:47.059215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92076d87-fa83-44a2-8d8d-b69ad95b3daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:47.059821 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92076d87-fa83-44a2-8d8d-b69ad95b3daf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:47.060101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92076d87-fa83-44a2-8d8d-b69ad95b3daf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:47.060372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92076d87-fa83-44a2-8d8d-b69ad95b3daf None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:47.061041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92076d87-fa83-44a2-8d8d-b69ad95b3daf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:47.061342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92076d87-fa83-44a2-8d8d-b69ad95b3daf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:47.063044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92076d87-fa83-44a2-8d8d-b69ad95b3daf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:47.078959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 613/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:47.085299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad775e32-5a1f-4858-96ae-0eacd9577db3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:47.198897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad775e32-5a1f-4858-96ae-0eacd9577db3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:47.230544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:47.237064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bad68-a8b3-4d6d-a0e7-e11c99083cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:47.237755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bad68-a8b3-4d6d-a0e7-e11c99083cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:47.238023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bad68-a8b3-4d6d-a0e7-e11c99083cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:47.238288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bad68-a8b3-4d6d-a0e7-e11c99083cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:47.239109 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bad68-a8b3-4d6d-a0e7-e11c99083cb7 None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=1f9f521aa8ce46c982d7ed178e86bcec) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:47.239415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bad68-a8b3-4d6d-a0e7-e11c99083cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:47.240956 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bad68-a8b3-4d6d-a0e7-e11c99083cb7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:47.246525 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 606/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:47 2022] GET /identity/v3/role_assignments?user.id=1f9f521aa8ce46c982d7ed178e86bcec&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:49.539958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b2dfe-7d7b-4636-826a-5c617c9027aa None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:49.540511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b2dfe-7d7b-4636-826a-5c617c9027aa None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:49.540511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b2dfe-7d7b-4636-826a-5c617c9027aa None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:49.541893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 614/1220] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:49.547930 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb00f66-7d8f-4e2d-a246-a84c78857b75 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:49.548352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb00f66-7d8f-4e2d-a246-a84c78857b75 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:49.548546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb00f66-7d8f-4e2d-a246-a84c78857b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:49.570031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ddb00f66-7d8f-4e2d-a246-a84c78857b75 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:49.571283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ddb00f66-7d8f-4e2d-a246-a84c78857b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:49.643376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 607/1221] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:43:49.929544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b2dfe-7d7b-4636-826a-5c617c9027aa None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:50.039018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b2dfe-7d7b-4636-826a-5c617c9027aa None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:50.076223 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3f9ee-75e2-48fc-bea6-c9dd3ec6b805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:50.076878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3f9ee-75e2-48fc-bea6-c9dd3ec6b805 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.077094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3f9ee-75e2-48fc-bea6-c9dd3ec6b805 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.077358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3f9ee-75e2-48fc-bea6-c9dd3ec6b805 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.090238 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3f9ee-75e2-48fc-bea6-c9dd3ec6b805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-57a3f9ee-75e2-48fc-bea6-c9dd3ec6b805 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:50.095104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:50.096249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:50.097102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:50.097102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:50.097102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:50.097102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:50.097102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:50.097102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:50.097102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:50.097102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:50.097102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:50.097102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:50.097102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:50.097102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:43:50.097102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 615/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:50.103007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb00f66-7d8f-4e2d-a246-a84c78857b75 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:50.210499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb00f66-7d8f-4e2d-a246-a84c78857b75 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:50.237828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:50.250540 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bad014-c49e-4ad8-9f12-a1fbadf0279a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:50.251243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bad014-c49e-4ad8-9f12-a1fbadf0279a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.251644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bad014-c49e-4ad8-9f12-a1fbadf0279a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.251916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bad014-c49e-4ad8-9f12-a1fbadf0279a None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.252702 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bad014-c49e-4ad8-9f12-a1fbadf0279a None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:50.253029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bad014-c49e-4ad8-9f12-a1fbadf0279a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:50.254588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bad014-c49e-4ad8-9f12-a1fbadf0279a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:50.263548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 608/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:50.269735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3f9ee-75e2-48fc-bea6-c9dd3ec6b805 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:50.319431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:50.381925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3f9ee-75e2-48fc-bea6-c9dd3ec6b805 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:50.416948 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3dd17-25ec-48f6-a2d7-542b1b11e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:50.417580 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3dd17-25ec-48f6-a2d7-542b1b11e49e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.417852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3dd17-25ec-48f6-a2d7-542b1b11e49e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.418114 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3dd17-25ec-48f6-a2d7-542b1b11e49e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.428454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3dd17-25ec-48f6-a2d7-542b1b11e49e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:50.429905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3dd17-25ec-48f6-a2d7-542b1b11e49e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-13c3dd17-25ec-48f6-a2d7-542b1b11e49e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:50.445687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:50.447319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:50.448504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:50.448504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:50.448504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:43:50.448504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 616/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:50.452766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bad014-c49e-4ad8-9f12-a1fbadf0279a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:50.556577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bad014-c49e-4ad8-9f12-a1fbadf0279a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:50.594696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9400e-e26d-4d69-a113-665bc5e9cd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:50.595381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9400e-e26d-4d69-a113-665bc5e9cd34 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.595721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9400e-e26d-4d69-a113-665bc5e9cd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.596008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9400e-e26d-4d69-a113-665bc5e9cd34 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.596712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9400e-e26d-4d69-a113-665bc5e9cd34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:50.597071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9400e-e26d-4d69-a113-665bc5e9cd34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:50.598649 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9400e-e26d-4d69-a113-665bc5e9cd34 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:50.612167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 609/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:50.618345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3dd17-25ec-48f6-a2d7-542b1b11e49e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:50.719464 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:50.727239 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3dd17-25ec-48f6-a2d7-542b1b11e49e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:50.763647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8899002-21c2-40ae-8184-3eb8fcb72d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:50.764263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8899002-21c2-40ae-8184-3eb8fcb72d5c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.764600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8899002-21c2-40ae-8184-3eb8fcb72d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.764909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8899002-21c2-40ae-8184-3eb8fcb72d5c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.774012 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8899002-21c2-40ae-8184-3eb8fcb72d5c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:50.776338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8899002-21c2-40ae-8184-3eb8fcb72d5c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-f8899002-21c2-40ae-8184-3eb8fcb72d5c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:50.788512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:50.789621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:50.790582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:50.790582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:50.790582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:50.790582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:50.790582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:50.790582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:50.790582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:50.790582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:50.790582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:43:50.790582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:43:50.790582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 617/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:50.795767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9400e-e26d-4d69-a113-665bc5e9cd34 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:50.843716 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:50.896688 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9400e-e26d-4d69-a113-665bc5e9cd34 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:50.931026 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4a6d2-549c-487f-9f3b-1c20f8996462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:50.931627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4a6d2-549c-487f-9f3b-1c20f8996462 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.931898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4a6d2-549c-487f-9f3b-1c20f8996462 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.932161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4a6d2-549c-487f-9f3b-1c20f8996462 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.932879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4a6d2-549c-487f-9f3b-1c20f8996462 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:50.933177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4a6d2-549c-487f-9f3b-1c20f8996462 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:50.934595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4a6d2-549c-487f-9f3b-1c20f8996462 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:50.954618 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 610/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Sun Sep 11 00:43:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:50.961112 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8899002-21c2-40ae-8184-3eb8fcb72d5c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.071192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8899002-21c2-40ae-8184-3eb8fcb72d5c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.108344 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444da07-dad4-4cd8-aa89-711e6b2cf6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.108344 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444da07-dad4-4cd8-aa89-711e6b2cf6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.108661 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444da07-dad4-4cd8-aa89-711e6b2cf6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.108973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444da07-dad4-4cd8-aa89-711e6b2cf6e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.120579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444da07-dad4-4cd8-aa89-711e6b2cf6e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:51.122005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444da07-dad4-4cd8-aa89-711e6b2cf6e2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-6444da07-dad4-4cd8-aa89-711e6b2cf6e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:51.137476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:51.138857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:51.139973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:51.139973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:51.139973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:43:51.139973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 618/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:51.144817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4a6d2-549c-487f-9f3b-1c20f8996462 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.253899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4a6d2-549c-487f-9f3b-1c20f8996462 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.256257 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:51.290478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d94b0-1bad-479f-b3cf-ade44997ef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.291107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d94b0-1bad-479f-b3cf-ade44997ef74 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.291381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d94b0-1bad-479f-b3cf-ade44997ef74 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.291644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d94b0-1bad-479f-b3cf-ade44997ef74 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.292283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d94b0-1bad-479f-b3cf-ade44997ef74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:51.292581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d94b0-1bad-479f-b3cf-ade44997ef74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:51.293940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d94b0-1bad-479f-b3cf-ade44997ef74 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:51.305282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 611/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:51.311598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444da07-dad4-4cd8-aa89-711e6b2cf6e2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.321866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:51.418197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444da07-dad4-4cd8-aa89-711e6b2cf6e2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.455596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0b842-27c1-4ffa-997e-c18ea592583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.456235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0b842-27c1-4ffa-997e-c18ea592583d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.456548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0b842-27c1-4ffa-997e-c18ea592583d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.456867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0b842-27c1-4ffa-997e-c18ea592583d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.464011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0b842-27c1-4ffa-997e-c18ea592583d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:51.465496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0b842-27c1-4ffa-997e-c18ea592583d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-3cc0b842-27c1-4ffa-997e-c18ea592583d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:51.476977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:51.478562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:51.479685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:51.479685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:51.479685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:51.479685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:51.479685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:51.479685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:51.479685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:51.479685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:43:51.479685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 619/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:51.484593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d94b0-1bad-479f-b3cf-ade44997ef74 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.591208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d94b0-1bad-479f-b3cf-ade44997ef74 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.629931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539df0c-7800-4538-9a85-1c91c2aff350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.630508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539df0c-7800-4538-9a85-1c91c2aff350 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.630816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539df0c-7800-4538-9a85-1c91c2aff350 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.631082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539df0c-7800-4538-9a85-1c91c2aff350 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.631762 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539df0c-7800-4538-9a85-1c91c2aff350 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:51.632061 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539df0c-7800-4538-9a85-1c91c2aff350 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:51.633474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539df0c-7800-4538-9a85-1c91c2aff350 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:51.646661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 612/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:51.652770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0b842-27c1-4ffa-997e-c18ea592583d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.723666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:51.760270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0b842-27c1-4ffa-997e-c18ea592583d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.794322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1b36-dcf4-460e-a4d2-0179f65157f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.795059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1b36-dcf4-460e-a4d2-0179f65157f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.795373 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1b36-dcf4-460e-a4d2-0179f65157f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.795615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1b36-dcf4-460e-a4d2-0179f65157f5 None admin] PATH_INFO: `/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/1f9f521aa8ce46c982d7ed178e86bcec/roles/62da722185f844e3acdc4e690c9903b7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.812586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff1b36-dcf4-460e-a4d2-0179f65157f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce5275375bc1421cb3fe6e27d5f685fe, user_id=1f9f521aa8ce46c982d7ed178e86bcec, role_id=62da722185f844e3acdc4e690c9903b7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:51.814120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff1b36-dcf4-460e-a4d2-0179f65157f5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:51.831164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 620/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:43:51 2022] PUT /identity/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/1f9f521aa8ce46c982d7ed178e86bcec/roles/62da722185f844e3acdc4e690c9903b7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:43:54.022001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99ca6e-bd3f-4dac-a24f-77e86cab1e39 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.022563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99ca6e-bd3f-4dac-a24f-77e86cab1e39 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.022563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99ca6e-bd3f-4dac-a24f-77e86cab1e39 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.024095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 613/1233] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:54.030042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774b34b-88c3-4efe-8052-b2c8d604c396 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.030545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774b34b-88c3-4efe-8052-b2c8d604c396 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.030656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774b34b-88c3-4efe-8052-b2c8d604c396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.049473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3774b34b-88c3-4efe-8052-b2c8d604c396 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:54.050745 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3774b34b-88c3-4efe-8052-b2c8d604c396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:54.130761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 621/1234] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:43:54.432922 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99ca6e-bd3f-4dac-a24f-77e86cab1e39 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:54.461694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:54.546023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99ca6e-bd3f-4dac-a24f-77e86cab1e39 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:54.584994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03ae9a-b754-49c2-a7d3-998e5aa2031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:54.585626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03ae9a-b754-49c2-a7d3-998e5aa2031f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.585902 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03ae9a-b754-49c2-a7d3-998e5aa2031f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.586191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03ae9a-b754-49c2-a7d3-998e5aa2031f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.597072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03ae9a-b754-49c2-a7d3-998e5aa2031f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ea03ae9a-b754-49c2-a7d3-998e5aa2031f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:54.603253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:54.604539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:54.605539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:54.605539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:54.605539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:54.605539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:54.605539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:54.605539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:54.605539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:54.605539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:54.605539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:54.605539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:54.605539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:54.605539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:43:54.605539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 614/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:54.611070 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774b34b-88c3-4efe-8052-b2c8d604c396 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:54.662425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:54.718551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774b34b-88c3-4efe-8052-b2c8d604c396 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:54.756142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988068c7-abe3-488a-b8e6-5cf866d70916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:54.756884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988068c7-abe3-488a-b8e6-5cf866d70916 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.757226 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988068c7-abe3-488a-b8e6-5cf866d70916 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.757537 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988068c7-abe3-488a-b8e6-5cf866d70916 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.758269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988068c7-abe3-488a-b8e6-5cf866d70916 None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:54.758588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988068c7-abe3-488a-b8e6-5cf866d70916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:54.760363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988068c7-abe3-488a-b8e6-5cf866d70916 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:54.768687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 622/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:54.775190 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03ae9a-b754-49c2-a7d3-998e5aa2031f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:54.863507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:54.883589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03ae9a-b754-49c2-a7d3-998e5aa2031f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:54.922148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78610987-4355-4e98-bb85-20a167b8c3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:54.923466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78610987-4355-4e98-bb85-20a167b8c3aa None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.923751 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78610987-4355-4e98-bb85-20a167b8c3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.924024 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78610987-4355-4e98-bb85-20a167b8c3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.938064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78610987-4355-4e98-bb85-20a167b8c3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:54.939473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78610987-4355-4e98-bb85-20a167b8c3aa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-78610987-4355-4e98-bb85-20a167b8c3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:54.957982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:54.959352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:54.960330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:54.960330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:54.960330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:43:54.960330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 615/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:54.965640 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988068c7-abe3-488a-b8e6-5cf866d70916 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.086574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988068c7-abe3-488a-b8e6-5cf866d70916 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:55.098230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:55.128149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ed379-4d10-4100-9441-86026bb2fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:55.128669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ed379-4d10-4100-9441-86026bb2fe29 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.129007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ed379-4d10-4100-9441-86026bb2fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.129325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ed379-4d10-4100-9441-86026bb2fe29 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.130026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ed379-4d10-4100-9441-86026bb2fe29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:55.130332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ed379-4d10-4100-9441-86026bb2fe29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:55.131916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ed379-4d10-4100-9441-86026bb2fe29 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:55.144828 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 623/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:55.150843 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78610987-4355-4e98-bb85-20a167b8c3aa None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.267465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78610987-4355-4e98-bb85-20a167b8c3aa None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:55.301346 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcf094-4935-450e-b759-f9da1e7a71a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:55.301961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcf094-4935-450e-b759-f9da1e7a71a5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.302272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcf094-4935-450e-b759-f9da1e7a71a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.302507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcf094-4935-450e-b759-f9da1e7a71a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.305204 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:55.310839 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcf094-4935-450e-b759-f9da1e7a71a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:55.312280 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcf094-4935-450e-b759-f9da1e7a71a5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c4dcf094-4935-450e-b759-f9da1e7a71a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:55.324491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:55.325711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:55.326668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:55.326668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:55.326668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:55.326668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:55.326668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:55.326668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:55.326668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:55.326668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:55.326668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:43:55.326668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:43:55.326668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 616/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:55.332188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ed379-4d10-4100-9441-86026bb2fe29 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.441749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ed379-4d10-4100-9441-86026bb2fe29 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:55.485566 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d4644-cdd0-4993-b4a8-a20fd8d0f140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:55.486309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d4644-cdd0-4993-b4a8-a20fd8d0f140 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.486600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d4644-cdd0-4993-b4a8-a20fd8d0f140 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d4644-cdd0-4993-b4a8-a20fd8d0f140 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.487628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d4644-cdd0-4993-b4a8-a20fd8d0f140 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:55.488002 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d4644-cdd0-4993-b4a8-a20fd8d0f140 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:55.489495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d4644-cdd0-4993-b4a8-a20fd8d0f140 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:55.507415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 624/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Sun Sep 11 00:43:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:55.514819 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcf094-4935-450e-b759-f9da1e7a71a5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.620874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcf094-4935-450e-b759-f9da1e7a71a5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:55.658469 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129da2e7-a1ab-4c5d-95af-55f714d19835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:55.659113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da2e7-a1ab-4c5d-95af-55f714d19835 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.659384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da2e7-a1ab-4c5d-95af-55f714d19835 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.659657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da2e7-a1ab-4c5d-95af-55f714d19835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.726522 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:55.734498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129da2e7-a1ab-4c5d-95af-55f714d19835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:55.736487 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129da2e7-a1ab-4c5d-95af-55f714d19835 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:55.848675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 617/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:43:55.855534 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d4644-cdd0-4993-b4a8-a20fd8d0f140 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.884654 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:55.959058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d4644-cdd0-4993-b4a8-a20fd8d0f140 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:55.998283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a20ad2-1b26-42c6-b60c-79e19463e8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:55.998858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a20ad2-1b26-42c6-b60c-79e19463e8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.999133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a20ad2-1b26-42c6-b60c-79e19463e8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.999398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a20ad2-1b26-42c6-b60c-79e19463e8b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:56.010324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a20ad2-1b26-42c6-b60c-79e19463e8b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:56.011843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a20ad2-1b26-42c6-b60c-79e19463e8b7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-12a20ad2-1b26-42c6-b60c-79e19463e8b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:56.027485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:56.028519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:56.029436 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:56.029436 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:56.029436 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:43:56.029436 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 625/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:56.034374 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129da2e7-a1ab-4c5d-95af-55f714d19835 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:56.151886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:56.158878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129da2e7-a1ab-4c5d-95af-55f714d19835 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:56.194526 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a18416-e8c7-4ecd-820a-0c7fac3c0c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:56.195222 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a18416-e8c7-4ecd-820a-0c7fac3c0c9d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:56.195498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a18416-e8c7-4ecd-820a-0c7fac3c0c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:56.195768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a18416-e8c7-4ecd-820a-0c7fac3c0c9d None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:56.196450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a18416-e8c7-4ecd-820a-0c7fac3c0c9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:56.196749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a18416-e8c7-4ecd-820a-0c7fac3c0c9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:56.198111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a18416-e8c7-4ecd-820a-0c7fac3c0c9d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:56.211481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 618/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:56.218151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a20ad2-1b26-42c6-b60c-79e19463e8b7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:56.300561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:56.322846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a20ad2-1b26-42c6-b60c-79e19463e8b7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:56.356393 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f48a3-2e0c-463d-8754-f7967b148aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:56.357017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f48a3-2e0c-463d-8754-f7967b148aad None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:56.357310 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f48a3-2e0c-463d-8754-f7967b148aad None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:56.357577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f48a3-2e0c-463d-8754-f7967b148aad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:56.365016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f48a3-2e0c-463d-8754-f7967b148aad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:56.367702 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f48a3-2e0c-463d-8754-f7967b148aad None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-985f48a3-2e0c-463d-8754-f7967b148aad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:56.379685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:56.381280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:56.382866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:56.382866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:56.382866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:56.382866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:56.382866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:56.382866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:56.382866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:56.382866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:43:56.382866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 626/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:56.387443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a18416-e8c7-4ecd-820a-0c7fac3c0c9d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:56.501593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a18416-e8c7-4ecd-820a-0c7fac3c0c9d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:56.539113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7ea6-a68a-4438-8b4c-19a902e887ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:56.539723 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7ea6-a68a-4438-8b4c-19a902e887ef None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:56.540040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7ea6-a68a-4438-8b4c-19a902e887ef None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:56.540311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7ea6-a68a-4438-8b4c-19a902e887ef None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:56.540999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7ea6-a68a-4438-8b4c-19a902e887ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:56.541306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7ea6-a68a-4438-8b4c-19a902e887ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:56.542750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7ea6-a68a-4438-8b4c-19a902e887ef None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:56.558774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 619/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:56.563440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f48a3-2e0c-463d-8754-f7967b148aad None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:56.672715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f48a3-2e0c-463d-8754-f7967b148aad None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:56.711069 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fc1df-fa15-42ae-b346-24836b8a34b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:56.711769 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fc1df-fa15-42ae-b346-24836b8a34b5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:56.712126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fc1df-fa15-42ae-b346-24836b8a34b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:56.712360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fc1df-fa15-42ae-b346-24836b8a34b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:56.713094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fc1df-fa15-42ae-b346-24836b8a34b5 None admin] RBAC: Adding query filter params (role.id=62da722185f844e3acdc4e690c9903b7, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=1f9f521aa8ce46c982d7ed178e86bcec) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:56.713391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fc1df-fa15-42ae-b346-24836b8a34b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:56.714880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fc1df-fa15-42ae-b346-24836b8a34b5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:56.720822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 627/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:56 2022] GET /identity/v3/role_assignments?user.id=1f9f521aa8ce46c982d7ed178e86bcec&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=62da722185f844e3acdc4e690c9903b7 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:59.186595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f85fd-cd34-4e14-b120-4d902763eb68 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:59.187174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f85fd-cd34-4e14-b120-4d902763eb68 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:59.187174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f85fd-cd34-4e14-b120-4d902763eb68 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:59.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 620/1247] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:59.194429 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7267669-949f-481a-9972-fa1fc069f034 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:59.194867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7267669-949f-481a-9972-fa1fc069f034 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:59.195098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7267669-949f-481a-9972-fa1fc069f034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:59.201432 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:59.216347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b7267669-949f-481a-9972-fa1fc069f034 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:59.217683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b7267669-949f-481a-9972-fa1fc069f034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:59.292173 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 628/1248] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:43:59.591939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f85fd-cd34-4e14-b120-4d902763eb68 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:59.613246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:59.714203 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f85fd-cd34-4e14-b120-4d902763eb68 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:59.752233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827ccd5-e742-497d-aa40-4373dfbc6c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:59.752857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827ccd5-e742-497d-aa40-4373dfbc6c0c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:59.753129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827ccd5-e742-497d-aa40-4373dfbc6c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:59.753393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827ccd5-e742-497d-aa40-4373dfbc6c0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:59.763998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827ccd5-e742-497d-aa40-4373dfbc6c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1827ccd5-e742-497d-aa40-4373dfbc6c0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:59.768732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:59.769847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:59.770940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:59.770940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:59.770940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:59.770940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:59.770940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:59.770940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:59.770940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:59.770940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:59.770940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:59.770940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:59.770940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:59.770940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:43:59.770940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 621/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:59.776864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7267669-949f-481a-9972-fa1fc069f034 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:59.876236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7267669-949f-481a-9972-fa1fc069f034 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:59.906584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:59.912136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0dd91-927d-412d-ae7f-52076bcf619e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:59.912748 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0dd91-927d-412d-ae7f-52076bcf619e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:59.913024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0dd91-927d-412d-ae7f-52076bcf619e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:59.913297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0dd91-927d-412d-ae7f-52076bcf619e None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:59.913996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0dd91-927d-412d-ae7f-52076bcf619e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:59.914270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0dd91-927d-412d-ae7f-52076bcf619e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:59.915951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0dd91-927d-412d-ae7f-52076bcf619e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:59.925440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 629/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:59.932052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827ccd5-e742-497d-aa40-4373dfbc6c0c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:00.016627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:00.041641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827ccd5-e742-497d-aa40-4373dfbc6c0c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:00.081195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95658c9e-8a80-454c-806a-b613624fee34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:00.081856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95658c9e-8a80-454c-806a-b613624fee34 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:00.082186 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95658c9e-8a80-454c-806a-b613624fee34 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:00.082542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95658c9e-8a80-454c-806a-b613624fee34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:00.094252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95658c9e-8a80-454c-806a-b613624fee34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:00.095788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95658c9e-8a80-454c-806a-b613624fee34 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-95658c9e-8a80-454c-806a-b613624fee34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:00.112007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:00.113235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:00.114324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:00.114324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:00.114324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:44:00.114324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 622/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:00.120104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0dd91-927d-412d-ae7f-52076bcf619e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:00.230085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0dd91-927d-412d-ae7f-52076bcf619e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:00.263322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3451c1-9832-4c61-a567-4f2c18c88074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:00.263896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3451c1-9832-4c61-a567-4f2c18c88074 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:00.264169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3451c1-9832-4c61-a567-4f2c18c88074 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:00.264442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3451c1-9832-4c61-a567-4f2c18c88074 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:00.265077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3451c1-9832-4c61-a567-4f2c18c88074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:00.265392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3451c1-9832-4c61-a567-4f2c18c88074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:00.266772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3451c1-9832-4c61-a567-4f2c18c88074 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:00.279035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 630/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:00.284543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95658c9e-8a80-454c-806a-b613624fee34 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:00.398911 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95658c9e-8a80-454c-806a-b613624fee34 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:00.428796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:00.439668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0b51e-301a-464f-819d-72d688b44f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:00.440463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b51e-301a-464f-819d-72d688b44f38 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:00.440867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b51e-301a-464f-819d-72d688b44f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:00.441162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b51e-301a-464f-819d-72d688b44f38 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:00.449486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0b51e-301a-464f-819d-72d688b44f38 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:00.450991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0b51e-301a-464f-819d-72d688b44f38 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-57e0b51e-301a-464f-819d-72d688b44f38 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:44:00.462278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:00.463327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:00.464271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:00.464271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:00.464271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:44:00.464271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:44:00.464271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:44:00.464271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:44:00.464271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:44:00.464271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:44:00.464271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:44:00.464271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:44:00.464271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 623/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:00.469650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3451c1-9832-4c61-a567-4f2c18c88074 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:00.530402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:00.576149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3451c1-9832-4c61-a567-4f2c18c88074 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:00.611384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c241941-43ff-463b-ac13-003fe6ca00e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:00.612032 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c241941-43ff-463b-ac13-003fe6ca00e5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:00.612344 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c241941-43ff-463b-ac13-003fe6ca00e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:00.612633 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c241941-43ff-463b-ac13-003fe6ca00e5 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:00.613354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c241941-43ff-463b-ac13-003fe6ca00e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:00.613654 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c241941-43ff-463b-ac13-003fe6ca00e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:00.615115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c241941-43ff-463b-ac13-003fe6ca00e5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:00.632656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 631/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Sun Sep 11 00:44:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:00.639351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0b51e-301a-464f-819d-72d688b44f38 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:00.748937 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0b51e-301a-464f-819d-72d688b44f38 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:00.792195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90b598-e672-4d75-bf26-534ee7a4ced6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:00.792730 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90b598-e672-4d75-bf26-534ee7a4ced6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:00.793003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90b598-e672-4d75-bf26-534ee7a4ced6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:00.793270 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90b598-e672-4d75-bf26-534ee7a4ced6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:00.853002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:00.866130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90b598-e672-4d75-bf26-534ee7a4ced6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:00.867625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90b598-e672-4d75-bf26-534ee7a4ced6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:00.982617 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 624/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:44:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:44:00.988668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c241941-43ff-463b-ac13-003fe6ca00e5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:01.095488 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c241941-43ff-463b-ac13-003fe6ca00e5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:01.112072 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:01.135074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1a2bf-1226-462a-930f-bf8015f41ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:01.135711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a2bf-1226-462a-930f-bf8015f41ddd None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:01.135989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a2bf-1226-462a-930f-bf8015f41ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:01.136258 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a2bf-1226-462a-930f-bf8015f41ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:01.147052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1a2bf-1226-462a-930f-bf8015f41ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:01.148510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1a2bf-1226-462a-930f-bf8015f41ddd None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b0a1a2bf-1226-462a-930f-bf8015f41ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:01.163966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:01.165627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:01.166568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:01.166568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:01.166568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:01.166568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 632/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:01.171501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90b598-e672-4d75-bf26-534ee7a4ced6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:01.260049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:01.272944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90b598-e672-4d75-bf26-534ee7a4ced6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:01.307293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbcebd-3641-435e-b6c3-2b5d4e5278df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:01.307929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbcebd-3641-435e-b6c3-2b5d4e5278df None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:01.308153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbcebd-3641-435e-b6c3-2b5d4e5278df None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:01.308416 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbcebd-3641-435e-b6c3-2b5d4e5278df None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:01.309047 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbcebd-3641-435e-b6c3-2b5d4e5278df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:01.309341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbcebd-3641-435e-b6c3-2b5d4e5278df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:01.310689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbcebd-3641-435e-b6c3-2b5d4e5278df None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:01.322822 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 625/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:01.328550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1a2bf-1226-462a-930f-bf8015f41ddd None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:01.434878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1a2bf-1226-462a-930f-bf8015f41ddd None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:01.467835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1bc66-d472-498f-860c-1a2444319bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:01.468485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1bc66-d472-498f-860c-1a2444319bea None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:01.468762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1bc66-d472-498f-860c-1a2444319bea None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:01.469029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1bc66-d472-498f-860c-1a2444319bea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:01.475376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1bc66-d472-498f-860c-1a2444319bea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:01.476793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1bc66-d472-498f-860c-1a2444319bea None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-f9b1bc66-d472-498f-860c-1a2444319bea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:44:01.488241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:01.489314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:01.490551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:44:01.490551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:44:01.490551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:44:01.490551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:44:01.490551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:44:01.490551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:44:01.490551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:01.490551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:01.490551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 633/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:44:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:01.495690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbcebd-3641-435e-b6c3-2b5d4e5278df None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:01.595208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbcebd-3641-435e-b6c3-2b5d4e5278df None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:01.630059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dc847-dc46-444e-bb13-26c225cb66cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:01.630653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dc847-dc46-444e-bb13-26c225cb66cc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:01.630959 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dc847-dc46-444e-bb13-26c225cb66cc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:01.631228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dc847-dc46-444e-bb13-26c225cb66cc None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:01.631908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dc847-dc46-444e-bb13-26c225cb66cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:01.632211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dc847-dc46-444e-bb13-26c225cb66cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:01.633632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dc847-dc46-444e-bb13-26c225cb66cc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:01.645180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 626/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:44:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:01.651836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1bc66-d472-498f-860c-1a2444319bea None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:01.677028 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:01.747752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1bc66-d472-498f-860c-1a2444319bea None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:01.779430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152903b-f0ca-49de-b195-d989de9dc32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:01.780003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152903b-f0ca-49de-b195-d989de9dc32a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:01.780274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152903b-f0ca-49de-b195-d989de9dc32a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:01.780536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152903b-f0ca-49de-b195-d989de9dc32a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:01.781241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152903b-f0ca-49de-b195-d989de9dc32a None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=1f9f521aa8ce46c982d7ed178e86bcec) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:01.781540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152903b-f0ca-49de-b195-d989de9dc32a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:01.782963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152903b-f0ca-49de-b195-d989de9dc32a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:01.788030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 634/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:44:01 2022] GET /identity/v3/role_assignments?user.id=1f9f521aa8ce46c982d7ed178e86bcec&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:03.900510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7defe-5292-4f06-b3f2-7686b5e8be86 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:03.901024 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7defe-5292-4f06-b3f2-7686b5e8be86 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:03.901024 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7defe-5292-4f06-b3f2-7686b5e8be86 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:03.902360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 627/1261] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:03.907442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1274db4-aa0c-4301-8885-985734b52144 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:03.907863 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1274db4-aa0c-4301-8885-985734b52144 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:03.907990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1274db4-aa0c-4301-8885-985734b52144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:03.926189 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a1274db4-aa0c-4301-8885-985734b52144 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:03.927385 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a1274db4-aa0c-4301-8885-985734b52144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:04.002976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 635/1262] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:04.282229 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7defe-5292-4f06-b3f2-7686b5e8be86 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:04.293742 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:04.384955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7defe-5292-4f06-b3f2-7686b5e8be86 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:04.417730 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbccad1-e792-4c37-8519-495b369635dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:04.418341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbccad1-e792-4c37-8519-495b369635dc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:04.418611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbccad1-e792-4c37-8519-495b369635dc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:04.418921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbccad1-e792-4c37-8519-495b369635dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:04.429180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbccad1-e792-4c37-8519-495b369635dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2dbccad1-e792-4c37-8519-495b369635dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:44:04.434661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:04.435675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:04.436594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:04.436594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:04.436594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:04.436594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:04.436594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:44:04.436594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:44:04.436594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:44:04.436594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:44:04.436594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:44:04.436594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:44:04.436594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:44:04.436594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:44:04.436594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 628/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:44:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:04.442870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1274db4-aa0c-4301-8885-985734b52144 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:04.465529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:04.556998 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1274db4-aa0c-4301-8885-985734b52144 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:04.597197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aa8fc-5549-431d-aef6-bc2e3d9a50e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:04.597795 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aa8fc-5549-431d-aef6-bc2e3d9a50e1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:04.598069 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aa8fc-5549-431d-aef6-bc2e3d9a50e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:04.598333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aa8fc-5549-431d-aef6-bc2e3d9a50e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:04.599015 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640aa8fc-5549-431d-aef6-bc2e3d9a50e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:04.599313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640aa8fc-5549-431d-aef6-bc2e3d9a50e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:04.600643 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640aa8fc-5549-431d-aef6-bc2e3d9a50e1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:04.609005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 636/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:44:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:04.614747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbccad1-e792-4c37-8519-495b369635dc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:04.680979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:04.715306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbccad1-e792-4c37-8519-495b369635dc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:04.750864 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea388c-d6b9-4e30-95d1-839a1845b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:04.751952 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea388c-d6b9-4e30-95d1-839a1845b088 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:04.752249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea388c-d6b9-4e30-95d1-839a1845b088 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:04.752519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea388c-d6b9-4e30-95d1-839a1845b088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:04.762708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea388c-d6b9-4e30-95d1-839a1845b088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:04.764180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea388c-d6b9-4e30-95d1-839a1845b088 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a7ea388c-d6b9-4e30-95d1-839a1845b088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:04.779119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:04.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:04.781176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:04.781176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:04.781176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:44:04.781176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 629/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:04.786063 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aa8fc-5549-431d-aef6-bc2e3d9a50e1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:04.870647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:04.889133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aa8fc-5549-431d-aef6-bc2e3d9a50e1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:04.920719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ff501-a0f1-4730-baf8-5b254f9200ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:04.921288 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ff501-a0f1-4730-baf8-5b254f9200ef None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:04.921570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ff501-a0f1-4730-baf8-5b254f9200ef None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:04.921835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ff501-a0f1-4730-baf8-5b254f9200ef None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:04.922459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ff501-a0f1-4730-baf8-5b254f9200ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:04.922774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ff501-a0f1-4730-baf8-5b254f9200ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:04.924120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ff501-a0f1-4730-baf8-5b254f9200ef None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:04.935282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 637/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:04.941306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea388c-d6b9-4e30-95d1-839a1845b088 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:05.037990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea388c-d6b9-4e30-95d1-839a1845b088 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:05.056811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:05.071249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18c10f-cf27-43d7-810c-564eec4be78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:05.072419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18c10f-cf27-43d7-810c-564eec4be78d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.072786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18c10f-cf27-43d7-810c-564eec4be78d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.072980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18c10f-cf27-43d7-810c-564eec4be78d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.080856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18c10f-cf27-43d7-810c-564eec4be78d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:05.082278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18c10f-cf27-43d7-810c-564eec4be78d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5a18c10f-cf27-43d7-810c-564eec4be78d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:44:05.095341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:05.096312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:05.097534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:05.097534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:05.097534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:44:05.097534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:44:05.097534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:44:05.097534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:44:05.097534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:44:05.097534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:44:05.097534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:44:05.097534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:44:05.097534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 630/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:05.102530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ff501-a0f1-4730-baf8-5b254f9200ef None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:05.198180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ff501-a0f1-4730-baf8-5b254f9200ef None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:05.229885 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd02aa-051c-4cc5-bd5c-432cce21373e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:05.230474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd02aa-051c-4cc5-bd5c-432cce21373e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.230770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd02aa-051c-4cc5-bd5c-432cce21373e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.231043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd02aa-051c-4cc5-bd5c-432cce21373e None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.231757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd02aa-051c-4cc5-bd5c-432cce21373e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:05.232060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd02aa-051c-4cc5-bd5c-432cce21373e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:05.233494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd02aa-051c-4cc5-bd5c-432cce21373e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:05.241779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:05.250490 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 638/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Sun Sep 11 00:44:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:05.256212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18c10f-cf27-43d7-810c-564eec4be78d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:05.352178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18c10f-cf27-43d7-810c-564eec4be78d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:05.385022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254dfd4-98a5-4bf8-ba48-dfe6c1a31102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:05.385633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254dfd4-98a5-4bf8-ba48-dfe6c1a31102 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.385908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254dfd4-98a5-4bf8-ba48-dfe6c1a31102 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.386171 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254dfd4-98a5-4bf8-ba48-dfe6c1a31102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.396252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254dfd4-98a5-4bf8-ba48-dfe6c1a31102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:05.397676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254dfd4-98a5-4bf8-ba48-dfe6c1a31102 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3254dfd4-98a5-4bf8-ba48-dfe6c1a31102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:05.411410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:05.412524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:05.413661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:05.413661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:05.413661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:44:05.413661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 631/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:05.418080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd02aa-051c-4cc5-bd5c-432cce21373e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:05.513850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd02aa-051c-4cc5-bd5c-432cce21373e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:05.545689 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134be1a-ca98-4e74-ada7-d8bf44173199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:05.546280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134be1a-ca98-4e74-ada7-d8bf44173199 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.546561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134be1a-ca98-4e74-ada7-d8bf44173199 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.546861 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134be1a-ca98-4e74-ada7-d8bf44173199 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.547499 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134be1a-ca98-4e74-ada7-d8bf44173199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:05.547801 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134be1a-ca98-4e74-ada7-d8bf44173199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:05.549148 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134be1a-ca98-4e74-ada7-d8bf44173199 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:05.560366 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 639/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:05.566217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254dfd4-98a5-4bf8-ba48-dfe6c1a31102 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:05.596980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:05.663735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254dfd4-98a5-4bf8-ba48-dfe6c1a31102 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:05.696627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb2ec5-2b51-4c88-a9a8-76a83ebf883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:05.697236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb2ec5-2b51-4c88-a9a8-76a83ebf883e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.697507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb2ec5-2b51-4c88-a9a8-76a83ebf883e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.697766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb2ec5-2b51-4c88-a9a8-76a83ebf883e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.704103 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb2ec5-2b51-4c88-a9a8-76a83ebf883e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:05.705552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb2ec5-2b51-4c88-a9a8-76a83ebf883e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-27eb2ec5-2b51-4c88-a9a8-76a83ebf883e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:44:05.716483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:05.717512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:05.718455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:44:05.718455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:44:05.718455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:44:05.718455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:44:05.718455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:44:05.718455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:44:05.718455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:05.718455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:44:05.718455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 632/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:44:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:05.723325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134be1a-ca98-4e74-ada7-d8bf44173199 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:05.779293 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:05.821578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134be1a-ca98-4e74-ada7-d8bf44173199 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:05.853373 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51955f55-1bf8-4293-bf73-faa8dc981f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:05.853967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51955f55-1bf8-4293-bf73-faa8dc981f40 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.854242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51955f55-1bf8-4293-bf73-faa8dc981f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.854509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51955f55-1bf8-4293-bf73-faa8dc981f40 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.855219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51955f55-1bf8-4293-bf73-faa8dc981f40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:05.855523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51955f55-1bf8-4293-bf73-faa8dc981f40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:05.856926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51955f55-1bf8-4293-bf73-faa8dc981f40 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:05.869473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 640/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:44:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:05.875479 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb2ec5-2b51-4c88-a9a8-76a83ebf883e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:05.963570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:05.972260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb2ec5-2b51-4c88-a9a8-76a83ebf883e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:06.004799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc265bfb-ddcc-4e30-a420-15209db66a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:06.005438 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc265bfb-ddcc-4e30-a420-15209db66a50 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:06.005714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc265bfb-ddcc-4e30-a420-15209db66a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:06.005981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc265bfb-ddcc-4e30-a420-15209db66a50 None admin] PATH_INFO: `/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/1f9f521aa8ce46c982d7ed178e86bcec/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:06.007837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc265bfb-ddcc-4e30-a420-15209db66a50 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce5275375bc1421cb3fe6e27d5f685fe, user_id=1f9f521aa8ce46c982d7ed178e86bcec, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:06.009302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc265bfb-ddcc-4e30-a420-15209db66a50 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:06.021199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 633/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Sun Sep 11 00:44:05 2022] PUT /identity/v3/projects/ce5275375bc1421cb3fe6e27d5f685fe/users/1f9f521aa8ce46c982d7ed178e86bcec/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:44:08.121325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec025e58-2eb7-4c57-ad39-f69dfe66b2e9 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.121929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec025e58-2eb7-4c57-ad39-f69dfe66b2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.121929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec025e58-2eb7-4c57-ad39-f69dfe66b2e9 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.123227 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 641/1274] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:08.128561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28915-d827-4260-b581-63e12d2a9e9f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.128978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28915-d827-4260-b581-63e12d2a9e9f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.129184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28915-d827-4260-b581-63e12d2a9e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.147593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4db28915-d827-4260-b581-63e12d2a9e9f None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:08.148765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4db28915-d827-4260-b581-63e12d2a9e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:08.213352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 634/1275] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:08.486359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec025e58-2eb7-4c57-ad39-f69dfe66b2e9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:08.585404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec025e58-2eb7-4c57-ad39-f69dfe66b2e9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:08.601926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:08.619274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da308f0d-542e-48db-bbdd-a94ca95a8e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:08.619884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da308f0d-542e-48db-bbdd-a94ca95a8e3c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.620185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da308f0d-542e-48db-bbdd-a94ca95a8e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.620447 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da308f0d-542e-48db-bbdd-a94ca95a8e3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.630098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da308f0d-542e-48db-bbdd-a94ca95a8e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-da308f0d-542e-48db-bbdd-a94ca95a8e3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:44:08.634971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:08.636111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:08.637321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:08.637321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:08.637321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:08.637321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:08.637321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:44:08.637321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:44:08.637321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:44:08.637321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:44:08.637321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:44:08.637321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:44:08.637321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:44:08.637321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:08.637321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 642/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Sun Sep 11 00:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:08.641877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db28915-d827-4260-b581-63e12d2a9e9f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:08.720144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:08.738041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db28915-d827-4260-b581-63e12d2a9e9f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:08.770481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36a06d-bce6-4f5c-bcf5-3bf62aaafeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:08.771094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36a06d-bce6-4f5c-bcf5-3bf62aaafeee None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.771369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36a06d-bce6-4f5c-bcf5-3bf62aaafeee None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.771633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36a06d-bce6-4f5c-bcf5-3bf62aaafeee None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.772282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36a06d-bce6-4f5c-bcf5-3bf62aaafeee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:08.772577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36a06d-bce6-4f5c-bcf5-3bf62aaafeee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:08.773926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36a06d-bce6-4f5c-bcf5-3bf62aaafeee None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:08.781699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 635/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Sun Sep 11 00:44:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:08.787533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da308f0d-542e-48db-bbdd-a94ca95a8e3c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:08.884753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da308f0d-542e-48db-bbdd-a94ca95a8e3c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:08.917205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8270677-daa0-448a-b491-2e0bf1f2d45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:08.917812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8270677-daa0-448a-b491-2e0bf1f2d45b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.918091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8270677-daa0-448a-b491-2e0bf1f2d45b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.918364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8270677-daa0-448a-b491-2e0bf1f2d45b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.927978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8270677-daa0-448a-b491-2e0bf1f2d45b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:08.929408 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8270677-daa0-448a-b491-2e0bf1f2d45b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-f8270677-daa0-448a-b491-2e0bf1f2d45b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:08.943718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:08.944912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:08.946083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:08.946083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:08.946083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:08.946083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 643/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:08.950454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36a06d-bce6-4f5c-bcf5-3bf62aaafeee None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.048048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36a06d-bce6-4f5c-bcf5-3bf62aaafeee None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:09.081276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ebcf5-6451-4b3f-b1d2-f9338ef4aabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:09.081868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ebcf5-6451-4b3f-b1d2-f9338ef4aabf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:09.082148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ebcf5-6451-4b3f-b1d2-f9338ef4aabf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:09.082416 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ebcf5-6451-4b3f-b1d2-f9338ef4aabf None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:09.083069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ebcf5-6451-4b3f-b1d2-f9338ef4aabf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:09.083364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ebcf5-6451-4b3f-b1d2-f9338ef4aabf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:09.084713 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ebcf5-6451-4b3f-b1d2-f9338ef4aabf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:09.096916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 636/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:09.103869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8270677-daa0-448a-b491-2e0bf1f2d45b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.136260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:09.203794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8270677-daa0-448a-b491-2e0bf1f2d45b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:09.235491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8a80f-2d2e-45ab-a991-c008130528af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:09.236104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8a80f-2d2e-45ab-a991-c008130528af None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:09.236382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8a80f-2d2e-45ab-a991-c008130528af None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:09.236649 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8a80f-2d2e-45ab-a991-c008130528af None admin] PATH_INFO: `/v3/users/placement` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:09.244239 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8a80f-2d2e-45ab-a991-c008130528af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:09.245651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8a80f-2d2e-45ab-a991-c008130528af None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-c2b8a80f-2d2e-45ab-a991-c008130528af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:44:09.256468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:09.257604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:09.258576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:09.258576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:09.258576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:44:09.258576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:44:09.258576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:44:09.258576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:44:09.258576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:44:09.258576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:44:09.258576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:44:09.258576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:09.258576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 644/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:09.264025 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ebcf5-6451-4b3f-b1d2-f9338ef4aabf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.267771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:09.359682 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ebcf5-6451-4b3f-b1d2-f9338ef4aabf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:09.397402 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c27c46-03b7-4d01-910a-fea1387dd8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:09.397999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c27c46-03b7-4d01-910a-fea1387dd8cf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:09.398274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c27c46-03b7-4d01-910a-fea1387dd8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:09.398544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c27c46-03b7-4d01-910a-fea1387dd8cf None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:09.399301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c27c46-03b7-4d01-910a-fea1387dd8cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:09.399604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c27c46-03b7-4d01-910a-fea1387dd8cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:09.402023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c27c46-03b7-4d01-910a-fea1387dd8cf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:09.419961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 637/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Sun Sep 11 00:44:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:09.425810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8a80f-2d2e-45ab-a991-c008130528af None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.513775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:09.522860 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8a80f-2d2e-45ab-a991-c008130528af None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:09.555589 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9a474-b9c2-4818-b2bb-a86d2414cc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:09.556717 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9a474-b9c2-4818-b2bb-a86d2414cc49 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:09.556993 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9a474-b9c2-4818-b2bb-a86d2414cc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:09.557259 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9a474-b9c2-4818-b2bb-a86d2414cc49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:09.621690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9a474-b9c2-4818-b2bb-a86d2414cc49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:09.623086 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9a474-b9c2-4818-b2bb-a86d2414cc49 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:09.706965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:09.717448 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 645/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Sun Sep 11 00:44:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:44:09.723434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c27c46-03b7-4d01-910a-fea1387dd8cf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.782679 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:09.820609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c27c46-03b7-4d01-910a-fea1387dd8cf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:09.854036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd9aed-9ee7-4b73-bc74-d09442648330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:09.854651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd9aed-9ee7-4b73-bc74-d09442648330 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:09.854954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd9aed-9ee7-4b73-bc74-d09442648330 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:09.855224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd9aed-9ee7-4b73-bc74-d09442648330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:09.865333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd9aed-9ee7-4b73-bc74-d09442648330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:09.866846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd9aed-9ee7-4b73-bc74-d09442648330 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1ecd9aed-9ee7-4b73-bc74-d09442648330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:09.881212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:09.882311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:09.883532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:09.883532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:09.883532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:44:09.883532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 638/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:09.888107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9a474-b9c2-4818-b2bb-a86d2414cc49 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.982911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9a474-b9c2-4818-b2bb-a86d2414cc49 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:10.016290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d332e6-da0a-4864-b855-3430ddd6f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:10.016879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d332e6-da0a-4864-b855-3430ddd6f57c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:10.017158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d332e6-da0a-4864-b855-3430ddd6f57c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:10.017426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d332e6-da0a-4864-b855-3430ddd6f57c None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:10.018059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d332e6-da0a-4864-b855-3430ddd6f57c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:10.018358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d332e6-da0a-4864-b855-3430ddd6f57c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:10.019725 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d332e6-da0a-4864-b855-3430ddd6f57c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:10.030484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 646/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:10.035950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd9aed-9ee7-4b73-bc74-d09442648330 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:10.133298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd9aed-9ee7-4b73-bc74-d09442648330 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:10.146107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:10.166022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b128baa-9056-41c2-8caf-cf1f2dbb45c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:10.166639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b128baa-9056-41c2-8caf-cf1f2dbb45c0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:10.166941 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b128baa-9056-41c2-8caf-cf1f2dbb45c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:10.167211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b128baa-9056-41c2-8caf-cf1f2dbb45c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:10.173632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b128baa-9056-41c2-8caf-cf1f2dbb45c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:10.175097 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b128baa-9056-41c2-8caf-cf1f2dbb45c0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4b128baa-9056-41c2-8caf-cf1f2dbb45c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:44:10.186563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:10.187645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:10.188820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:44:10.188820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:44:10.188820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:44:10.188820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:44:10.188820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:44:10.188820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:44:10.188820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:10.188820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 11 00:44:10.188820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 639/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Sun Sep 11 00:44:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:10.193729 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d332e6-da0a-4864-b855-3430ddd6f57c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:10.241270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:10.288540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d332e6-da0a-4864-b855-3430ddd6f57c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:10.320977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63778b-acb5-4295-9362-d3b794da3186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:10.321560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63778b-acb5-4295-9362-d3b794da3186 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:10.321864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63778b-acb5-4295-9362-d3b794da3186 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:10.322135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63778b-acb5-4295-9362-d3b794da3186 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:10.322846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63778b-acb5-4295-9362-d3b794da3186 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:10.323150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63778b-acb5-4295-9362-d3b794da3186 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:10.324565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63778b-acb5-4295-9362-d3b794da3186 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:10.335839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 647/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Sun Sep 11 00:44:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:10.341765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b128baa-9056-41c2-8caf-cf1f2dbb45c0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:10.438560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b128baa-9056-41c2-8caf-cf1f2dbb45c0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:10.470708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8fa43-5de7-480f-9e5d-a26a5f87ca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:10.471327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8fa43-5de7-480f-9e5d-a26a5f87ca61 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:10.471600 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8fa43-5de7-480f-9e5d-a26a5f87ca61 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:10.471866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8fa43-5de7-480f-9e5d-a26a5f87ca61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:10.472573 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8fa43-5de7-480f-9e5d-a26a5f87ca61 None admin] RBAC: Adding query filter params (role.id=36c98abb38594a2f8c43a4ec8c919b20, scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe, user.id=1f9f521aa8ce46c982d7ed178e86bcec) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:10.472873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8fa43-5de7-480f-9e5d-a26a5f87ca61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:10.474287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8fa43-5de7-480f-9e5d-a26a5f87ca61 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:10.480420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 640/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Sun Sep 11 00:44:10 2022] GET /identity/v3/role_assignments?user.id=1f9f521aa8ce46c982d7ed178e86bcec&scope.project.id=ce5275375bc1421cb3fe6e27d5f685fe&role.id=36c98abb38594a2f8c43a4ec8c919b20 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:12.609340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab4c01-34c2-4631-b01d-ac8e71cb4908 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:12.609889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab4c01-34c2-4631-b01d-ac8e71cb4908 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:12.609889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab4c01-34c2-4631-b01d-ac8e71cb4908 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:12.611313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 648/1288] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:12.616660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0c37d-2c4a-4223-abd3-9b4fad7f394f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:12.617122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0c37d-2c4a-4223-abd3-9b4fad7f394f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:12.617253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0c37d-2c4a-4223-abd3-9b4fad7f394f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:12.636347 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-38f0c37d-2c4a-4223-abd3-9b4fad7f394f None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:12.637525 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-38f0c37d-2c4a-4223-abd3-9b4fad7f394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:12.666180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:12.703510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 641/1289] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:12.967432 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab4c01-34c2-4631-b01d-ac8e71cb4908 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:13.065992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab4c01-34c2-4631-b01d-ac8e71cb4908 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:13.078546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:13.103838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84762a39-8479-4317-a42f-819996c3410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:13.104453 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84762a39-8479-4317-a42f-819996c3410c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:13.104733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84762a39-8479-4317-a42f-819996c3410c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:13.104994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84762a39-8479-4317-a42f-819996c3410c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:13.105566 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84762a39-8479-4317-a42f-819996c3410c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:13.106931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84762a39-8479-4317-a42f-819996c3410c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-84762a39-8479-4317-a42f-819996c3410c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:13.116045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:13.117320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:13.118374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 649/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Sun Sep 11 00:44:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:13.123924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0c37d-2c4a-4223-abd3-9b4fad7f394f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:13.225443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0c37d-2c4a-4223-abd3-9b4fad7f394f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:13.257889 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100d9dc-51c6-4bfe-948f-a3466deb4a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:13.258487 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100d9dc-51c6-4bfe-948f-a3466deb4a8c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:13.258785 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100d9dc-51c6-4bfe-948f-a3466deb4a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:13.259055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100d9dc-51c6-4bfe-948f-a3466deb4a8c None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:13.260167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100d9dc-51c6-4bfe-948f-a3466deb4a8c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:13.260465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100d9dc-51c6-4bfe-948f-a3466deb4a8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:13.261817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100d9dc-51c6-4bfe-948f-a3466deb4a8c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:13.266454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 642/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Sun Sep 11 00:44:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:13.272374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84762a39-8479-4317-a42f-819996c3410c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:13.368472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84762a39-8479-4317-a42f-819996c3410c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:13.400485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cabc3-a821-4621-b82b-d14d5999b232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:13.401062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cabc3-a821-4621-b82b-d14d5999b232 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:13.401342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cabc3-a821-4621-b82b-d14d5999b232 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:13.401614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cabc3-a821-4621-b82b-d14d5999b232 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:13.402232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cabc3-a821-4621-b82b-d14d5999b232 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:13.402532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cabc3-a821-4621-b82b-d14d5999b232 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:13.403904 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cabc3-a821-4621-b82b-d14d5999b232 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:13.408127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 650/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Sun Sep 11 00:44:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:15.556748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd75a2f-8e83-4ab1-9e6f-0ee8202bd89d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:15.557300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd75a2f-8e83-4ab1-9e6f-0ee8202bd89d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:15.557300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd75a2f-8e83-4ab1-9e6f-0ee8202bd89d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:15.558629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 643/1293] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:15.564248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c38b2-f994-440b-a6ba-0cf568a13657 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:15.564617 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c38b2-f994-440b-a6ba-0cf568a13657 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:15.564818 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c38b2-f994-440b-a6ba-0cf568a13657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:15.583835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d83c38b2-f994-440b-a6ba-0cf568a13657 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:15.585002 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d83c38b2-f994-440b-a6ba-0cf568a13657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:15.613864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:15.651441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 651/1294] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:15.918671 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd75a2f-8e83-4ab1-9e6f-0ee8202bd89d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:15.952014 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:16.025591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd75a2f-8e83-4ab1-9e6f-0ee8202bd89d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:16.058448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774051f-d9bc-40cd-81c4-4994b991ee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:16.059074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774051f-d9bc-40cd-81c4-4994b991ee7d None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:16.059351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774051f-d9bc-40cd-81c4-4994b991ee7d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:16.059619 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774051f-d9bc-40cd-81c4-4994b991ee7d None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:16.060262 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774051f-d9bc-40cd-81c4-4994b991ee7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:16.061627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774051f-d9bc-40cd-81c4-4994b991ee7d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:16.076937 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 644/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Sun Sep 11 00:44:15 2022] POST /identity/v3/services => generated 246 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:44:18.222076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2e640-6eba-4185-9ea6-a82a123ac91e None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:18.222644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2e640-6eba-4185-9ea6-a82a123ac91e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:18.222644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2e640-6eba-4185-9ea6-a82a123ac91e None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:18.223953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 652/1296] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:18.229091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a65e7a-6d8f-4473-8f47-eb12529b1016 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:18.229514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a65e7a-6d8f-4473-8f47-eb12529b1016 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:18.229637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a65e7a-6d8f-4473-8f47-eb12529b1016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:18.248021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f5a65e7a-6d8f-4473-8f47-eb12529b1016 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:18.249186 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f5a65e7a-6d8f-4473-8f47-eb12529b1016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:18.320107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 645/1297] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:18.593503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2e640-6eba-4185-9ea6-a82a123ac91e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:18.690869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2e640-6eba-4185-9ea6-a82a123ac91e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:18.723014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bafbeb-1c13-4133-95c8-5c98f21d603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:18.723621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bafbeb-1c13-4133-95c8-5c98f21d603c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:18.723895 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bafbeb-1c13-4133-95c8-5c98f21d603c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:18.724163 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bafbeb-1c13-4133-95c8-5c98f21d603c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:18.724728 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bafbeb-1c13-4133-95c8-5c98f21d603c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:18.726068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bafbeb-1c13-4133-95c8-5c98f21d603c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-f1bafbeb-1c13-4133-95c8-5c98f21d603c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:18.735142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:18.736332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:18.737391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 653/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Sun Sep 11 00:44:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:18.742021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a65e7a-6d8f-4473-8f47-eb12529b1016 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:18.759706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:18.841000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a65e7a-6d8f-4473-8f47-eb12529b1016 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:18.873661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af93bd2-1165-4693-a674-0d159a528d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:18.874195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af93bd2-1165-4693-a674-0d159a528d5f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:18.874464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af93bd2-1165-4693-a674-0d159a528d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:18.874752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af93bd2-1165-4693-a674-0d159a528d5f None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:18.875365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af93bd2-1165-4693-a674-0d159a528d5f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:18.875659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af93bd2-1165-4693-a674-0d159a528d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:18.877005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af93bd2-1165-4693-a674-0d159a528d5f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:18.881909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 646/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Sun Sep 11 00:44:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:18.887870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bafbeb-1c13-4133-95c8-5c98f21d603c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:18.919025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:18.984033 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bafbeb-1c13-4133-95c8-5c98f21d603c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:19.016436 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c422956-dd01-4758-9b25-f869275b03f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:19.017015 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c422956-dd01-4758-9b25-f869275b03f7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:19.017291 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c422956-dd01-4758-9b25-f869275b03f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:19.017561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c422956-dd01-4758-9b25-f869275b03f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:19.018244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c422956-dd01-4758-9b25-f869275b03f7 None admin] RBAC: Adding query filter params (interface=public, service_id=3479708fe6dd46c581654766c9ec1f22, region_id=RegionOne) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:19.018548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c422956-dd01-4758-9b25-f869275b03f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:19.019922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c422956-dd01-4758-9b25-f869275b03f7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:19.024666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 654/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Sun Sep 11 00:44:18 2022] GET /identity/v3/endpoints?service_id=3479708fe6dd46c581654766c9ec1f22&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:19.030140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af93bd2-1165-4693-a674-0d159a528d5f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:19.114507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:19.132784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af93bd2-1165-4693-a674-0d159a528d5f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:19.164563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a63082-beab-4bd7-853b-dc5c7749747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:19.165154 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a63082-beab-4bd7-853b-dc5c7749747a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:19.165428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a63082-beab-4bd7-853b-dc5c7749747a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:19.166192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a63082-beab-4bd7-853b-dc5c7749747a None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:19.166816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a63082-beab-4bd7-853b-dc5c7749747a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:19.168174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a63082-beab-4bd7-853b-dc5c7749747a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:19.174677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 647/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Sun Sep 11 00:44:19 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:44:21.288660 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94b2f8-f915-416f-a8f0-276a15b05b43 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:21.289188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94b2f8-f915-416f-a8f0-276a15b05b43 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:21.289188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94b2f8-f915-416f-a8f0-276a15b05b43 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:21.290519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 655/1302] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:21.296268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9a40f-1ab8-4a78-8cc7-6be62eafe4b5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:21.296688 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9a40f-1ab8-4a78-8cc7-6be62eafe4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:21.296804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9a40f-1ab8-4a78-8cc7-6be62eafe4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:21.314621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-00d9a40f-1ab8-4a78-8cc7-6be62eafe4b5 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:21.315807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-00d9a40f-1ab8-4a78-8cc7-6be62eafe4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:21.379771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 648/1303] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:21.647517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94b2f8-f915-416f-a8f0-276a15b05b43 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:21.738333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:21.745499 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94b2f8-f915-416f-a8f0-276a15b05b43 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:21.781060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad862c8a-10f5-4568-b605-895c9f595f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:21.781664 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad862c8a-10f5-4568-b605-895c9f595f31 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:21.781938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad862c8a-10f5-4568-b605-895c9f595f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:21.782204 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad862c8a-10f5-4568-b605-895c9f595f31 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:21.782799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad862c8a-10f5-4568-b605-895c9f595f31 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:21.784141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad862c8a-10f5-4568-b605-895c9f595f31 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-ad862c8a-10f5-4568-b605-895c9f595f31 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:21.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:21.795386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 11 00:44:21.796449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 656/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Sun Sep 11 00:44:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:21.802570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9a40f-1ab8-4a78-8cc7-6be62eafe4b5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:21.876616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:21.899489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9a40f-1ab8-4a78-8cc7-6be62eafe4b5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:21.931930 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d26e41-f2e1-419d-9485-4da0722f1e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:21.932529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d26e41-f2e1-419d-9485-4da0722f1e4c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:21.932808 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d26e41-f2e1-419d-9485-4da0722f1e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:21.933080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d26e41-f2e1-419d-9485-4da0722f1e4c None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:21.933696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d26e41-f2e1-419d-9485-4da0722f1e4c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:21.933997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d26e41-f2e1-419d-9485-4da0722f1e4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:21.935387 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d26e41-f2e1-419d-9485-4da0722f1e4c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:21.940571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 649/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Sun Sep 11 00:44:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:21.946337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad862c8a-10f5-4568-b605-895c9f595f31 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:22.041595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad862c8a-10f5-4568-b605-895c9f595f31 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:22.074027 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e7d1b-3dcf-4a3e-8d37-c2c2a65ace8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:22.074600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e7d1b-3dcf-4a3e-8d37-c2c2a65ace8d None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:22.074903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e7d1b-3dcf-4a3e-8d37-c2c2a65ace8d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:22.075173 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e7d1b-3dcf-4a3e-8d37-c2c2a65ace8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:22.075815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e7d1b-3dcf-4a3e-8d37-c2c2a65ace8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:22.077138 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e7d1b-3dcf-4a3e-8d37-c2c2a65ace8d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:22.095925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 657/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:44:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:44:31.937853 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=30 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:32.091795 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:25.995287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b3dab-08db-43fc-be47-b668cc443546 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:25.995746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b3dab-08db-43fc-be47-b668cc443546 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:25.995825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b3dab-08db-43fc-be47-b668cc443546 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:26.001093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 650/1307] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:45:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:26.002567 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75dac-b041-4d2a-9c94-199fd2b0ff51 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:26.003019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75dac-b041-4d2a-9c94-199fd2b0ff51 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:26.003258 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75dac-b041-4d2a-9c94-199fd2b0ff51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:26.121584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-99a75dac-b041-4d2a-9c94-199fd2b0ff51 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:26.122705 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-99a75dac-b041-4d2a-9c94-199fd2b0ff51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:26.262135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 658/1308] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:45:26.562035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef33c-6094-4ae0-be6b-8f351ea2e419 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:26.562320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef33c-6094-4ae0-be6b-8f351ea2e419 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:26.562820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef33c-6094-4ae0-be6b-8f351ea2e419 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:26.564422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 651/1309] 10.222.0.33 () {54 vars in 965 bytes} [Sun Sep 11 00:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:26.571059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ce19d-de2c-4261-a2eb-2246f3c6ed22 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:26.571423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ce19d-de2c-4261-a2eb-2246f3c6ed22 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:26.571780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ce19d-de2c-4261-a2eb-2246f3c6ed22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:26.653345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5a6ce19d-de2c-4261-a2eb-2246f3c6ed22 None None] MFA Rules not processed for user `c45d8e2b0b674e9a814167db4d78749e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:26.654899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5a6ce19d-de2c-4261-a2eb-2246f3c6ed22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:26.678629 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:26.749507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 659/1310] 10.222.0.33 () {58 vars in 1062 bytes} [Sun Sep 11 00:45:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:45:26.758429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceef33c-6094-4ae0-be6b-8f351ea2e419 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:26.760242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0ceef33c-6094-4ae0-be6b-8f351ea2e419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:26.883198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceef33c-6094-4ae0-be6b-8f351ea2e419 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:26.963461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883c31e-3be0-453f-a453-9c2c253d4d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:26.964319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883c31e-3be0-453f-a453-9c2c253d4d1c service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:26.964764 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883c31e-3be0-453f-a453-9c2c253d4d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:26.965205 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883c31e-3be0-453f-a453-9c2c253d4d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:26.967055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e883c31e-3be0-453f-a453-9c2c253d4d1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:27.024714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:27.086269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883c31e-3be0-453f-a453-9c2c253d4d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:27.087812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883c31e-3be0-453f-a453-9c2c253d4d1c service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:27.107866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 652/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:45:29.571085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe3102-d95c-4c67-a685-e242ccfd5cae None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:29.571610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe3102-d95c-4c67-a685-e242ccfd5cae None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:29.571610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe3102-d95c-4c67-a685-e242ccfd5cae None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:29.572993 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 660/1312] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:29.578295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132d8a-d2fe-421c-8a75-8cda24a0f926 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:29.578754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132d8a-d2fe-421c-8a75-8cda24a0f926 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:29.579023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132d8a-d2fe-421c-8a75-8cda24a0f926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:29.649432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-40132d8a-d2fe-421c-8a75-8cda24a0f926 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:29.650616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-40132d8a-d2fe-421c-8a75-8cda24a0f926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:29.747591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 653/1313] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:45:30.034338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe3102-d95c-4c67-a685-e242ccfd5cae None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:30.035950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0bfe3102-d95c-4c67-a685-e242ccfd5cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:30.141475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe3102-d95c-4c67-a685-e242ccfd5cae None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:30.220379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:30.223029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134584ff-264d-4918-a0b4-7cf69c73f847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:30.223734 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134584ff-264d-4918-a0b4-7cf69c73f847 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:30.224090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134584ff-264d-4918-a0b4-7cf69c73f847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:30.224636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134584ff-264d-4918-a0b4-7cf69c73f847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:30.227493 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-134584ff-264d-4918-a0b4-7cf69c73f847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:30.345508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134584ff-264d-4918-a0b4-7cf69c73f847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:30.346980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134584ff-264d-4918-a0b4-7cf69c73f847 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:30.365276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 661/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:45:32.832908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffa8e0-500b-4a72-ab5e-758b528dda1e None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:32.833463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffa8e0-500b-4a72-ab5e-758b528dda1e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:32.833463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffa8e0-500b-4a72-ab5e-758b528dda1e None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:32.834904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 654/1315] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:32.840132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f8d2f-9292-43cf-8ecd-12cf31726a58 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:32.840547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f8d2f-9292-43cf-8ecd-12cf31726a58 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:32.840678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f8d2f-9292-43cf-8ecd-12cf31726a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:32.906342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-776f8d2f-9292-43cf-8ecd-12cf31726a58 None None] MFA Rules not processed for user `ad45b1b3038c4a20809d31f56bf8ddf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:32.907582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-776f8d2f-9292-43cf-8ecd-12cf31726a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:32.958526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:33.003336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 662/1316] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:45:33.291019 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffa8e0-500b-4a72-ab5e-758b528dda1e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:33.292547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-32ffa8e0-500b-4a72-ab5e-758b528dda1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:33.302196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:33.396555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffa8e0-500b-4a72-ab5e-758b528dda1e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:33.474906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e48b37-0895-4e1b-bc2d-2ff607ac435f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:33.475511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e48b37-0895-4e1b-bc2d-2ff607ac435f service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:33.475784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e48b37-0895-4e1b-bc2d-2ff607ac435f service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:33.476049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e48b37-0895-4e1b-bc2d-2ff607ac435f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:33.477615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e5e48b37-0895-4e1b-bc2d-2ff607ac435f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:33.540492 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:33.586979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e48b37-0895-4e1b-bc2d-2ff607ac435f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:33.588405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e48b37-0895-4e1b-bc2d-2ff607ac435f service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:33.606005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 655/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:45:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:45:36.291529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bd1d7-80be-4d75-8351-582b6b0c9509 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:36.292091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bd1d7-80be-4d75-8351-582b6b0c9509 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:36.292091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bd1d7-80be-4d75-8351-582b6b0c9509 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:36.293421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 663/1318] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:36.298773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8938bdd-a6fb-4e7f-a411-83571f9a43ea None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:36.299194 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8938bdd-a6fb-4e7f-a411-83571f9a43ea None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:36.299327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8938bdd-a6fb-4e7f-a411-83571f9a43ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:36.364300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c8938bdd-a6fb-4e7f-a411-83571f9a43ea None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:36.365527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c8938bdd-a6fb-4e7f-a411-83571f9a43ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:36.462116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 656/1319] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:45:36.744946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bd1d7-80be-4d75-8351-582b6b0c9509 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:36.746531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-be8bd1d7-80be-4d75-8351-582b6b0c9509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:36.847380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bd1d7-80be-4d75-8351-582b6b0c9509 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:36.919912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285bbc3-d407-4def-adc6-3227c7a57782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:36.920501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285bbc3-d407-4def-adc6-3227c7a57782 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:36.920777 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285bbc3-d407-4def-adc6-3227c7a57782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:36.921045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285bbc3-d407-4def-adc6-3227c7a57782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:36.922625 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4285bbc3-d407-4def-adc6-3227c7a57782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:36.929363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:37.029264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285bbc3-d407-4def-adc6-3227c7a57782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:37.030595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285bbc3-d407-4def-adc6-3227c7a57782 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:37.048957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 664/1320] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:45:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:45:39.860220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab7d68-12c0-4e3f-bf8a-0a62ca03a7be None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:39.860797 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab7d68-12c0-4e3f-bf8a-0a62ca03a7be None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:39.860797 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab7d68-12c0-4e3f-bf8a-0a62ca03a7be None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:39.862312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 657/1321] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:39.868125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f18138-68bf-49ab-bd86-ff7f938269a6 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:39.868653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f18138-68bf-49ab-bd86-ff7f938269a6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:39.868653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f18138-68bf-49ab-bd86-ff7f938269a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:39.941482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-82f18138-68bf-49ab-bd86-ff7f938269a6 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:39.942706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-82f18138-68bf-49ab-bd86-ff7f938269a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:40.004421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:40.045336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 665/1322] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:45:40.345276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044574d-f7d2-4b29-a2cd-1be0eab2de03 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:40.345556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044574d-f7d2-4b29-a2cd-1be0eab2de03 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:40.345828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044574d-f7d2-4b29-a2cd-1be0eab2de03 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:40.347237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 658/1323] 10.222.0.33 () {54 vars in 965 bytes} [Sun Sep 11 00:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:40.354205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c27d3b-023e-40d9-8813-2f0bf247938b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:40.354569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c27d3b-023e-40d9-8813-2f0bf247938b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:40.354939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c27d3b-023e-40d9-8813-2f0bf247938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:40.432907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-01c27d3b-023e-40d9-8813-2f0bf247938b None None] MFA Rules not processed for user `c45d8e2b0b674e9a814167db4d78749e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:40.434113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-01c27d3b-023e-40d9-8813-2f0bf247938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:40.510458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 666/1324] 10.222.0.33 () {58 vars in 1062 bytes} [Sun Sep 11 00:45:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:45:40.519451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044574d-f7d2-4b29-a2cd-1be0eab2de03 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:40.520964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d044574d-f7d2-4b29-a2cd-1be0eab2de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:40.540606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:40.624322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044574d-f7d2-4b29-a2cd-1be0eab2de03 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:40.697431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562e93-de7f-4a32-b86d-bc2765723fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:40.698033 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562e93-de7f-4a32-b86d-bc2765723fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:40.698308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562e93-de7f-4a32-b86d-bc2765723fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:40.698571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562e93-de7f-4a32-b86d-bc2765723fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:40.700187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ee562e93-de7f-4a32-b86d-bc2765723fa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:40.769701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:40.807265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee562e93-de7f-4a32-b86d-bc2765723fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:40.808692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee562e93-de7f-4a32-b86d-bc2765723fa3 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:40.827331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 659/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:45:43.240639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a67d0-66ea-4741-8ce9-236835ab41e4 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:43.241170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a67d0-66ea-4741-8ce9-236835ab41e4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:43.241170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a67d0-66ea-4741-8ce9-236835ab41e4 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:43.242443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 667/1326] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:43.247926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc66d2-9add-4eb8-a09e-727d009412c1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:43.248329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc66d2-9add-4eb8-a09e-727d009412c1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:43.248503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc66d2-9add-4eb8-a09e-727d009412c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:43.314511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0edc66d2-9add-4eb8-a09e-727d009412c1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:43.315747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0edc66d2-9add-4eb8-a09e-727d009412c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:43.413014 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 660/1327] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:45:43.695374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a67d0-66ea-4741-8ce9-236835ab41e4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:43.696917 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-236a67d0-66ea-4741-8ce9-236835ab41e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:43.765665 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:43.809772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a67d0-66ea-4741-8ce9-236835ab41e4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:43.884793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac09c5-f873-4862-b76f-f75e97d5e87c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:43.885398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac09c5-f873-4862-b76f-f75e97d5e87c service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:43.885673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac09c5-f873-4862-b76f-f75e97d5e87c service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:43.885942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac09c5-f873-4862-b76f-f75e97d5e87c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:43.887570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-08ac09c5-f873-4862-b76f-f75e97d5e87c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:43.996164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac09c5-f873-4862-b76f-f75e97d5e87c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:43.996802 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:43.998639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac09c5-f873-4862-b76f-f75e97d5e87c service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:44.016497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 668/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:45:46.256817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d93117-41b3-4aca-afbc-323c0e6a97f8 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:46.257345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d93117-41b3-4aca-afbc-323c0e6a97f8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:46.257345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d93117-41b3-4aca-afbc-323c0e6a97f8 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:46.258748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 661/1329] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:46.264497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6564cda-9d03-4801-a2d3-f9d9c3b31953 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:46.265002 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6564cda-9d03-4801-a2d3-f9d9c3b31953 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:46.265100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6564cda-9d03-4801-a2d3-f9d9c3b31953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:46.337487 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b6564cda-9d03-4801-a2d3-f9d9c3b31953 None None] MFA Rules not processed for user `ad45b1b3038c4a20809d31f56bf8ddf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:46.338702 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b6564cda-9d03-4801-a2d3-f9d9c3b31953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:46.435995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 669/1330] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:45:46.715512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d93117-41b3-4aca-afbc-323c0e6a97f8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:46.717113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-04d93117-41b3-4aca-afbc-323c0e6a97f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:46.748131 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:46.824477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d93117-41b3-4aca-afbc-323c0e6a97f8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:46.900910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8af2f-6f03-4edd-a6e5-21ac67eabb8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:46.901584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8af2f-6f03-4edd-a6e5-21ac67eabb8a service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:46.901827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8af2f-6f03-4edd-a6e5-21ac67eabb8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:46.902096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8af2f-6f03-4edd-a6e5-21ac67eabb8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:46.903741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e8d8af2f-6f03-4edd-a6e5-21ac67eabb8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:46.984354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:47.017810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8af2f-6f03-4edd-a6e5-21ac67eabb8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:47.019302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8af2f-6f03-4edd-a6e5-21ac67eabb8a service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:47.039262 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 662/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:45:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:45:49.433243 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e2d6-0a39-4561-9b86-0a6ca664695f None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:49.433680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e2d6-0a39-4561-9b86-0a6ca664695f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:49.433789 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e2d6-0a39-4561-9b86-0a6ca664695f None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:49.435384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 670/1332] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:49.440648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76487b83-acc1-4c2f-b19c-67bee2fe4be3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:49.441062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76487b83-acc1-4c2f-b19c-67bee2fe4be3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:49.441190 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76487b83-acc1-4c2f-b19c-67bee2fe4be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:49.505185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-76487b83-acc1-4c2f-b19c-67bee2fe4be3 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:49.506392 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-76487b83-acc1-4c2f-b19c-67bee2fe4be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:49.602088 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 663/1333] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:45:49.881162 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e2d6-0a39-4561-9b86-0a6ca664695f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:49.882761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ee80e2d6-0a39-4561-9b86-0a6ca664695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:49.951384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:49.984729 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e2d6-0a39-4561-9b86-0a6ca664695f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:50.056026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734b02f-8143-4a2e-873e-204b5e65aa14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:50.056625 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b02f-8143-4a2e-873e-204b5e65aa14 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:50.056902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b02f-8143-4a2e-873e-204b5e65aa14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:50.057170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b02f-8143-4a2e-873e-204b5e65aa14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:50.058782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2734b02f-8143-4a2e-873e-204b5e65aa14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:50.164016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734b02f-8143-4a2e-873e-204b5e65aa14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:50.165361 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734b02f-8143-4a2e-873e-204b5e65aa14 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:50.175074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:50.183829 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 671/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:45:52.370603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e41eb-bf7b-45ba-a289-55317f3ba8ab None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:52.371272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e41eb-bf7b-45ba-a289-55317f3ba8ab None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:52.371272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e41eb-bf7b-45ba-a289-55317f3ba8ab None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:52.372566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 664/1335] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:52.377775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4055-8177-4bed-abcb-4441702d4cc2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:52.378172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4055-8177-4bed-abcb-4441702d4cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:52.378321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4055-8177-4bed-abcb-4441702d4cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:52.445065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-656c4055-8177-4bed-abcb-4441702d4cc2 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:52.446237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-656c4055-8177-4bed-abcb-4441702d4cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:52.539637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 672/1336] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:45:52.824792 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e41eb-bf7b-45ba-a289-55317f3ba8ab None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:52.826282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ea9e41eb-bf7b-45ba-a289-55317f3ba8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:52.866030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:52.929123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e41eb-bf7b-45ba-a289-55317f3ba8ab None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:53.000925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83237e-b070-46fe-ae0a-59114b6e573a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:53.001528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83237e-b070-46fe-ae0a-59114b6e573a service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:53.001803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83237e-b070-46fe-ae0a-59114b6e573a service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:53.002068 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83237e-b070-46fe-ae0a-59114b6e573a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:53.003674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5c83237e-b070-46fe-ae0a-59114b6e573a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:53.086338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:53.112847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83237e-b070-46fe-ae0a-59114b6e573a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:53.115132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83237e-b070-46fe-ae0a-59114b6e573a service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:53.133342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 665/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:45:55.572812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435f28f-1b27-46ea-9397-de0c4d0b7d9a None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:55.573339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435f28f-1b27-46ea-9397-de0c4d0b7d9a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:55.573458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435f28f-1b27-46ea-9397-de0c4d0b7d9a None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:55.574709 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 673/1338] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:55.579704 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb2f47-118a-470a-a260-460a59d2afab None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:55.580151 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb2f47-118a-470a-a260-460a59d2afab None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:55.580251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb2f47-118a-470a-a260-460a59d2afab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:55.644405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-93cb2f47-118a-470a-a260-460a59d2afab None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:55.646119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-93cb2f47-118a-470a-a260-460a59d2afab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:55.739169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 666/1339] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:45:56.016829 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435f28f-1b27-46ea-9397-de0c4d0b7d9a None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:56.018376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e435f28f-1b27-46ea-9397-de0c4d0b7d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:56.094412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:56.121211 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435f28f-1b27-46ea-9397-de0c4d0b7d9a None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:56.195187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81336cc-cf5a-46e4-b1c9-4dc6cae46e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:56.195791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81336cc-cf5a-46e4-b1c9-4dc6cae46e08 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:56.196060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81336cc-cf5a-46e4-b1c9-4dc6cae46e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:56.196321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81336cc-cf5a-46e4-b1c9-4dc6cae46e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:56.197893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f81336cc-cf5a-46e4-b1c9-4dc6cae46e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:56.307492 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81336cc-cf5a-46e4-b1c9-4dc6cae46e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:56.308838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81336cc-cf5a-46e4-b1c9-4dc6cae46e08 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:56.327036 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 674/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:45:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:00.379019 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263fe15-4ee4-4183-be78-179b2b20e092 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:00.379565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263fe15-4ee4-4183-be78-179b2b20e092 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:00.379565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263fe15-4ee4-4183-be78-179b2b20e092 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:00.380855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 667/1341] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:00.386197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb27a86-d45b-43d7-80cc-b082c546d68b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:00.386646 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb27a86-d45b-43d7-80cc-b082c546d68b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:00.386973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb27a86-d45b-43d7-80cc-b082c546d68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:00.392614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:00.461326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0cb27a86-d45b-43d7-80cc-b082c546d68b None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:00.462525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0cb27a86-d45b-43d7-80cc-b082c546d68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:00.556469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 675/1342] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:46:00.834311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263fe15-4ee4-4183-be78-179b2b20e092 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:00.835935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e263fe15-4ee4-4183-be78-179b2b20e092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:00.889933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:00.947360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263fe15-4ee4-4183-be78-179b2b20e092 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:01.020132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12215254-7e15-4f70-8b41-f328d17ca911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:01.020729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12215254-7e15-4f70-8b41-f328d17ca911 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:01.021005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12215254-7e15-4f70-8b41-f328d17ca911 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:01.021295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12215254-7e15-4f70-8b41-f328d17ca911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:01.022885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-12215254-7e15-4f70-8b41-f328d17ca911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:01.117170 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:01.134973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12215254-7e15-4f70-8b41-f328d17ca911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:01.136409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12215254-7e15-4f70-8b41-f328d17ca911 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:01.154942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 668/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:03.957425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20726bf-b570-46c1-a089-7cfd4cfecf5f None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:03.957955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20726bf-b570-46c1-a089-7cfd4cfecf5f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:03.957955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20726bf-b570-46c1-a089-7cfd4cfecf5f None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:03.959251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 676/1344] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:03.964635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69f856-117e-41fc-990d-c6f944ab4acd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:03.965053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69f856-117e-41fc-990d-c6f944ab4acd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:03.965179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69f856-117e-41fc-990d-c6f944ab4acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:04.031410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4e69f856-117e-41fc-990d-c6f944ab4acd None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:04.032589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4e69f856-117e-41fc-990d-c6f944ab4acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:04.132335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 669/1345] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:04.417835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20726bf-b570-46c1-a089-7cfd4cfecf5f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:04.419493 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c20726bf-b570-46c1-a089-7cfd4cfecf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:04.513548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:04.530802 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20726bf-b570-46c1-a089-7cfd4cfecf5f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:04.609967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3560b75-53c3-4d75-9854-b6dedb03986a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:04.610475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3560b75-53c3-4d75-9854-b6dedb03986a service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:04.610834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3560b75-53c3-4d75-9854-b6dedb03986a service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:04.611109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3560b75-53c3-4d75-9854-b6dedb03986a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:04.612690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a3560b75-53c3-4d75-9854-b6dedb03986a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:04.720723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3560b75-53c3-4d75-9854-b6dedb03986a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:04.722694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3560b75-53c3-4d75-9854-b6dedb03986a service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:04.740186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 677/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:08.931980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee5af1-ffaf-4df7-a383-f92ca3b34dc0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:08.932492 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee5af1-ffaf-4df7-a383-f92ca3b34dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:08.932606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee5af1-ffaf-4df7-a383-f92ca3b34dc0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:08.933856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 670/1347] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:08.939602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656fc46-7d8e-4699-a124-11ffbefaf4dd None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:08.939982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656fc46-7d8e-4699-a124-11ffbefaf4dd None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:08.940245 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656fc46-7d8e-4699-a124-11ffbefaf4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:08.956664 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:09.012356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7656fc46-7d8e-4699-a124-11ffbefaf4dd None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:09.013562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7656fc46-7d8e-4699-a124-11ffbefaf4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:09.113376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 678/1348] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:09.395787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee5af1-ffaf-4df7-a383-f92ca3b34dc0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:09.397359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-45ee5af1-ffaf-4df7-a383-f92ca3b34dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:09.458192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:09.506764 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee5af1-ffaf-4df7-a383-f92ca3b34dc0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:09.582077 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0791b-0f81-4355-89fe-773435e05690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:09.582688 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0791b-0f81-4355-89fe-773435e05690 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:09.582995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0791b-0f81-4355-89fe-773435e05690 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:09.583267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0791b-0f81-4355-89fe-773435e05690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:09.585193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-23c0791b-0f81-4355-89fe-773435e05690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:09.696682 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:09.701059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0791b-0f81-4355-89fe-773435e05690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:09.702497 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0791b-0f81-4355-89fe-773435e05690 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:09.722645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 671/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:14.647289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d262e1-3d62-4acf-a07c-d618484502f6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:14.647289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d262e1-3d62-4acf-a07c-d618484502f6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:14.647289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d262e1-3d62-4acf-a07c-d618484502f6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:14.647289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 679/1350] 10.222.0.33 () {54 vars in 921 bytes} [Sun Sep 11 00:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:14.652731 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f5d00-d5f8-4da6-9f48-a01e3895eebf None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:14.652731 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f5d00-d5f8-4da6-9f48-a01e3895eebf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:14.653166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f5d00-d5f8-4da6-9f48-a01e3895eebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:14.753964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-738f5d00-d5f8-4da6-9f48-a01e3895eebf None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:14.755811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-738f5d00-d5f8-4da6-9f48-a01e3895eebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:14.913740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 672/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 00:46:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:46:19.111327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=59 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:19.186908 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383fb8-c6a9-44da-bca2-d32f2b0912ad None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:19.187302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383fb8-c6a9-44da-bca2-d32f2b0912ad None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:19.187545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383fb8-c6a9-44da-bca2-d32f2b0912ad None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:19.188955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 680/1352] 10.222.0.33 () {54 vars in 921 bytes} [Sun Sep 11 00:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:19.194593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175406f9-1324-4163-a590-fd0538eab37b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:19.195115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175406f9-1324-4163-a590-fd0538eab37b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:19.195115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175406f9-1324-4163-a590-fd0538eab37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:19.252313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:19.276845 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-175406f9-1324-4163-a590-fd0538eab37b None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:19.278038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-175406f9-1324-4163-a590-fd0538eab37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:19.390861 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 673/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 00:46:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:20.694351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d948395-85db-4d22-9b82-39020da8ece6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:20.694875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d948395-85db-4d22-9b82-39020da8ece6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:20.694968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d948395-85db-4d22-9b82-39020da8ece6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:20.696465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 681/1354] 10.222.0.33 () {54 vars in 921 bytes} [Sun Sep 11 00:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:20.701386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b0d42-deac-4c2c-997a-865dcdc2a5e5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:20.701804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b0d42-deac-4c2c-997a-865dcdc2a5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:20.702082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b0d42-deac-4c2c-997a-865dcdc2a5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:20.779778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c29b0d42-deac-4c2c-997a-865dcdc2a5e5 None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:20.780978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c29b0d42-deac-4c2c-997a-865dcdc2a5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:20.822029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:20.886933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 674/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 00:46:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:24.441598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb518d-9ef3-49c0-af88-377a91f71704 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:24.442122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb518d-9ef3-49c0-af88-377a91f71704 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:24.442122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb518d-9ef3-49c0-af88-377a91f71704 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:24.443482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 682/1356] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:24.448981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390d5b2-6cc8-4f82-8819-4e9b1d70704a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:24.449419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390d5b2-6cc8-4f82-8819-4e9b1d70704a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:24.449513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390d5b2-6cc8-4f82-8819-4e9b1d70704a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:24.521646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5390d5b2-6cc8-4f82-8819-4e9b1d70704a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:24.522762 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5390d5b2-6cc8-4f82-8819-4e9b1d70704a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:24.623508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 675/1357] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:24.933635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6192a9-3721-4513-9cab-dca4e7d86674 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:24.933938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6192a9-3721-4513-9cab-dca4e7d86674 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:24.934186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6192a9-3721-4513-9cab-dca4e7d86674 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:24.936184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 683/1358] 10.222.0.33 () {54 vars in 962 bytes} [Sun Sep 11 00:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:24.947317 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab6263-6670-4647-b2dd-c952e62df40a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:24.947611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab6263-6670-4647-b2dd-c952e62df40a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:24.947885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab6263-6670-4647-b2dd-c952e62df40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:24.976213 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:25.043868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a5ab6263-6670-4647-b2dd-c952e62df40a None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:25.045527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a5ab6263-6670-4647-b2dd-c952e62df40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:25.194842 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 676/1359] 10.222.0.33 () {58 vars in 1059 bytes} [Sun Sep 11 00:46:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:25.204100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6192a9-3721-4513-9cab-dca4e7d86674 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:25.206415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2b6192a9-3721-4513-9cab-dca4e7d86674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:25.368400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6192a9-3721-4513-9cab-dca4e7d86674 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:25.449815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:25.493629 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc419aa-b651-4dea-8283-21eb1bec06d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:25.494627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc419aa-b651-4dea-8283-21eb1bec06d5 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:25.495069 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc419aa-b651-4dea-8283-21eb1bec06d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:25.495349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc419aa-b651-4dea-8283-21eb1bec06d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:25.496947 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0bc419aa-b651-4dea-8283-21eb1bec06d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:25.603294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc419aa-b651-4dea-8283-21eb1bec06d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:25.604885 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc419aa-b651-4dea-8283-21eb1bec06d5 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:25.624483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 684/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:28.038228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa908985-19ca-4883-911e-4098227295c3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:28.038228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa908985-19ca-4883-911e-4098227295c3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:28.039145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa908985-19ca-4883-911e-4098227295c3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:28.043535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 677/1361] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:28.044829 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39e239-c303-44da-a835-e6ea517e5aa7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:28.045219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39e239-c303-44da-a835-e6ea517e5aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:28.045486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39e239-c303-44da-a835-e6ea517e5aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:28.116768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-1f39e239-c303-44da-a835-e6ea517e5aa7 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:28.117947 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1f39e239-c303-44da-a835-e6ea517e5aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:28.156129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:28.222548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 685/1362] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:28.517436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa908985-19ca-4883-911e-4098227295c3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:28.519149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fa908985-19ca-4883-911e-4098227295c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:28.606120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:28.710103 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa908985-19ca-4883-911e-4098227295c3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:28.843504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dbe33-fbcb-4bab-b2fa-587b6d1afa38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:28.844145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dbe33-fbcb-4bab-b2fa-587b6d1afa38 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:28.844424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dbe33-fbcb-4bab-b2fa-587b6d1afa38 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:28.844681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dbe33-fbcb-4bab-b2fa-587b6d1afa38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:28.846823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a01dbe33-fbcb-4bab-b2fa-587b6d1afa38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:28.869682 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:28.939920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dbe33-fbcb-4bab-b2fa-587b6d1afa38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:28.941548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dbe33-fbcb-4bab-b2fa-587b6d1afa38 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:28.960619 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 678/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:31.445247 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c34ff-afd7-47b1-a530-ca4efb969224 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:31.445776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c34ff-afd7-47b1-a530-ca4efb969224 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:31.445776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c34ff-afd7-47b1-a530-ca4efb969224 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:31.447418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 686/1364] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:31.452405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e421717-0c29-4fb5-b3ed-c503f8e2401a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:31.452822 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e421717-0c29-4fb5-b3ed-c503f8e2401a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:31.453239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e421717-0c29-4fb5-b3ed-c503f8e2401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:31.528740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7e421717-0c29-4fb5-b3ed-c503f8e2401a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:31.530020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7e421717-0c29-4fb5-b3ed-c503f8e2401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:31.695735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:31.697860 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 679/1365] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:31.992733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe604a-9ebe-4530-92e3-8d844e391604 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:31.993436 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe604a-9ebe-4530-92e3-8d844e391604 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:31.993955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe604a-9ebe-4530-92e3-8d844e391604 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:31.995679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 687/1366] 10.222.0.33 () {54 vars in 962 bytes} [Sun Sep 11 00:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:32.007594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adc068-9041-4865-bd5d-4669949f6d32 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:32.007883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adc068-9041-4865-bd5d-4669949f6d32 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:32.008159 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adc068-9041-4865-bd5d-4669949f6d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:32.122021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-81adc068-9041-4865-bd5d-4669949f6d32 None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:32.123476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-81adc068-9041-4865-bd5d-4669949f6d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:32.269675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 680/1367] 10.222.0.33 () {58 vars in 1059 bytes} [Sun Sep 11 00:46:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:32.278921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe604a-9ebe-4530-92e3-8d844e391604 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:32.280940 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-78fe604a-9ebe-4530-92e3-8d844e391604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:32.517837 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe604a-9ebe-4530-92e3-8d844e391604 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:32.543846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:32.672352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd489a-5238-48a4-b2c2-fcf910760fc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:32.673185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd489a-5238-48a4-b2c2-fcf910760fc8 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:32.673536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd489a-5238-48a4-b2c2-fcf910760fc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:32.673877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd489a-5238-48a4-b2c2-fcf910760fc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:32.676048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-17bd489a-5238-48a4-b2c2-fcf910760fc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:32.784709 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd489a-5238-48a4-b2c2-fcf910760fc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:32.786528 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd489a-5238-48a4-b2c2-fcf910760fc8 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:32.821415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 688/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:35.270890 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee14f3-caa0-498b-b846-4283199e2f27 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:35.271999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee14f3-caa0-498b-b846-4283199e2f27 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:35.272511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee14f3-caa0-498b-b846-4283199e2f27 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:35.274409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 681/1369] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:35.284252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a8021-6e1a-4e8d-b40f-3fe371fcc5e4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:35.284675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a8021-6e1a-4e8d-b40f-3fe371fcc5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:35.284927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a8021-6e1a-4e8d-b40f-3fe371fcc5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:35.319506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:35.358552 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b04a8021-6e1a-4e8d-b40f-3fe371fcc5e4 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:35.361104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b04a8021-6e1a-4e8d-b40f-3fe371fcc5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:35.513856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 689/1370] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:35.812302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee14f3-caa0-498b-b846-4283199e2f27 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:35.814806 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f2ee14f3-caa0-498b-b846-4283199e2f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:35.875407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:35.981097 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee14f3-caa0-498b-b846-4283199e2f27 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:36.104003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90cd42-fe98-4357-9aff-b8697a398080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:36.104542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90cd42-fe98-4357-9aff-b8697a398080 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:36.104817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90cd42-fe98-4357-9aff-b8697a398080 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:36.105083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90cd42-fe98-4357-9aff-b8697a398080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:36.106784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7c90cd42-fe98-4357-9aff-b8697a398080 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:36.118873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:36.239153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90cd42-fe98-4357-9aff-b8697a398080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:36.240855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90cd42-fe98-4357-9aff-b8697a398080 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:36.281884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 682/1371] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:36.448030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1628b-a803-4585-b940-a20ddc4aad73 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:36.448561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1628b-a803-4585-b940-a20ddc4aad73 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:36.448561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1628b-a803-4585-b940-a20ddc4aad73 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:36.449984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 690/1372] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:36.456382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b27aa-3f1f-4805-b494-f16db39efca3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:36.456950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b27aa-3f1f-4805-b494-f16db39efca3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:36.457463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b27aa-3f1f-4805-b494-f16db39efca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:36.538954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b64b27aa-3f1f-4805-b494-f16db39efca3 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:36.540551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b64b27aa-3f1f-4805-b494-f16db39efca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:36.630259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:36.653310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 683/1373] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:36.952592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc70dc-6e99-4404-8744-5e4b2842fdec None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:36.952957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc70dc-6e99-4404-8744-5e4b2842fdec None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:36.953297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc70dc-6e99-4404-8744-5e4b2842fdec None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:36.955372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 691/1374] 10.222.0.33 () {54 vars in 964 bytes} [Sun Sep 11 00:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:36.960424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e78ee-3fde-412c-a785-118f5b79fee4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:36.960711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e78ee-3fde-412c-a785-118f5b79fee4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:36.960984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e78ee-3fde-412c-a785-118f5b79fee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:37.043301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8a4e78ee-3fde-412c-a785-118f5b79fee4 None None] MFA Rules not processed for user `7ecc9e16475344b78bb885437b5d6bec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:37.044403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8a4e78ee-3fde-412c-a785-118f5b79fee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:37.130890 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 684/1375] 10.222.0.33 () {58 vars in 1061 bytes} [Sun Sep 11 00:46:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:37.136160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc70dc-6e99-4404-8744-5e4b2842fdec None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:37.137999 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9cdc70dc-6e99-4404-8744-5e4b2842fdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:37.248813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc70dc-6e99-4404-8744-5e4b2842fdec None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:37.253351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:37.332506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0221a-7bdc-47e8-9c3c-360b29b01275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecc9e16475344b78bb885437b5d6bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:37.333217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0221a-7bdc-47e8-9c3c-360b29b01275 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:37.333498 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0221a-7bdc-47e8-9c3c-360b29b01275 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:37.333773 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0221a-7bdc-47e8-9c3c-360b29b01275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:37.335379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9df0221a-7bdc-47e8-9c3c-360b29b01275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:37.459898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0221a-7bdc-47e8-9c3c-360b29b01275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:37.461328 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0221a-7bdc-47e8-9c3c-360b29b01275 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:37.482836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 692/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:38.508998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb350-3a91-4afb-beeb-8ba8f0c2d366 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.509588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb350-3a91-4afb-beeb-8ba8f0c2d366 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.509588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb350-3a91-4afb-beeb-8ba8f0c2d366 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.510886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 685/1377] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:38.516710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187d63c-b0d1-42c7-9193-86e24c8b89fd None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.517471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187d63c-b0d1-42c7-9193-86e24c8b89fd None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.517892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187d63c-b0d1-42c7-9193-86e24c8b89fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.564603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:38.593984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9187d63c-b0d1-42c7-9193-86e24c8b89fd None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:38.595800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9187d63c-b0d1-42c7-9193-86e24c8b89fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:38.700731 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 693/1378] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:38.988648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eb350-3a91-4afb-beeb-8ba8f0c2d366 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.990179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ec1eb350-3a91-4afb-beeb-8ba8f0c2d366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:39.088119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:39.165291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eb350-3a91-4afb-beeb-8ba8f0c2d366 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.292265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a7b16-1135-4987-bf85-e58a70a769e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.292787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a7b16-1135-4987-bf85-e58a70a769e9 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.293059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a7b16-1135-4987-bf85-e58a70a769e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.293324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a7b16-1135-4987-bf85-e58a70a769e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.295006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5d6a7b16-1135-4987-bf85-e58a70a769e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:39.346919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:39.404831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a7b16-1135-4987-bf85-e58a70a769e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.405858 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a7b16-1135-4987-bf85-e58a70a769e9 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.428774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 686/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:41.723601 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cb73c-a7bf-4661-b2d1-1efc1c960ef1 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:41.724813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cb73c-a7bf-4661-b2d1-1efc1c960ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:41.725267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cb73c-a7bf-4661-b2d1-1efc1c960ef1 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:41.726973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 694/1380] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:41.732485 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588be0c-be56-437b-85e3-0862891bc53d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:41.733303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588be0c-be56-437b-85e3-0862891bc53d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:41.733790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588be0c-be56-437b-85e3-0862891bc53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:41.807094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0588be0c-be56-437b-85e3-0862891bc53d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:41.808755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0588be0c-be56-437b-85e3-0862891bc53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:41.929693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 687/1381] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:42.223705 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cb73c-a7bf-4661-b2d1-1efc1c960ef1 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:42.225462 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-729cb73c-a7bf-4661-b2d1-1efc1c960ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:42.341867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:42.384008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cb73c-a7bf-4661-b2d1-1efc1c960ef1 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:42.510199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efbf68-c2d9-47ac-b811-75b3b13f5e27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:42.511230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efbf68-c2d9-47ac-b811-75b3b13f5e27 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:42.511718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efbf68-c2d9-47ac-b811-75b3b13f5e27 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:42.512313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efbf68-c2d9-47ac-b811-75b3b13f5e27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:42.514328 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-75efbf68-c2d9-47ac-b811-75b3b13f5e27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:42.595693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:42.613105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efbf68-c2d9-47ac-b811-75b3b13f5e27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:42.614807 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efbf68-c2d9-47ac-b811-75b3b13f5e27 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:42.633309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 695/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:44.858193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e8ca2-df90-45fe-a517-5bd374a6ff31 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.858710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e8ca2-df90-45fe-a517-5bd374a6ff31 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.858710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e8ca2-df90-45fe-a517-5bd374a6ff31 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.860612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 688/1383] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:44.866055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08d85d-f20d-4434-b260-07f71cf53a19 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.866506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08d85d-f20d-4434-b260-07f71cf53a19 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.866611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08d85d-f20d-4434-b260-07f71cf53a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.943017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4a08d85d-f20d-4434-b260-07f71cf53a19 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:44.944196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4a08d85d-f20d-4434-b260-07f71cf53a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:45.044045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 696/1384] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:45.325829 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e8ca2-df90-45fe-a517-5bd374a6ff31 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:45.327134 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d37e8ca2-df90-45fe-a517-5bd374a6ff31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:45.359820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:45.522101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e8ca2-df90-45fe-a517-5bd374a6ff31 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:45.617331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:45.647437 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb32ca2-a989-4e7e-b31f-e21a65ab5411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:45.648290 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb32ca2-a989-4e7e-b31f-e21a65ab5411 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:45.648675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb32ca2-a989-4e7e-b31f-e21a65ab5411 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:45.649046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb32ca2-a989-4e7e-b31f-e21a65ab5411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:45.651353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fbb32ca2-a989-4e7e-b31f-e21a65ab5411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:45.758127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb32ca2-a989-4e7e-b31f-e21a65ab5411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:45.759759 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb32ca2-a989-4e7e-b31f-e21a65ab5411 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:45.778165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 689/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:48.040389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ed8e3-ab4a-4f53-a095-a1e02154078e None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:48.040919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ed8e3-ab4a-4f53-a095-a1e02154078e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:48.040919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ed8e3-ab4a-4f53-a095-a1e02154078e None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:48.042367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 697/1386] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:48.048312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829e605-b2bd-4550-ad77-45b2863d00fa None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:48.048755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829e605-b2bd-4550-ad77-45b2863d00fa None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:48.048885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829e605-b2bd-4550-ad77-45b2863d00fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:48.120799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c829e605-b2bd-4550-ad77-45b2863d00fa None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:48.122071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c829e605-b2bd-4550-ad77-45b2863d00fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:48.184877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:48.238382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 690/1387] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:46:48.542952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ed8e3-ab4a-4f53-a095-a1e02154078e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:48.544562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3c5ed8e3-ab4a-4f53-a095-a1e02154078e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:48.611465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:48.727823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ed8e3-ab4a-4f53-a095-a1e02154078e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:48.850969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1177948-c0d7-421b-beb1-2d4c38329abe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:48.851604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1177948-c0d7-421b-beb1-2d4c38329abe service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:48.851882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1177948-c0d7-421b-beb1-2d4c38329abe service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:48.852156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1177948-c0d7-421b-beb1-2d4c38329abe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:48.853745 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b1177948-c0d7-421b-beb1-2d4c38329abe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:48.868100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:48.956066 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1177948-c0d7-421b-beb1-2d4c38329abe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:48.957749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1177948-c0d7-421b-beb1-2d4c38329abe service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:48.978623 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 698/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:51.201235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647faa-ef21-46f7-a859-ffd13ba3931f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.201852 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647faa-ef21-46f7-a859-ffd13ba3931f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.201852 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647faa-ef21-46f7-a859-ffd13ba3931f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.203702 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 691/1389] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:51.209201 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea6255-0d63-4246-b8d4-cb7291bcaac8 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.209645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea6255-0d63-4246-b8d4-cb7291bcaac8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.209737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea6255-0d63-4246-b8d4-cb7291bcaac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.284504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-56ea6255-0d63-4246-b8d4-cb7291bcaac8 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:51.285701 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-56ea6255-0d63-4246-b8d4-cb7291bcaac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:51.371698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:51.383962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 699/1390] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:51.679083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01647faa-ef21-46f7-a859-ffd13ba3931f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:51.680661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-01647faa-ef21-46f7-a859-ffd13ba3931f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:51.827923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01647faa-ef21-46f7-a859-ffd13ba3931f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:51.866209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:51.945635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae95d9b-73bf-4e45-bc85-3fc3c9f4eb55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:51.946237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae95d9b-73bf-4e45-bc85-3fc3c9f4eb55 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.946509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae95d9b-73bf-4e45-bc85-3fc3c9f4eb55 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.946800 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae95d9b-73bf-4e45-bc85-3fc3c9f4eb55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.948378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-aae95d9b-73bf-4e45-bc85-3fc3c9f4eb55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:52.036326 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae95d9b-73bf-4e45-bc85-3fc3c9f4eb55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:52.037924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae95d9b-73bf-4e45-bc85-3fc3c9f4eb55 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:52.055770 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 692/1391] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:53.184182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517fa37-5353-41d5-b947-a8648c797057 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.184713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517fa37-5353-41d5-b947-a8648c797057 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.184713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517fa37-5353-41d5-b947-a8648c797057 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.186139 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 700/1392] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:53.191447 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bc306-dd5a-4111-804f-a602925cd89d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.191884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bc306-dd5a-4111-804f-a602925cd89d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.191991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bc306-dd5a-4111-804f-a602925cd89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.244728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:53.258374 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1d8bc306-dd5a-4111-804f-a602925cd89d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:53.259694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1d8bc306-dd5a-4111-804f-a602925cd89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:53.356949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 693/1393] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:53.656933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484e713-e2d9-402b-9258-4eed11498190 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.657236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484e713-e2d9-402b-9258-4eed11498190 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.657509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484e713-e2d9-402b-9258-4eed11498190 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.658879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 701/1394] 10.222.0.33 () {54 vars in 966 bytes} [Sun Sep 11 00:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:46:53.664102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead001fd-02d2-46e6-b745-fa280b500af8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.664454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead001fd-02d2-46e6-b745-fa280b500af8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.664788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead001fd-02d2-46e6-b745-fa280b500af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.742483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ead001fd-02d2-46e6-b745-fa280b500af8 None None] MFA Rules not processed for user `f0dfdb9054ac4fef97d8e30aa5a8bd66`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:53.743681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ead001fd-02d2-46e6-b745-fa280b500af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:53.807215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:53.820989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 694/1395] 10.222.0.33 () {58 vars in 1063 bytes} [Sun Sep 11 00:46:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:46:53.830606 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484e713-e2d9-402b-9258-4eed11498190 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:53.832132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2484e713-e2d9-402b-9258-4eed11498190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:53.935715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484e713-e2d9-402b-9258-4eed11498190 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:54.012268 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1068097-141d-4162-9bca-a56e4100ae95 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dfdb9054ac4fef97d8e30aa5a8bd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:54.012896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1068097-141d-4162-9bca-a56e4100ae95 service glance] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.013176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1068097-141d-4162-9bca-a56e4100ae95 service glance] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.013442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1068097-141d-4162-9bca-a56e4100ae95 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.015037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b1068097-141d-4162-9bca-a56e4100ae95 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:54.059133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:54.126740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1068097-141d-4162-9bca-a56e4100ae95 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:54.128220 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1068097-141d-4162-9bca-a56e4100ae95 service glance] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:54.147921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 702/1396] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:54.259443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62076f4f-7613-4bff-a91b-b625f1ff6c90 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.260019 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62076f4f-7613-4bff-a91b-b625f1ff6c90 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.260019 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62076f4f-7613-4bff-a91b-b625f1ff6c90 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.262808 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 695/1397] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:54.267340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b5de-148a-4752-a30c-2f14428ec0ad None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.267798 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b5de-148a-4752-a30c-2f14428ec0ad None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.267953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b5de-148a-4752-a30c-2f14428ec0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.342823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7cd0b5de-148a-4752-a30c-2f14428ec0ad None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:54.346673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7cd0b5de-148a-4752-a30c-2f14428ec0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:54.452952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:54.455434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 703/1398] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:54.755141 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62076f4f-7613-4bff-a91b-b625f1ff6c90 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:54.756693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-62076f4f-7613-4bff-a91b-b625f1ff6c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:54.895499 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929529f-049a-4271-96d6-fedcf169c1d7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.896173 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929529f-049a-4271-96d6-fedcf169c1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.896452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929529f-049a-4271-96d6-fedcf169c1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.913999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62076f4f-7613-4bff-a91b-b625f1ff6c90 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:54.968494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0929529f-049a-4271-96d6-fedcf169c1d7 None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:54.969715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0929529f-049a-4271-96d6-fedcf169c1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:54.982083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:55.032137 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ad82a-902c-4fc7-abf8-2f17b7a55595 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:55.032807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ad82a-902c-4fc7-abf8-2f17b7a55595 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.033099 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ad82a-902c-4fc7-abf8-2f17b7a55595 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.033359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ad82a-902c-4fc7-abf8-2f17b7a55595 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.035076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-203ad82a-902c-4fc7-abf8-2f17b7a55595 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:55.067029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 704/1399] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 00:46:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:55.118041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da3838-f1f1-4c37-bfd9-b15b5a8b858b None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.118331 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da3838-f1f1-4c37-bfd9-b15b5a8b858b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.118603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da3838-f1f1-4c37-bfd9-b15b5a8b858b None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.120290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 705/1400] 10.222.0.33 () {54 vars in 943 bytes} [Sun Sep 11 00:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:46:55.126788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4442a-33b1-49d5-9066-72fba9d43f46 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.127076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4442a-33b1-49d5-9066-72fba9d43f46 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.127352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4442a-33b1-49d5-9066-72fba9d43f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.138332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ad82a-902c-4fc7-abf8-2f17b7a55595 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:55.140033 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ad82a-902c-4fc7-abf8-2f17b7a55595 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:55.158372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 696/1401] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:46:55.209454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8af4442a-33b1-49d5-9066-72fba9d43f46 None None] MFA Rules not processed for user `e8baa8033f884cb6a7783f78c01a212e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:55.210704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8af4442a-33b1-49d5-9066-72fba9d43f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:55.247194 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:55.332936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 706/1402] 10.222.0.33 () {58 vars in 1040 bytes} [Sun Sep 11 00:46:55 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:46:55.342609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ad82a-902c-4fc7-abf8-2f17b7a55595 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:55.344546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-203ad82a-902c-4fc7-abf8-2f17b7a55595 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:55.424799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:55.439705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ad82a-902c-4fc7-abf8-2f17b7a55595 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:55.547345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489482c-84c4-4d22-bfce-af0a46ec5e6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:55.547951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489482c-84c4-4d22-bfce-af0a46ec5e6d service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.548224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489482c-84c4-4d22-bfce-af0a46ec5e6d service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.548492 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489482c-84c4-4d22-bfce-af0a46ec5e6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.550113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d489482c-84c4-4d22-bfce-af0a46ec5e6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:55.637444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489482c-84c4-4d22-bfce-af0a46ec5e6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:55.638984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489482c-84c4-4d22-bfce-af0a46ec5e6d service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:55.646989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 697/1403] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 00:46:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 00:46:57.381159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78aad6-a3ed-4bc8-adf9-abda6fb1ef14 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:57.381697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78aad6-a3ed-4bc8-adf9-abda6fb1ef14 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:57.381697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78aad6-a3ed-4bc8-adf9-abda6fb1ef14 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:57.383059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 707/1404] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:57.388457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a485f9-d3a0-43d5-8607-92111c23af95 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:57.388880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a485f9-d3a0-43d5-8607-92111c23af95 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:57.389051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a485f9-d3a0-43d5-8607-92111c23af95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:57.417431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:57.466570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-10a485f9-d3a0-43d5-8607-92111c23af95 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:57.467934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-10a485f9-d3a0-43d5-8607-92111c23af95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:57.585091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 698/1405] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:46:57.875086 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78aad6-a3ed-4bc8-adf9-abda6fb1ef14 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:57.876597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0e78aad6-a3ed-4bc8-adf9-abda6fb1ef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:58.038861 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78aad6-a3ed-4bc8-adf9-abda6fb1ef14 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:58.042454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:58.164618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc65012-2dcb-4193-b432-03206bdb9db5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:58.165315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc65012-2dcb-4193-b432-03206bdb9db5 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.165658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc65012-2dcb-4193-b432-03206bdb9db5 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.165997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc65012-2dcb-4193-b432-03206bdb9db5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.167697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7bc65012-2dcb-4193-b432-03206bdb9db5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:58.272425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc65012-2dcb-4193-b432-03206bdb9db5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:58.274297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc65012-2dcb-4193-b432-03206bdb9db5 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:58.293566 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 708/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:00.482011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a713eb-bf6f-4e83-9516-9ee02c4f6432 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:00.482585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a713eb-bf6f-4e83-9516-9ee02c4f6432 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:00.482585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a713eb-bf6f-4e83-9516-9ee02c4f6432 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:00.484390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 699/1407] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:00.489448 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcb61-9025-4135-8ae8-5cec1c136d3a None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:00.489898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcb61-9025-4135-8ae8-5cec1c136d3a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:00.489994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcb61-9025-4135-8ae8-5cec1c136d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:00.503122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:00.566994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0a9fcb61-9025-4135-8ae8-5cec1c136d3a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:00.568211 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0a9fcb61-9025-4135-8ae8-5cec1c136d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:00.677254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 709/1408] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:00.981290 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a713eb-bf6f-4e83-9516-9ee02c4f6432 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:00.983178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-60a713eb-bf6f-4e83-9516-9ee02c4f6432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:01.091571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:01.151193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a713eb-bf6f-4e83-9516-9ee02c4f6432 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:01.277706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412eb07-e1ba-4592-82eb-f13b0872fecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:01.278219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412eb07-e1ba-4592-82eb-f13b0872fecb service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:01.278496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412eb07-e1ba-4592-82eb-f13b0872fecb service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:01.278786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412eb07-e1ba-4592-82eb-f13b0872fecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:01.280972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4412eb07-e1ba-4592-82eb-f13b0872fecb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:01.351389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:01.383221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412eb07-e1ba-4592-82eb-f13b0872fecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:01.384826 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412eb07-e1ba-4592-82eb-f13b0872fecb service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:01.408106 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 700/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:10.675294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=61 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:11.405062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=17 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:18.611183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46fec5-5924-48cf-ba06-bb2c3579015e None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.611752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46fec5-5924-48cf-ba06-bb2c3579015e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.611752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46fec5-5924-48cf-ba06-bb2c3579015e None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.613052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 710/1410] 10.222.0.33 () {54 vars in 918 bytes} [Sun Sep 11 00:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:18.618001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d1ebd-5b3c-4dd9-aabf-1b522be87ff7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.618424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d1ebd-5b3c-4dd9-aabf-1b522be87ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.618550 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d1ebd-5b3c-4dd9-aabf-1b522be87ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.692888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cb6d1ebd-5b3c-4dd9-aabf-1b522be87ff7 None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:18.693982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cb6d1ebd-5b3c-4dd9-aabf-1b522be87ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:18.794716 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 701/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Sun Sep 11 00:47:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:18.809336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843fc6-15a4-4201-a8ff-816362766bdd None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.809642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843fc6-15a4-4201-a8ff-816362766bdd None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.809927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843fc6-15a4-4201-a8ff-816362766bdd None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.811935 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 711/1412] 10.222.0.33 () {54 vars in 918 bytes} [Sun Sep 11 00:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:18.816467 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed72746-2418-4c0e-a76f-832fea48d223 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.816813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed72746-2418-4c0e-a76f-832fea48d223 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.817093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed72746-2418-4c0e-a76f-832fea48d223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.888673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:18.891878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3ed72746-2418-4c0e-a76f-832fea48d223 None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:18.893734 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3ed72746-2418-4c0e-a76f-832fea48d223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:19.014239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 702/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Sun Sep 11 00:47:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:21.578636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc210f2-fa81-4d1f-9799-8623fac64c11 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:21.579233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc210f2-fa81-4d1f-9799-8623fac64c11 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:21.579233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc210f2-fa81-4d1f-9799-8623fac64c11 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:21.580524 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:47:21.585812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1a46f-34cf-4086-a5d8-6d9bfffa6026 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:21.586309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1a46f-34cf-4086-a5d8-6d9bfffa6026 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:21.586413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1a46f-34cf-4086-a5d8-6d9bfffa6026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:21.651671 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-81a1a46f-34cf-4086-a5d8-6d9bfffa6026 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:21.652844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-81a1a46f-34cf-4086-a5d8-6d9bfffa6026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:21.706407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:21.747406 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:22.039339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc210f2-fa81-4d1f-9799-8623fac64c11 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:22.040920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bcc210f2-fa81-4d1f-9799-8623fac64c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:22.185428 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc210f2-fa81-4d1f-9799-8623fac64c11 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:22.257599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:22.298292 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b7fe3-a07e-407e-b1b8-6c8874c7dd8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:22.298846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b7fe3-a07e-407e-b1b8-6c8874c7dd8d service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:22.299124 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b7fe3-a07e-407e-b1b8-6c8874c7dd8d service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:22.299392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b7fe3-a07e-407e-b1b8-6c8874c7dd8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:22.300980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b15b7fe3-a07e-407e-b1b8-6c8874c7dd8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:22.389477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b7fe3-a07e-407e-b1b8-6c8874c7dd8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:22.391081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b7fe3-a07e-407e-b1b8-6c8874c7dd8d service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:22.408800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 713/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:23.541206 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a1fba-5b3f-4eb3-b0a7-5bd878230044 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:23.541692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a1fba-5b3f-4eb3-b0a7-5bd878230044 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:23.541802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a1fba-5b3f-4eb3-b0a7-5bd878230044 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:23.543118 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:23.549405 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e4a40-d10b-43cf-b387-85e8212a20fa None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:23.549849 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e4a40-d10b-43cf-b387-85e8212a20fa None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:23.549954 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e4a40-d10b-43cf-b387-85e8212a20fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:23.627841 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8d4e4a40-d10b-43cf-b387-85e8212a20fa None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:23.629025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8d4e4a40-d10b-43cf-b387-85e8212a20fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:23.655549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:23.722833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:23.878267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a1fba-5b3f-4eb3-b0a7-5bd878230044 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:23.879819 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-db2a1fba-5b3f-4eb3-b0a7-5bd878230044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:24.027329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a1fba-5b3f-4eb3-b0a7-5bd878230044 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:24.067875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:24.142241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53477c-469a-446b-a36c-866f4835cd4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:24.142875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53477c-469a-446b-a36c-866f4835cd4f service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:24.143155 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53477c-469a-446b-a36c-866f4835cd4f service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:24.143426 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53477c-469a-446b-a36c-866f4835cd4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:24.145013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5c53477c-469a-446b-a36c-866f4835cd4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:24.234701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53477c-469a-446b-a36c-866f4835cd4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:24.236375 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53477c-469a-446b-a36c-866f4835cd4f service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:24.255177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 705/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:25.388485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4ddee-89fe-4253-b069-866f815a756d None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:25.389059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4ddee-89fe-4253-b069-866f815a756d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:25.389059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4ddee-89fe-4253-b069-866f815a756d None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:25.390338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:25.396465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbacc5-2bce-4aa8-93ed-b456ac7fa19b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:25.396903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbacc5-2bce-4aa8-93ed-b456ac7fa19b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:25.397008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbacc5-2bce-4aa8-93ed-b456ac7fa19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:25.450893 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:25.473599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-eccbacc5-2bce-4aa8-93ed-b456ac7fa19b None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:25.474865 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-eccbacc5-2bce-4aa8-93ed-b456ac7fa19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:25.567775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:25.716008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4ddee-89fe-4253-b069-866f815a756d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:25.718141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3ad4ddee-89fe-4253-b069-866f815a756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:25.859992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4ddee-89fe-4253-b069-866f815a756d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:25.871994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:25.976162 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b7881-e352-4999-8808-549e00adf837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:25.976715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b7881-e352-4999-8808-549e00adf837 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:25.976997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b7881-e352-4999-8808-549e00adf837 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:25.977273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b7881-e352-4999-8808-549e00adf837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:25.978928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ed8b7881-e352-4999-8808-549e00adf837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:26.068421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b7881-e352-4999-8808-549e00adf837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:26.070010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b7881-e352-4999-8808-549e00adf837 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:26.088319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 716/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:27.188091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c41a2c-721f-43ff-b622-b52d145c4a92 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:27.188638 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c41a2c-721f-43ff-b622-b52d145c4a92 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:27.188638 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c41a2c-721f-43ff-b622-b52d145c4a92 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:27.189983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:27.196018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a87fe-c2ad-4c0a-8af2-ec68c02ae043 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:27.196434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a87fe-c2ad-4c0a-8af2-ec68c02ae043 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:27.196559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a87fe-c2ad-4c0a-8af2-ec68c02ae043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:27.215844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:27.395969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b38a87fe-c2ad-4c0a-8af2-ec68c02ae043 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:27.397189 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b38a87fe-c2ad-4c0a-8af2-ec68c02ae043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:27.493196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:27.641763 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c41a2c-721f-43ff-b622-b52d145c4a92 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:27.643302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-09c41a2c-721f-43ff-b622-b52d145c4a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:27.750573 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:27.786219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c41a2c-721f-43ff-b622-b52d145c4a92 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:27.901414 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e07cb-f62c-468f-8efd-f08d4438bf15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:27.902022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e07cb-f62c-468f-8efd-f08d4438bf15 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:27.902293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e07cb-f62c-468f-8efd-f08d4438bf15 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:27.902552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e07cb-f62c-468f-8efd-f08d4438bf15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:27.904150 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-381e07cb-f62c-468f-8efd-f08d4438bf15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:27.980942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:27.994369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e07cb-f62c-468f-8efd-f08d4438bf15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:27.996002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e07cb-f62c-468f-8efd-f08d4438bf15 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:28.013451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 708/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:29.126694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb949a2-d8a1-463a-9ee9-9d4071d64852 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.127223 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb949a2-d8a1-463a-9ee9-9d4071d64852 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.127333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb949a2-d8a1-463a-9ee9-9d4071d64852 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.128596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:29.134767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a296fe8-7598-40c1-8922-0d3bf5d01253 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.135221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a296fe8-7598-40c1-8922-0d3bf5d01253 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.135320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a296fe8-7598-40c1-8922-0d3bf5d01253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.210719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8a296fe8-7598-40c1-8922-0d3bf5d01253 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:29.211964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8a296fe8-7598-40c1-8922-0d3bf5d01253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:29.310534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:29.460343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb949a2-d8a1-463a-9ee9-9d4071d64852 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:29.461829 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-dfb949a2-d8a1-463a-9ee9-9d4071d64852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:29.546065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:29.608451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb949a2-d8a1-463a-9ee9-9d4071d64852 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:29.719378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a021147-97ad-426e-b53f-9c2b7dacfc61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:29.719981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a021147-97ad-426e-b53f-9c2b7dacfc61 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.720258 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a021147-97ad-426e-b53f-9c2b7dacfc61 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.720529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a021147-97ad-426e-b53f-9c2b7dacfc61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.722117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3a021147-97ad-426e-b53f-9c2b7dacfc61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:29.770256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:29.810509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a021147-97ad-426e-b53f-9c2b7dacfc61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:29.812613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a021147-97ad-426e-b53f-9c2b7dacfc61 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:29.830252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 719/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:30.876540 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bc9a1-0011-49ed-89d3-dc6486f650f1 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:30.877124 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bc9a1-0011-49ed-89d3-dc6486f650f1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:30.877237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bc9a1-0011-49ed-89d3-dc6486f650f1 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:30.878589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:30.884952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02826c36-6463-4908-97f6-19463ccd78f1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:30.885370 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02826c36-6463-4908-97f6-19463ccd78f1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:30.885486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02826c36-6463-4908-97f6-19463ccd78f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:30.960151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-02826c36-6463-4908-97f6-19463ccd78f1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:30.961349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-02826c36-6463-4908-97f6-19463ccd78f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:31.056158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:47:31.205241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bc9a1-0011-49ed-89d3-dc6486f650f1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:31.206751 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-875bc9a1-0011-49ed-89d3-dc6486f650f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:31.254869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:31.351239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bc9a1-0011-49ed-89d3-dc6486f650f1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:31.465301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0a689-9772-408f-b59c-bf2d3a15cefd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:31.465922 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0a689-9772-408f-b59c-bf2d3a15cefd service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:31.466196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0a689-9772-408f-b59c-bf2d3a15cefd service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:31.466455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0a689-9772-408f-b59c-bf2d3a15cefd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:31.468095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0fc0a689-9772-408f-b59c-bf2d3a15cefd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:31.474819 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:31.556416 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0a689-9772-408f-b59c-bf2d3a15cefd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:31.558009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0a689-9772-408f-b59c-bf2d3a15cefd service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:31.576305 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 711/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:32.613079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93f737-5b89-4a8f-8d3b-22d3148ae5c6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:32.613678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93f737-5b89-4a8f-8d3b-22d3148ae5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:32.613678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93f737-5b89-4a8f-8d3b-22d3148ae5c6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:32.614968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:32.621116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e55f9-616c-4da0-921c-9749c64fa86e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:32.621552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e55f9-616c-4da0-921c-9749c64fa86e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:32.621651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e55f9-616c-4da0-921c-9749c64fa86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:32.697325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-404e55f9-616c-4da0-921c-9749c64fa86e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:32.699359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-404e55f9-616c-4da0-921c-9749c64fa86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:32.772037 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:32.802613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:32.950752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93f737-5b89-4a8f-8d3b-22d3148ae5c6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:32.952719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4c93f737-5b89-4a8f-8d3b-22d3148ae5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:32.971350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:33.102352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93f737-5b89-4a8f-8d3b-22d3148ae5c6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:33.188533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:33.215312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46135b-d408-4d13-8fd7-a1d8052eaec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:33.215914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46135b-d408-4d13-8fd7-a1d8052eaec0 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:33.216190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46135b-d408-4d13-8fd7-a1d8052eaec0 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:33.216458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46135b-d408-4d13-8fd7-a1d8052eaec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:33.218597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4a46135b-d408-4d13-8fd7-a1d8052eaec0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:33.305603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46135b-d408-4d13-8fd7-a1d8052eaec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:33.307206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46135b-d408-4d13-8fd7-a1d8052eaec0 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:33.325217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 722/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:34.378148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d21615-147a-4c6b-be10-550604e6e49c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:34.378687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d21615-147a-4c6b-be10-550604e6e49c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:34.378687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d21615-147a-4c6b-be10-550604e6e49c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:34.380083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:34.386386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba2f68-7a8c-4546-99bd-8ed35b2893ec None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:34.386820 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba2f68-7a8c-4546-99bd-8ed35b2893ec None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:34.387012 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba2f68-7a8c-4546-99bd-8ed35b2893ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:34.462656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-19ba2f68-7a8c-4546-99bd-8ed35b2893ec None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:34.463892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-19ba2f68-7a8c-4546-99bd-8ed35b2893ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:34.505157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:34.559607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:34.708773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d21615-147a-4c6b-be10-550604e6e49c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:34.710276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d6d21615-147a-4c6b-be10-550604e6e49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:34.853395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d21615-147a-4c6b-be10-550604e6e49c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:34.908529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:34.967541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d21b1-3fb0-40a5-9c6b-d72c6d5c836a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:34.968141 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d21b1-3fb0-40a5-9c6b-d72c6d5c836a service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:34.968411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d21b1-3fb0-40a5-9c6b-d72c6d5c836a service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:34.968673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d21b1-3fb0-40a5-9c6b-d72c6d5c836a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:34.970245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c16d21b1-3fb0-40a5-9c6b-d72c6d5c836a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:35.061089 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d21b1-3fb0-40a5-9c6b-d72c6d5c836a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:35.062676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d21b1-3fb0-40a5-9c6b-d72c6d5c836a service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:35.081572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 714/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:36.121672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed629a-560b-46a7-8907-344e339eaf31 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:36.122217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed629a-560b-46a7-8907-344e339eaf31 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:36.122217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed629a-560b-46a7-8907-344e339eaf31 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:36.125052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:47:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:36.131588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aa7da-4b67-4fbd-a9da-1e5e4ed9827a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:36.132025 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aa7da-4b67-4fbd-a9da-1e5e4ed9827a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:36.132122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aa7da-4b67-4fbd-a9da-1e5e4ed9827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:36.210464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-699aa7da-4b67-4fbd-a9da-1e5e4ed9827a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:36.211722 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-699aa7da-4b67-4fbd-a9da-1e5e4ed9827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:36.213768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:36.310327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:36.458768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed629a-560b-46a7-8907-344e339eaf31 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:36.460287 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-46ed629a-560b-46a7-8907-344e339eaf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:36.604793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed629a-560b-46a7-8907-344e339eaf31 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:36.631342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:36.715971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e4f5e-05dd-4d2f-b075-6051eb3cf118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:36.716580 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e4f5e-05dd-4d2f-b075-6051eb3cf118 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:36.717418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e4f5e-05dd-4d2f-b075-6051eb3cf118 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:36.717681 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e4f5e-05dd-4d2f-b075-6051eb3cf118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:36.719273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-aa5e4f5e-05dd-4d2f-b075-6051eb3cf118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:36.805516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e4f5e-05dd-4d2f-b075-6051eb3cf118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:36.807120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e4f5e-05dd-4d2f-b075-6051eb3cf118 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:36.824666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 725/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:38.877931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847bea5-6186-44d3-ab03-1f247e39c828 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:38.878593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847bea5-6186-44d3-ab03-1f247e39c828 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:38.878593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847bea5-6186-44d3-ab03-1f247e39c828 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:38.879838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:38.885118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18b84b-2b82-4d9f-8f0f-d5e163c1a0ba None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:38.885531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18b84b-2b82-4d9f-8f0f-d5e163c1a0ba None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:38.885668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18b84b-2b82-4d9f-8f0f-d5e163c1a0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:38.925956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:38.951764 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3d18b84b-2b82-4d9f-8f0f-d5e163c1a0ba None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:38.952946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3d18b84b-2b82-4d9f-8f0f-d5e163c1a0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:39.049462 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:47:39.333385 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847bea5-6186-44d3-ab03-1f247e39c828 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:39.335066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9847bea5-6186-44d3-ab03-1f247e39c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:39.438142 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847bea5-6186-44d3-ab03-1f247e39c828 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:39.475888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:39.525011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33fbfc-eb91-4fd7-9fde-1ef77605d78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:39.525621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33fbfc-eb91-4fd7-9fde-1ef77605d78c service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:39.525898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33fbfc-eb91-4fd7-9fde-1ef77605d78c service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:39.526166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33fbfc-eb91-4fd7-9fde-1ef77605d78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:39.527827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2f33fbfc-eb91-4fd7-9fde-1ef77605d78c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:39.636866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33fbfc-eb91-4fd7-9fde-1ef77605d78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:39.638218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33fbfc-eb91-4fd7-9fde-1ef77605d78c service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:39.656357 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 717/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:41.964585 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62f97a-60f4-4f4e-bf74-bbc0ce21c98c None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.965159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62f97a-60f4-4f4e-bf74-bbc0ce21c98c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.965159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62f97a-60f4-4f4e-bf74-bbc0ce21c98c None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:41.966593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:41.972391 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c470b0-48da-4eea-8936-eb4c65fb4597 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.972806 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c470b0-48da-4eea-8936-eb4c65fb4597 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.972910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c470b0-48da-4eea-8936-eb4c65fb4597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:42.036955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a1c470b0-48da-4eea-8936-eb4c65fb4597 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:42.038138 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a1c470b0-48da-4eea-8936-eb4c65fb4597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:42.051363 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:42.135428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:42.423741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62f97a-60f4-4f4e-bf74-bbc0ce21c98c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:42.425301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fd62f97a-60f4-4f4e-bf74-bbc0ce21c98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:42.528584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62f97a-60f4-4f4e-bf74-bbc0ce21c98c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:42.541437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:42.601765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa30832-f4f7-4aaa-8163-8f99a177feeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:42.602475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa30832-f4f7-4aaa-8163-8f99a177feeb service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:42.602780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa30832-f4f7-4aaa-8163-8f99a177feeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:42.603050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa30832-f4f7-4aaa-8163-8f99a177feeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:42.604627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5aa30832-f4f7-4aaa-8163-8f99a177feeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:42.711215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa30832-f4f7-4aaa-8163-8f99a177feeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:42.712564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa30832-f4f7-4aaa-8163-8f99a177feeb service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:42.730681 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 728/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:45.175680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094d90e-276a-4bc9-b89f-3536fda22222 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:45.176246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094d90e-276a-4bc9-b89f-3536fda22222 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:45.176246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094d90e-276a-4bc9-b89f-3536fda22222 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:45.177623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:45.183040 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b7ada-680c-4d15-9050-16d7e36db22e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:45.183471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b7ada-680c-4d15-9050-16d7e36db22e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:45.183869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b7ada-680c-4d15-9050-16d7e36db22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:45.231237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:45.250941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-139b7ada-680c-4d15-9050-16d7e36db22e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:45.252120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-139b7ada-680c-4d15-9050-16d7e36db22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:45.347143 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:45.630211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094d90e-276a-4bc9-b89f-3536fda22222 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:45.631777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4094d90e-276a-4bc9-b89f-3536fda22222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:45.734677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094d90e-276a-4bc9-b89f-3536fda22222 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:45.774320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:45.807648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbf469-7f40-4a66-a914-29847971a46e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:45.808244 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbf469-7f40-4a66-a914-29847971a46e service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:45.808517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbf469-7f40-4a66-a914-29847971a46e service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:45.809051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbf469-7f40-4a66-a914-29847971a46e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:45.811192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3ebbf469-7f40-4a66-a914-29847971a46e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:45.918368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbf469-7f40-4a66-a914-29847971a46e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:45.919964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbf469-7f40-4a66-a914-29847971a46e service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:45.937575 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 720/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:48.214031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282321c-49c5-4a9a-8f52-b7747487ef3f None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.214623 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282321c-49c5-4a9a-8f52-b7747487ef3f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.214623 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282321c-49c5-4a9a-8f52-b7747487ef3f None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.215949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:48.221303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d92ac3-d28f-4e82-8d81-08604dd1a0d8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.221722 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d92ac3-d28f-4e82-8d81-08604dd1a0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.221854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d92ac3-d28f-4e82-8d81-08604dd1a0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.290334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e2d92ac3-d28f-4e82-8d81-08604dd1a0d8 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:48.291575 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e2d92ac3-d28f-4e82-8d81-08604dd1a0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:48.313886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:48.389550 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:48.676665 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282321c-49c5-4a9a-8f52-b7747487ef3f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:48.678223 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0282321c-49c5-4a9a-8f52-b7747487ef3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:48.780260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282321c-49c5-4a9a-8f52-b7747487ef3f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:48.800241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:48.853298 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73365e3-cdd0-45dc-b312-609c07f31021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:48.853896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73365e3-cdd0-45dc-b312-609c07f31021 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.854170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73365e3-cdd0-45dc-b312-609c07f31021 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.854440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73365e3-cdd0-45dc-b312-609c07f31021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.856050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d73365e3-cdd0-45dc-b312-609c07f31021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:48.969935 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73365e3-cdd0-45dc-b312-609c07f31021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:48.971394 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73365e3-cdd0-45dc-b312-609c07f31021 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:48.988819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 731/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:51.308614 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed001bb-c7fb-40ff-8f06-b66f1f6aabd3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:51.309457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed001bb-c7fb-40ff-8f06-b66f1f6aabd3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:51.309457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed001bb-c7fb-40ff-8f06-b66f1f6aabd3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:51.311543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:51.316642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42f224-2974-4aba-a693-1516fd5f271d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:51.317044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42f224-2974-4aba-a693-1516fd5f271d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:51.317195 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42f224-2974-4aba-a693-1516fd5f271d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:51.379938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:51.382706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7d42f224-2974-4aba-a693-1516fd5f271d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:51.384461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7d42f224-2974-4aba-a693-1516fd5f271d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:51.481620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:51.773011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed001bb-c7fb-40ff-8f06-b66f1f6aabd3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:51.774572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4ed001bb-c7fb-40ff-8f06-b66f1f6aabd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:51.876050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed001bb-c7fb-40ff-8f06-b66f1f6aabd3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:51.924068 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:51.948966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a7a06-b5be-443f-a6c2-7e0cbc56ecdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:51.949667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a7a06-b5be-443f-a6c2-7e0cbc56ecdf service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:51.949942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a7a06-b5be-443f-a6c2-7e0cbc56ecdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:51.950208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a7a06-b5be-443f-a6c2-7e0cbc56ecdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:51.952412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8b8a7a06-b5be-443f-a6c2-7e0cbc56ecdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:52.062122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a7a06-b5be-443f-a6c2-7e0cbc56ecdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:52.063536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a7a06-b5be-443f-a6c2-7e0cbc56ecdf service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:52.081334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 723/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:54.267544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba94a3-1f4d-4979-a11c-9b2448e83c49 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.268131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba94a3-1f4d-4979-a11c-9b2448e83c49 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.268131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba94a3-1f4d-4979-a11c-9b2448e83c49 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.269423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:54.274808 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92345ea1-7ef2-4717-8f64-9b0dace015a8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.275309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92345ea1-7ef2-4717-8f64-9b0dace015a8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.275411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92345ea1-7ef2-4717-8f64-9b0dace015a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.340637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-92345ea1-7ef2-4717-8f64-9b0dace015a8 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:54.342362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-92345ea1-7ef2-4717-8f64-9b0dace015a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:54.371674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:54.439331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:54.719213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba94a3-1f4d-4979-a11c-9b2448e83c49 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:54.720743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3dba94a3-1f4d-4979-a11c-9b2448e83c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:54.822146 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba94a3-1f4d-4979-a11c-9b2448e83c49 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:54.850016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:54.895792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a47236-5fa4-4ecf-b95a-5cb20183c71a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:54.896393 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a47236-5fa4-4ecf-b95a-5cb20183c71a service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.896676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a47236-5fa4-4ecf-b95a-5cb20183c71a service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.896944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a47236-5fa4-4ecf-b95a-5cb20183c71a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.898526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c5a47236-5fa4-4ecf-b95a-5cb20183c71a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:55.009498 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a47236-5fa4-4ecf-b95a-5cb20183c71a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:55.010890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a47236-5fa4-4ecf-b95a-5cb20183c71a service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:55.029383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 734/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:47:57.261026 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372c6cb-5229-4d2d-93f8-9e43076e70ba None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:57.261565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372c6cb-5229-4d2d-93f8-9e43076e70ba None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:57.261565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372c6cb-5229-4d2d-93f8-9e43076e70ba None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:57.263558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:57.268903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65d5b-352d-4e30-9823-1af2b832be27 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:57.269332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65d5b-352d-4e30-9823-1af2b832be27 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:57.269477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65d5b-352d-4e30-9823-1af2b832be27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:57.334741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f5d65d5b-352d-4e30-9823-1af2b832be27 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:57.335953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f5d65d5b-352d-4e30-9823-1af2b832be27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:57.344604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:57.432282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:47:57.719944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372c6cb-5229-4d2d-93f8-9e43076e70ba None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:57.721497 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0372c6cb-5229-4d2d-93f8-9e43076e70ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:57.827163 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372c6cb-5229-4d2d-93f8-9e43076e70ba None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:57.883568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:57.902075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314db63-9d56-4cb4-8b66-f510f72df399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:57.902682 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314db63-9d56-4cb4-8b66-f510f72df399 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:57.902988 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314db63-9d56-4cb4-8b66-f510f72df399 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:57.903263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314db63-9d56-4cb4-8b66-f510f72df399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:57.905460 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2314db63-9d56-4cb4-8b66-f510f72df399 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:58.012954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314db63-9d56-4cb4-8b66-f510f72df399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:58.014421 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314db63-9d56-4cb4-8b66-f510f72df399 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:58.032196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 726/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:00.210870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1e12b-78e4-40f9-9055-5cdfa7f389a6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:00.211438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1e12b-78e4-40f9-9055-5cdfa7f389a6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:00.211438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1e12b-78e4-40f9-9055-5cdfa7f389a6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:00.212751 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:00.217983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399f034-95a4-46c5-9dd1-c05c329bf8c0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:00.218426 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399f034-95a4-46c5-9dd1-c05c329bf8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:00.218547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399f034-95a4-46c5-9dd1-c05c329bf8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:00.287377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a399f034-95a4-46c5-9dd1-c05c329bf8c0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:00.288587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a399f034-95a4-46c5-9dd1-c05c329bf8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:00.326835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:00.384434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:00.670555 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1e12b-78e4-40f9-9055-5cdfa7f389a6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:00.672125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-65a1e12b-78e4-40f9-9055-5cdfa7f389a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:00.773873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1e12b-78e4-40f9-9055-5cdfa7f389a6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:00.811102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:00.847195 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bffa0-79b7-41e4-a344-be36927657a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:00.847785 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bffa0-79b7-41e4-a344-be36927657a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:00.848057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bffa0-79b7-41e4-a344-be36927657a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:00.848319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bffa0-79b7-41e4-a344-be36927657a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:00.850158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-db0bffa0-79b7-41e4-a344-be36927657a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:00.956352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bffa0-79b7-41e4-a344-be36927657a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:00.957693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bffa0-79b7-41e4-a344-be36927657a4 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:00.975229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 737/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:03.133285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301602ae-aee4-4e67-a48c-a4f40d52a36e None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:03.133876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301602ae-aee4-4e67-a48c-a4f40d52a36e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:03.133876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301602ae-aee4-4e67-a48c-a4f40d52a36e None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:03.135230 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:03.140467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a4d6e-baeb-4a18-91d9-1bf0b1f4c140 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:03.140920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a4d6e-baeb-4a18-91d9-1bf0b1f4c140 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:03.141033 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a4d6e-baeb-4a18-91d9-1bf0b1f4c140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:03.210585 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-bb4a4d6e-baeb-4a18-91d9-1bf0b1f4c140 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:03.211817 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bb4a4d6e-baeb-4a18-91d9-1bf0b1f4c140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:03.229472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:03.307293 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:03.593668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301602ae-aee4-4e67-a48c-a4f40d52a36e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:03.595263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-301602ae-aee4-4e67-a48c-a4f40d52a36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:03.701384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301602ae-aee4-4e67-a48c-a4f40d52a36e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:03.767486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:03.774360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7575f-8946-4295-908a-0f1599456e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:03.774992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7575f-8946-4295-908a-0f1599456e36 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:03.775269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7575f-8946-4295-908a-0f1599456e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:03.775533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7575f-8946-4295-908a-0f1599456e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:03.777114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cdf7575f-8946-4295-908a-0f1599456e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:03.885960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7575f-8946-4295-908a-0f1599456e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:03.887466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7575f-8946-4295-908a-0f1599456e36 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:03.905353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 729/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:06.058609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e61d46-ac6a-4ea4-a84f-666b3339078b None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.059485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e61d46-ac6a-4ea4-a84f-666b3339078b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.059485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e61d46-ac6a-4ea4-a84f-666b3339078b None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.061441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:06.066801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fd79a-5f0e-4406-9ab7-fd0d638ce507 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.067247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fd79a-5f0e-4406-9ab7-fd0d638ce507 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.067345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fd79a-5f0e-4406-9ab7-fd0d638ce507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.131248 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5c2fd79a-5f0e-4406-9ab7-fd0d638ce507 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:06.132428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5c2fd79a-5f0e-4406-9ab7-fd0d638ce507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:06.179792 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:06.228323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:06.508807 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e61d46-ac6a-4ea4-a84f-666b3339078b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:06.510337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-61e61d46-ac6a-4ea4-a84f-666b3339078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:06.612163 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e61d46-ac6a-4ea4-a84f-666b3339078b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:06.659533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:06.686951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0a728-04ba-411f-a40a-472f32b622a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:06.687474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0a728-04ba-411f-a40a-472f32b622a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.687747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0a728-04ba-411f-a40a-472f32b622a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.688010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0a728-04ba-411f-a40a-472f32b622a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.689640 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9af0a728-04ba-411f-a40a-472f32b622a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:06.795729 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0a728-04ba-411f-a40a-472f32b622a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:06.797150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0a728-04ba-411f-a40a-472f32b622a1 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:06.815787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 740/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:16.226802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=22 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:16.813480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=66 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:26.879363 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da22d6-4c7e-4837-8faa-5b60da808f1f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:26.879928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da22d6-4c7e-4837-8faa-5b60da808f1f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:26.879928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da22d6-4c7e-4837-8faa-5b60da808f1f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:26.881248 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 731/1471] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:26.886746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c76f0-bf8c-4afa-888f-90bbe7140c57 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:26.887143 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c76f0-bf8c-4afa-888f-90bbe7140c57 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:26.887309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c76f0-bf8c-4afa-888f-90bbe7140c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:26.955463 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6c6c76f0-bf8c-4afa-888f-90bbe7140c57 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:26.956667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6c6c76f0-bf8c-4afa-888f-90bbe7140c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:27.051387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 741/1472] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:27.353188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddd8b4-fae6-4db2-9d64-6ec04e3805b3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.353469 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddd8b4-fae6-4db2-9d64-6ec04e3805b3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.353734 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddd8b4-fae6-4db2-9d64-6ec04e3805b3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.355082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 732/1473] 10.222.0.33 () {54 vars in 966 bytes} [Sun Sep 11 00:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:27.360677 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708998f8-b0ed-445d-a424-48a35d0aba3f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.361009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708998f8-b0ed-445d-a424-48a35d0aba3f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.361274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708998f8-b0ed-445d-a424-48a35d0aba3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.436317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-708998f8-b0ed-445d-a424-48a35d0aba3f None None] MFA Rules not processed for user `f0dfdb9054ac4fef97d8e30aa5a8bd66`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:27.437529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-708998f8-b0ed-445d-a424-48a35d0aba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:27.457785 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:27.513392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 742/1474] 10.222.0.33 () {58 vars in 1063 bytes} [Sun Sep 11 00:48:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:27.521080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddd8b4-fae6-4db2-9d64-6ec04e3805b3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:27.522648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e2ddd8b4-fae6-4db2-9d64-6ec04e3805b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:27.628738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddd8b4-fae6-4db2-9d64-6ec04e3805b3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:27.700497 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663c810-d298-457c-8993-db2325402759 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dfdb9054ac4fef97d8e30aa5a8bd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:27.701093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663c810-d298-457c-8993-db2325402759 service glance] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.701366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663c810-d298-457c-8993-db2325402759 service glance] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.701633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663c810-d298-457c-8993-db2325402759 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.703244 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8663c810-d298-457c-8993-db2325402759 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:27.756313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:27.813479 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663c810-d298-457c-8993-db2325402759 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:27.814988 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663c810-d298-457c-8993-db2325402759 service glance] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:27.834925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 733/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:30.070692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21747e7-e0f3-4436-83a6-ed7513f2e25c None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.071282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21747e7-e0f3-4436-83a6-ed7513f2e25c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.071282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21747e7-e0f3-4436-83a6-ed7513f2e25c None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.072593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 743/1476] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:30.077795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc811adb-d4fc-49f6-9357-a731aa5e41b1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.078202 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc811adb-d4fc-49f6-9357-a731aa5e41b1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.078350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc811adb-d4fc-49f6-9357-a731aa5e41b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.144352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-dc811adb-d4fc-49f6-9357-a731aa5e41b1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:30.145544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dc811adb-d4fc-49f6-9357-a731aa5e41b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:30.255048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 734/1477] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:30.511081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21747e7-e0f3-4436-83a6-ed7513f2e25c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:30.512608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a21747e7-e0f3-4436-83a6-ed7513f2e25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:30.637021 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21747e7-e0f3-4436-83a6-ed7513f2e25c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:30.686581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:30.729345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a109ac-eaa2-4538-b194-b6f2331ab69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:30.729947 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a109ac-eaa2-4538-b194-b6f2331ab69e admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.730227 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a109ac-eaa2-4538-b194-b6f2331ab69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.730496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a109ac-eaa2-4538-b194-b6f2331ab69e admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.731167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a109ac-eaa2-4538-b194-b6f2331ab69e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:30.733400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: WARNING py.warnings [None req-84a109ac-eaa2-4538-b194-b6f2331ab69e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:48:30.733400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: warnings.warn(msg) Sep 11 00:48:30.733400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: Sep 11 00:48:30.734530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a109ac-eaa2-4538-b194-b6f2331ab69e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:30.754589 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 744/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:30 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:48:32.913216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096b569-81d4-4ab2-a011-4538440be356 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:32.913774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096b569-81d4-4ab2-a011-4538440be356 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:32.914002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096b569-81d4-4ab2-a011-4538440be356 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:32.915299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 735/1479] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:32.921312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd93637-6f4e-4644-a239-df4376bc8070 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:32.921720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd93637-6f4e-4644-a239-df4376bc8070 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:32.921853 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd93637-6f4e-4644-a239-df4376bc8070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:32.993193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8cd93637-6f4e-4644-a239-df4376bc8070 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:32.994435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8cd93637-6f4e-4644-a239-df4376bc8070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:33.089838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 745/1480] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:33.385701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096b569-81d4-4ab2-a011-4538440be356 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:33.387239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b096b569-81d4-4ab2-a011-4538440be356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:33.397543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:33.530525 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096b569-81d4-4ab2-a011-4538440be356 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:33.611671 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:33.645068 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c155d47-d1c9-44b1-8df9-e093a16f5942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:33.645605 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c155d47-d1c9-44b1-8df9-e093a16f5942 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.645880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c155d47-d1c9-44b1-8df9-e093a16f5942 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.646145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c155d47-d1c9-44b1-8df9-e093a16f5942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.647760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6c155d47-d1c9-44b1-8df9-e093a16f5942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:33.736795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c155d47-d1c9-44b1-8df9-e093a16f5942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:33.738374 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c155d47-d1c9-44b1-8df9-e093a16f5942 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:33.757032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 736/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:36.069906 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fb68b-0fa3-412d-b19b-aba6efb7e460 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:36.070560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fb68b-0fa3-412d-b19b-aba6efb7e460 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:36.070560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fb68b-0fa3-412d-b19b-aba6efb7e460 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:36.071814 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 746/1482] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:36.077916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58752b-ad52-48cb-a753-ecd0c5053d15 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:36.078318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58752b-ad52-48cb-a753-ecd0c5053d15 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:36.078471 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58752b-ad52-48cb-a753-ecd0c5053d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:36.143813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9d58752b-ad52-48cb-a753-ecd0c5053d15 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:36.145034 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9d58752b-ad52-48cb-a753-ecd0c5053d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:36.192314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:36.242948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 737/1483] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:36.534941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fb68b-0fa3-412d-b19b-aba6efb7e460 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:36.536510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4d2fb68b-0fa3-412d-b19b-aba6efb7e460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:36.560847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:36.638531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fb68b-0fa3-412d-b19b-aba6efb7e460 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:36.712120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7080cb-b5a6-45a2-8be5-79337fd660e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:36.712718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7080cb-b5a6-45a2-8be5-79337fd660e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:36.712994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7080cb-b5a6-45a2-8be5-79337fd660e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:36.713264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7080cb-b5a6-45a2-8be5-79337fd660e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:36.714872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-dc7080cb-b5a6-45a2-8be5-79337fd660e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:36.787773 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:36.821920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7080cb-b5a6-45a2-8be5-79337fd660e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:36.823443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7080cb-b5a6-45a2-8be5-79337fd660e0 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:36.843803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 747/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:39.051852 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cc096-4b49-4762-9138-8dd34a9856cc None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:39.052428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cc096-4b49-4762-9138-8dd34a9856cc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:39.052428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cc096-4b49-4762-9138-8dd34a9856cc None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:39.053728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 738/1485] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:39.059017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140097-fb3a-4c40-86c5-bde2c822fa2f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:39.059450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140097-fb3a-4c40-86c5-bde2c822fa2f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:39.059569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140097-fb3a-4c40-86c5-bde2c822fa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:39.125266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-72140097-fb3a-4c40-86c5-bde2c822fa2f None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:39.126463 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-72140097-fb3a-4c40-86c5-bde2c822fa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:39.219942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 748/1486] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:39.518839 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cc096-4b49-4762-9138-8dd34a9856cc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:39.520376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-294cc096-4b49-4762-9138-8dd34a9856cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:39.622823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cc096-4b49-4762-9138-8dd34a9856cc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:39.693721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:39.695249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf6c90-4616-4aaa-a80a-f617dc528c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:39.696019 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf6c90-4616-4aaa-a80a-f617dc528c67 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:39.696476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf6c90-4616-4aaa-a80a-f617dc528c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:39.696907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf6c90-4616-4aaa-a80a-f617dc528c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:39.698673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3ddf6c90-4616-4aaa-a80a-f617dc528c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:39.812459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf6c90-4616-4aaa-a80a-f617dc528c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:39.813888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf6c90-4616-4aaa-a80a-f617dc528c67 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:39.949966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 739/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:42.190547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c8ff6-3e5f-47b9-8b25-08326a11657d None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:42.191174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c8ff6-3e5f-47b9-8b25-08326a11657d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:42.191174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c8ff6-3e5f-47b9-8b25-08326a11657d None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:42.192452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 749/1488] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:42.197679 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaee5d0-f721-41df-bfc8-9855d4048c09 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:42.198125 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaee5d0-f721-41df-bfc8-9855d4048c09 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:42.198233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaee5d0-f721-41df-bfc8-9855d4048c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:42.262759 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-faaee5d0-f721-41df-bfc8-9855d4048c09 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:42.263969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-faaee5d0-f721-41df-bfc8-9855d4048c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:42.316472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:42.362933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 740/1489] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:42.656832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c8ff6-3e5f-47b9-8b25-08326a11657d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:42.658437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1d4c8ff6-3e5f-47b9-8b25-08326a11657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:42.694510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:42.761568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c8ff6-3e5f-47b9-8b25-08326a11657d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:42.833660 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04028ab1-a18e-4f9c-afdc-d0ca7cf6a4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:42.834251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028ab1-a18e-4f9c-afdc-d0ca7cf6a4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:42.834525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028ab1-a18e-4f9c-afdc-d0ca7cf6a4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:42.834821 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028ab1-a18e-4f9c-afdc-d0ca7cf6a4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:42.836388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-04028ab1-a18e-4f9c-afdc-d0ca7cf6a4e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:42.914120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:42.944319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04028ab1-a18e-4f9c-afdc-d0ca7cf6a4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:42.945733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04028ab1-a18e-4f9c-afdc-d0ca7cf6a4e7 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:42.963254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 750/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:45.280498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32ae12-93ad-4070-89e2-7802e6e04ebe None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:45.281075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32ae12-93ad-4070-89e2-7802e6e04ebe None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:45.281075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32ae12-93ad-4070-89e2-7802e6e04ebe None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:45.282360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 741/1491] 10.222.0.33 () {54 vars in 927 bytes} [Sun Sep 11 00:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:45.287661 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a66a72-3a49-4dec-aecb-6f0f02cc7a6e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:45.288111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a66a72-3a49-4dec-aecb-6f0f02cc7a6e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:45.288222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a66a72-3a49-4dec-aecb-6f0f02cc7a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:45.354786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-44a66a72-3a49-4dec-aecb-6f0f02cc7a6e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:45.355981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-44a66a72-3a49-4dec-aecb-6f0f02cc7a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:45.453153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 751/1492] 10.222.0.33 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:45.739555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32ae12-93ad-4070-89e2-7802e6e04ebe None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:45.741075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9d32ae12-93ad-4070-89e2-7802e6e04ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:45.843290 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32ae12-93ad-4070-89e2-7802e6e04ebe None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:45.914814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058d3a6-9f4e-4747-bf96-c431848cd6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:45.915414 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058d3a6-9f4e-4747-bf96-c431848cd6da service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:45.915690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058d3a6-9f4e-4747-bf96-c431848cd6da service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:45.915953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058d3a6-9f4e-4747-bf96-c431848cd6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:45.917536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5058d3a6-9f4e-4747-bf96-c431848cd6da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:45.926564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:46.025574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058d3a6-9f4e-4747-bf96-c431848cd6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:46.027023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058d3a6-9f4e-4747-bf96-c431848cd6da service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:46.044699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 742/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:55.451622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=82 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:56.042012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=50 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:59.873474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4bfb5-d665-4fd2-bfaa-fb39e4a18c42 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:59.874048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4bfb5-d665-4fd2-bfaa-fb39e4a18c42 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:59.874048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4bfb5-d665-4fd2-bfaa-fb39e4a18c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:59.950434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-fcf4bfb5-d665-4fd2-bfaa-fb39e4a18c42 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:59.952183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fcf4bfb5-d665-4fd2-bfaa-fb39e4a18c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:00.048340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 752/1494] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:00.056335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064a149-5fa3-44c2-9d12-1cce52cb54be None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:00.056846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064a149-5fa3-44c2-9d12-1cce52cb54be None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:00.057000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064a149-5fa3-44c2-9d12-1cce52cb54be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:00.132588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7064a149-5fa3-44c2-9d12-1cce52cb54be None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:00.133692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7064a149-5fa3-44c2-9d12-1cce52cb54be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:00.230271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 743/1495] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:50:00.235230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4bfb5-d665-4fd2-bfaa-fb39e4a18c42 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:00.236452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fcf4bfb5-d665-4fd2-bfaa-fb39e4a18c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:00.247561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4bfb5-d665-4fd2-bfaa-fb39e4a18c42 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:00.307961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:00.342116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a4d93-450b-4823-bdc0-80e195e0aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:00.342717 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a4d93-450b-4823-bdc0-80e195e0aab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:00.343019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a4d93-450b-4823-bdc0-80e195e0aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:00.343286 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a4d93-450b-4823-bdc0-80e195e0aab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:00.343915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a4d93-450b-4823-bdc0-80e195e0aab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:00.344210 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a4d93-450b-4823-bdc0-80e195e0aab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:00.345204 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: WARNING py.warnings [None req-e19a4d93-450b-4823-bdc0-80e195e0aab4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:50:00.345204 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: warnings.warn(msg) Sep 11 00:50:00.345204 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: Sep 11 00:50:00.346081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a4d93-450b-4823-bdc0-80e195e0aab4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:00.357191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 753/1496] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:50:00.365420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064a149-5fa3-44c2-9d12-1cce52cb54be None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:00.375024 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064a149-5fa3-44c2-9d12-1cce52cb54be None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:00.437031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:00.472677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49ba90-dd3c-47c4-ad97-26d213fec327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:00.473280 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ba90-dd3c-47c4-ad97-26d213fec327 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:00.473554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ba90-dd3c-47c4-ad97-26d213fec327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:00.473823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ba90-dd3c-47c4-ad97-26d213fec327 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:00.474451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49ba90-dd3c-47c4-ad97-26d213fec327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:00.476223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: WARNING py.warnings [None req-6a49ba90-dd3c-47c4-ad97-26d213fec327 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:50:00.476223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: warnings.warn(msg) Sep 11 00:50:00.476223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: Sep 11 00:50:00.477394 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49ba90-dd3c-47c4-ad97-26d213fec327 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:00.531144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 744/1497] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:50:00 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:50:00.535374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a4d93-450b-4823-bdc0-80e195e0aab4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:00.536940 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e19a4d93-450b-4823-bdc0-80e195e0aab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:00.570507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a4d93-450b-4823-bdc0-80e195e0aab4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:00.663307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b283a-d47a-49cb-ad84-b1619566bc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:00.663961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b283a-d47a-49cb-ad84-b1619566bc7b admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:00.664236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b283a-d47a-49cb-ad84-b1619566bc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:00.664503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b283a-d47a-49cb-ad84-b1619566bc7b admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:00.665118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b283a-d47a-49cb-ad84-b1619566bc7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:00.666136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: WARNING py.warnings [None req-fd8b283a-d47a-49cb-ad84-b1619566bc7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:50:00.666136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: warnings.warn(msg) Sep 11 00:50:00.666136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: Sep 11 00:50:00.667380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b283a-d47a-49cb-ad84-b1619566bc7b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:00.709425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 754/1498] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:50:00 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:50:00.713547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49ba90-dd3c-47c4-ad97-26d213fec327 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:00.715114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6a49ba90-dd3c-47c4-ad97-26d213fec327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:00.775686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49ba90-dd3c-47c4-ad97-26d213fec327 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:00.856955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:00.869450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d1e78-bac8-4dc1-b62d-74b9566ce89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:00.870054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d1e78-bac8-4dc1-b62d-74b9566ce89a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:00.870328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d1e78-bac8-4dc1-b62d-74b9566ce89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:00.870591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d1e78-bac8-4dc1-b62d-74b9566ce89a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:00.871254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d1e78-bac8-4dc1-b62d-74b9566ce89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:00.872271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: WARNING py.warnings [None req-010d1e78-bac8-4dc1-b62d-74b9566ce89a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:50:00.872271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: warnings.warn(msg) Sep 11 00:50:00.872271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: Sep 11 00:50:00.873691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d1e78-bac8-4dc1-b62d-74b9566ce89a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:00.885938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 745/1499] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:50:00.890109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b283a-d47a-49cb-ad84-b1619566bc7b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:00.891692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fd8b283a-d47a-49cb-ad84-b1619566bc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:00.902760 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b283a-d47a-49cb-ad84-b1619566bc7b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:00.927419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:00.996359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14630cb2-30c7-4979-8764-32a511003931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:00.996950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14630cb2-30c7-4979-8764-32a511003931 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:00.997222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14630cb2-30c7-4979-8764-32a511003931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:00.997485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14630cb2-30c7-4979-8764-32a511003931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:00.998138 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14630cb2-30c7-4979-8764-32a511003931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:00.999218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: WARNING py.warnings [None req-14630cb2-30c7-4979-8764-32a511003931 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:50:00.999218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: warnings.warn(msg) Sep 11 00:50:00.999218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: Sep 11 00:50:01.000098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14630cb2-30c7-4979-8764-32a511003931 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:01.011940 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 755/1500] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:50:01.016629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d1e78-bac8-4dc1-b62d-74b9566ce89a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:01.018164 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-010d1e78-bac8-4dc1-b62d-74b9566ce89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:01.050823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d1e78-bac8-4dc1-b62d-74b9566ce89a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:01.142290 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85c078-2e2b-40e2-aa54-5e84148a76d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:01.142979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85c078-2e2b-40e2-aa54-5e84148a76d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:01.143234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85c078-2e2b-40e2-aa54-5e84148a76d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:01.143504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85c078-2e2b-40e2-aa54-5e84148a76d3 admin admin] PATH_INFO: `/v3/projects/ea97b6c07ede49239cf8b5343c193250/users/de954006bf9345c38bddaab85321c8db/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:01.165589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85c078-2e2b-40e2-aa54-5e84148a76d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea97b6c07ede49239cf8b5343c193250, user_id=de954006bf9345c38bddaab85321c8db, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:01.166611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: WARNING py.warnings [None req-2a85c078-2e2b-40e2-aa54-5e84148a76d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:50:01.166611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: warnings.warn(msg) Sep 11 00:50:01.166611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: Sep 11 00:50:01.168584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85c078-2e2b-40e2-aa54-5e84148a76d3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:01.192777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 746/1501] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:50:01 2022] PUT /identity/v3/projects/ea97b6c07ede49239cf8b5343c193250/users/de954006bf9345c38bddaab85321c8db/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:50:01.205003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780acd4-1954-4b98-8ad6-9b84e91f320f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:01.205284 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780acd4-1954-4b98-8ad6-9b84e91f320f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:01.205552 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780acd4-1954-4b98-8ad6-9b84e91f320f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:01.261671 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5780acd4-1954-4b98-8ad6-9b84e91f320f None None] MFA Rules not processed for user `de954006bf9345c38bddaab85321c8db`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:01.262894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5780acd4-1954-4b98-8ad6-9b84e91f320f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:01.338520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 756/1502] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:50:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:01.353038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bd952-1e13-4064-9f2a-134f8dde185a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:01.353317 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bd952-1e13-4064-9f2a-134f8dde185a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:01.353582 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bd952-1e13-4064-9f2a-134f8dde185a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:01.354951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 747/1503] 10.222.0.33 () {54 vars in 964 bytes} [Sun Sep 11 00:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:01.360114 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4addb7-4af1-4454-bc77-40485f33196d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:01.360399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4addb7-4af1-4454-bc77-40485f33196d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:01.360671 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4addb7-4af1-4454-bc77-40485f33196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:01.391306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:01.435980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8a4addb7-4af1-4454-bc77-40485f33196d None None] MFA Rules not processed for user `7ecc9e16475344b78bb885437b5d6bec`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:01.437221 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8a4addb7-4af1-4454-bc77-40485f33196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:01.513543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 757/1504] 10.222.0.33 () {58 vars in 1061 bytes} [Sun Sep 11 00:50:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:01.521194 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bd952-1e13-4064-9f2a-134f8dde185a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:01.522680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-014bd952-1e13-4064-9f2a-134f8dde185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:01.571737 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:01.624601 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bd952-1e13-4064-9f2a-134f8dde185a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:01.696736 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aea9f-a153-46f0-b81c-f687f413c959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecc9e16475344b78bb885437b5d6bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:01.697328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aea9f-a153-46f0-b81c-f687f413c959 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:01.697600 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aea9f-a153-46f0-b81c-f687f413c959 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:01.697863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aea9f-a153-46f0-b81c-f687f413c959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:01.699520 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-340aea9f-a153-46f0-b81c-f687f413c959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:01.796621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340aea9f-a153-46f0-b81c-f687f413c959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:01.797974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340aea9f-a153-46f0-b81c-f687f413c959 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:01.801381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:01.816666 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 748/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:01.860943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570224d-bf5e-4f28-bad0-5f0486949abb None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:01.861223 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570224d-bf5e-4f28-bad0-5f0486949abb None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:01.861486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570224d-bf5e-4f28-bad0-5f0486949abb None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:01.862749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 758/1506] 10.222.0.33 () {52 vars in 830 bytes} [Sun Sep 11 00:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:01.866364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aea9f-a153-46f0-b81c-f687f413c959 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:01.867625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-340aea9f-a153-46f0-b81c-f687f413c959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:01.963701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aea9f-a153-46f0-b81c-f687f413c959 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:02.057080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:02.057629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:02.057932 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:02.058173 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] PATH_INFO: `/v3/users/de954006bf9345c38bddaab85321c8db` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:02.071705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de954006bf9345c38bddaab85321c8db)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:02.072728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: WARNING py.warnings [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:50:02.072728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: warnings.warn(msg) Sep 11 00:50:02.072728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: Sep 11 00:50:02.073925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:02.083958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:02.139712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de954006bf9345c38bddaab85321c8db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:50:02.162057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de954006bf9345c38bddaab85321c8db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:50:02.175839 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de954006bf9345c38bddaab85321c8db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:50:02.184984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de954006bf9345c38bddaab85321c8db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:50:02.186022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de954006bf9345c38bddaab85321c8db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:50:02.191874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 749/1507] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:50:01 2022] DELETE /identity/v3/users/de954006bf9345c38bddaab85321c8db => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:50:02.196191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e49b9-cacf-4621-a18d-1098e0117540 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:02.196678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e49b9-cacf-4621-a18d-1098e0117540 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:02.196789 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e49b9-cacf-4621-a18d-1098e0117540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:02.254253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-442e49b9-cacf-4621-a18d-1098e0117540 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:02.255493 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-442e49b9-cacf-4621-a18d-1098e0117540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:02.331105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:02.343547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 759/1508] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:02.352986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:02.354187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:02.455885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1f5e6-9c1f-4bf9-86ef-e64c4cfd1d9f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:02.509775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:02.530516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65eb70-690a-4320-9c1c-269f6ee048f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:02.531150 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65eb70-690a-4320-9c1c-269f6ee048f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:02.531427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65eb70-690a-4320-9c1c-269f6ee048f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:02.531696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65eb70-690a-4320-9c1c-269f6ee048f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:02.533280 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cc65eb70-690a-4320-9c1c-269f6ee048f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:02.640816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65eb70-690a-4320-9c1c-269f6ee048f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:02.642254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65eb70-690a-4320-9c1c-269f6ee048f1 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:02.660748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 750/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:03.156077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e49b9-cacf-4621-a18d-1098e0117540 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:03.157341 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-442e49b9-cacf-4621-a18d-1098e0117540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:03.168871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e49b9-cacf-4621-a18d-1098e0117540 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:03.268989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afb77b-9b09-487a-bb15-97cd9920027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:03.269639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afb77b-9b09-487a-bb15-97cd9920027d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:03.269869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afb77b-9b09-487a-bb15-97cd9920027d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:03.270134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afb77b-9b09-487a-bb15-97cd9920027d admin admin] PATH_INFO: `/v3/projects/ea97b6c07ede49239cf8b5343c193250` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:03.279739 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afb77b-9b09-487a-bb15-97cd9920027d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea97b6c07ede49239cf8b5343c193250)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:03.280741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: WARNING py.warnings [None req-53afb77b-9b09-487a-bb15-97cd9920027d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:50:03.280741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: warnings.warn(msg) Sep 11 00:50:03.280741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: Sep 11 00:50:03.281915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afb77b-9b09-487a-bb15-97cd9920027d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:03.339510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-53afb77b-9b09-487a-bb15-97cd9920027d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea97b6c07ede49239cf8b5343c193250', 'request_id': 'req-53afb77b-9b09-487a-bb15-97cd9920027d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:50:03.353103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-53afb77b-9b09-487a-bb15-97cd9920027d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea97b6c07ede49239cf8b5343c193250', 'request_id': 'req-53afb77b-9b09-487a-bb15-97cd9920027d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:50:03.359815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-53afb77b-9b09-487a-bb15-97cd9920027d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea97b6c07ede49239cf8b5343c193250', 'request_id': 'req-53afb77b-9b09-487a-bb15-97cd9920027d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:50:03.384116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-53afb77b-9b09-487a-bb15-97cd9920027d admin admin] The token cache is being invalidate because project ea97b6c07ede49239cf8b5343c193250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:50:03.384401 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-53afb77b-9b09-487a-bb15-97cd9920027d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:50:03.384825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-53afb77b-9b09-487a-bb15-97cd9920027d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:50:03.386207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 760/1510] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:50:03 2022] DELETE /identity/v3/projects/ea97b6c07ede49239cf8b5343c193250 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:50:12.658459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=62 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:13.382119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:12.843168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df301c-03c7-4dc2-a551-1070fc62e3f5 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:12.843800 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df301c-03c7-4dc2-a551-1070fc62e3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:12.843800 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df301c-03c7-4dc2-a551-1070fc62e3f5 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:12.845080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:12.849902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953aa8e-a070-457c-bd32-0ac8c2f196c2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:12.850334 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953aa8e-a070-457c-bd32-0ac8c2f196c2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:12.850440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953aa8e-a070-457c-bd32-0ac8c2f196c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:12.932008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7953aa8e-a070-457c-bd32-0ac8c2f196c2 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:12.933207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7953aa8e-a070-457c-bd32-0ac8c2f196c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:13.034360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:13.192817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df301c-03c7-4dc2-a551-1070fc62e3f5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:13.194920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-83df301c-03c7-4dc2-a551-1070fc62e3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:13.312132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df301c-03c7-4dc2-a551-1070fc62e3f5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:13.317721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dc439-4ecb-43c8-a98a-8decfe57c5e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:13.318313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dc439-4ecb-43c8-a98a-8decfe57c5e2 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:13.318586 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dc439-4ecb-43c8-a98a-8decfe57c5e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:13.318886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dc439-4ecb-43c8-a98a-8decfe57c5e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:13.326777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dc439-4ecb-43c8-a98a-8decfe57c5e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:13.328348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dc439-4ecb-43c8-a98a-8decfe57c5e2 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:13.337444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 752/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:51:14.411038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bd719-e2b3-46d3-b3ac-da5cdd97d1ca None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:14.411727 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bd719-e2b3-46d3-b3ac-da5cdd97d1ca None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:14.411727 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bd719-e2b3-46d3-b3ac-da5cdd97d1ca None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:14.412970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:14.419122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb148d7-97c5-44ec-8d1a-9e2d739d21a1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:14.419631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb148d7-97c5-44ec-8d1a-9e2d739d21a1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:14.419741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb148d7-97c5-44ec-8d1a-9e2d739d21a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:14.440083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8eb148d7-97c5-44ec-8d1a-9e2d739d21a1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:14.441260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8eb148d7-97c5-44ec-8d1a-9e2d739d21a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:14.449219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:14.601060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bd719-e2b3-46d3-b3ac-da5cdd97d1ca None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:14.615739 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bd719-e2b3-46d3-b3ac-da5cdd97d1ca None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:14.620997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7d769-a437-4e4d-b2ad-5f19a244d4c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:14.621579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7d769-a437-4e4d-b2ad-5f19a244d4c0 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:14.621852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7d769-a437-4e4d-b2ad-5f19a244d4c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:14.622117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7d769-a437-4e4d-b2ad-5f19a244d4c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:14.629968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7d769-a437-4e4d-b2ad-5f19a244d4c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:14.631553 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7d769-a437-4e4d-b2ad-5f19a244d4c0 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:14.640622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 763/1516] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:51:19.329009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a5f6-2107-4854-adeb-2376d8367f3c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:19.329568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a5f6-2107-4854-adeb-2376d8367f3c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:19.329568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a5f6-2107-4854-adeb-2376d8367f3c None None] PATH_INFO: `/v3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:19.330844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 754/1517] 10.222.0.49 () {54 vars in 925 bytes} [Sun Sep 11 00:51:19 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:19.336790 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd078-ef2a-46f6-9c65-7d67e1267188 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:19.337207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd078-ef2a-46f6-9c65-7d67e1267188 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:19.337319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd078-ef2a-46f6-9c65-7d67e1267188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:19.395475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-856bd078-ef2a-46f6-9c65-7d67e1267188 None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:19.396661 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-856bd078-ef2a-46f6-9c65-7d67e1267188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:19.413013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:19.467439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 764/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Sep 11 00:51:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:22.966409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5115ce3-2b90-400a-a44a-c6529df9f537 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:22.966923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5115ce3-2b90-400a-a44a-c6529df9f537 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:22.967049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5115ce3-2b90-400a-a44a-c6529df9f537 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:22.968299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 755/1519] 10.222.0.33 () {54 vars in 961 bytes} [Sun Sep 11 00:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:22.973982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871541c8-71ec-420d-acda-92a20df3bbb4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:22.974419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871541c8-71ec-420d-acda-92a20df3bbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:22.974561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871541c8-71ec-420d-acda-92a20df3bbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:22.994249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-871541c8-71ec-420d-acda-92a20df3bbb4 None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:22.995459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-871541c8-71ec-420d-acda-92a20df3bbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:23.003899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 765/1520] 10.222.0.33 () {58 vars in 1058 bytes} [Sun Sep 11 00:51:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:23.011508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5115ce3-2b90-400a-a44a-c6529df9f537 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:23.024377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5115ce3-2b90-400a-a44a-c6529df9f537 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:23.029245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bd937-2e9f-488c-a1c7-8adab88f6074 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:23.029825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bd937-2e9f-488c-a1c7-8adab88f6074 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:23.030102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bd937-2e9f-488c-a1c7-8adab88f6074 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:23.030367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bd937-2e9f-488c-a1c7-8adab88f6074 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:23.039452 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bd937-2e9f-488c-a1c7-8adab88f6074 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:23.041068 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bd937-2e9f-488c-a1c7-8adab88f6074 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:23.051233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 756/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:51:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:51:26.115679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb1799-0960-4369-a1c5-38cfa59a69f8 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:26.116528 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb1799-0960-4369-a1c5-38cfa59a69f8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:26.116704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb1799-0960-4369-a1c5-38cfa59a69f8 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:26.118128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:26.124152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3a8b6-c952-4d87-827b-248021d4a08d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:26.124589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3a8b6-c952-4d87-827b-248021d4a08d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:26.124701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3a8b6-c952-4d87-827b-248021d4a08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:26.144814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-64a3a8b6-c952-4d87-827b-248021d4a08d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:26.146026 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-64a3a8b6-c952-4d87-827b-248021d4a08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:26.153644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:26.309893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb1799-0960-4369-a1c5-38cfa59a69f8 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:26.325815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb1799-0960-4369-a1c5-38cfa59a69f8 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:26.331283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6efba-a13f-460a-9835-7814eb76e998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:26.331877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6efba-a13f-460a-9835-7814eb76e998 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:26.332156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6efba-a13f-460a-9835-7814eb76e998 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:26.332425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6efba-a13f-460a-9835-7814eb76e998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:26.340445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6efba-a13f-460a-9835-7814eb76e998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:26.342009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6efba-a13f-460a-9835-7814eb76e998 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:26.351379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 767/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:51:27.421106 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6002e-55a4-4cdd-966b-c45b93b213be None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:27.421664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6002e-55a4-4cdd-966b-c45b93b213be None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:27.421664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6002e-55a4-4cdd-966b-c45b93b213be None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:27.423141 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:27.429840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b47d1-e998-4a23-b70c-a36bd084b51c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:27.430244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b47d1-e998-4a23-b70c-a36bd084b51c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:27.430383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b47d1-e998-4a23-b70c-a36bd084b51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:27.450118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ca9b47d1-e998-4a23-b70c-a36bd084b51c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:27.451318 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ca9b47d1-e998-4a23-b70c-a36bd084b51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:27.459599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:27.609661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6002e-55a4-4cdd-966b-c45b93b213be None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:27.624044 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6002e-55a4-4cdd-966b-c45b93b213be None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:27.630104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f70e87-3970-4248-82e4-012377991b52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:27.630686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f70e87-3970-4248-82e4-012377991b52 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:27.630995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f70e87-3970-4248-82e4-012377991b52 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:27.631284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f70e87-3970-4248-82e4-012377991b52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:27.639268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f70e87-3970-4248-82e4-012377991b52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:27.640824 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f70e87-3970-4248-82e4-012377991b52 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:27.650698 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 759/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:51:31.611145 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f72556-abcb-4f3f-a20e-d4c16df3dca7 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:31.611732 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f72556-abcb-4f3f-a20e-d4c16df3dca7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:31.611732 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f72556-abcb-4f3f-a20e-d4c16df3dca7 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:31.613001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:31.618234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f734253-3707-4f30-9019-ab47b613cb97 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:31.618680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f734253-3707-4f30-9019-ab47b613cb97 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:31.618805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f734253-3707-4f30-9019-ab47b613cb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:31.638510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4f734253-3707-4f30-9019-ab47b613cb97 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:31.639764 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4f734253-3707-4f30-9019-ab47b613cb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:31.647703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:31.942630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f72556-abcb-4f3f-a20e-d4c16df3dca7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:31.944632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-86f72556-abcb-4f3f-a20e-d4c16df3dca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:32.021483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f72556-abcb-4f3f-a20e-d4c16df3dca7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:32.024979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a4c9a-7cd5-4d23-b922-cb7cf5ef8970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:32.025560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a4c9a-7cd5-4d23-b922-cb7cf5ef8970 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:32.025839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a4c9a-7cd5-4d23-b922-cb7cf5ef8970 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:32.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a4c9a-7cd5-4d23-b922-cb7cf5ef8970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:32.034989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a4c9a-7cd5-4d23-b922-cb7cf5ef8970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:32.036423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a4c9a-7cd5-4d23-b922-cb7cf5ef8970 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:32.045538 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 770/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:51:34.167616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec949557-94d0-4efb-a668-86279e81c7b0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:34.168172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec949557-94d0-4efb-a668-86279e81c7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:34.168172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec949557-94d0-4efb-a668-86279e81c7b0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:34.169582 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:34.175221 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a57ea-899a-4de7-a77b-0c6cb8c00730 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:34.175664 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a57ea-899a-4de7-a77b-0c6cb8c00730 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:34.175775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a57ea-899a-4de7-a77b-0c6cb8c00730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:34.196212 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ed9a57ea-899a-4de7-a77b-0c6cb8c00730 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:34.197396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ed9a57ea-899a-4de7-a77b-0c6cb8c00730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:34.205192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:34.495494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec949557-94d0-4efb-a668-86279e81c7b0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:34.506143 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec949557-94d0-4efb-a668-86279e81c7b0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:34.509644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827432fd-8db5-4036-9aab-cdcb418bc9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:34.510262 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827432fd-8db5-4036-9aab-cdcb418bc9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:34.510537 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827432fd-8db5-4036-9aab-cdcb418bc9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:34.510841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827432fd-8db5-4036-9aab-cdcb418bc9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:34.520115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827432fd-8db5-4036-9aab-cdcb418bc9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:34.521534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827432fd-8db5-4036-9aab-cdcb418bc9a1 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:34.530692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 762/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:51:44.190109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=73 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:44.526618 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=80 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:50.164558 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0caccf-f41f-49ed-94c4-125a37a52a03 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.165714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0caccf-f41f-49ed-94c4-125a37a52a03 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.166249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0caccf-f41f-49ed-94c4-125a37a52a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.181815 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076e2c-c437-4fa1-b1f8-c6a5900bcc66 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.183002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076e2c-c437-4fa1-b1f8-c6a5900bcc66 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.183508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076e2c-c437-4fa1-b1f8-c6a5900bcc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.190368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ed0caccf-f41f-49ed-94c4-125a37a52a03 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.192207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ed0caccf-f41f-49ed-94c4-125a37a52a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.212426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 772/1534] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:50.218666 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-15076e2c-c437-4fa1-b1f8-c6a5900bcc66 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.220221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-15076e2c-c437-4fa1-b1f8-c6a5900bcc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.221342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdf460-6e7d-4091-8929-aa6b3eb3fc7e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.221632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdf460-6e7d-4091-8929-aa6b3eb3fc7e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.221905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdf460-6e7d-4091-8929-aa6b3eb3fc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.237697 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 763/1535] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:52:50.247648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89da457-e6d8-40ed-9765-eea6b92687b1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.247998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89da457-e6d8-40ed-9765-eea6b92687b1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.248197 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89da457-e6d8-40ed-9765-eea6b92687b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.255639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d1cdf460-6e7d-4091-8929-aa6b3eb3fc7e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.256882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d1cdf460-6e7d-4091-8929-aa6b3eb3fc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.276682 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 773/1536] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:52:50.279888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b89da457-e6d8-40ed-9765-eea6b92687b1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.281189 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdf460-6e7d-4091-8929-aa6b3eb3fc7e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.282037 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b89da457-e6d8-40ed-9765-eea6b92687b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.297229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdf460-6e7d-4091-8929-aa6b3eb3fc7e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.301218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 764/1537] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:52:50.306277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89da457-e6d8-40ed-9765-eea6b92687b1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.306482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39f38-735c-4c92-ab70-2211af5ccb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.307077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39f38-735c-4c92-ab70-2211af5ccb3b admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.307361 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39f38-735c-4c92-ab70-2211af5ccb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.307635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39f38-735c-4c92-ab70-2211af5ccb3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.308289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c39f38-735c-4c92-ab70-2211af5ccb3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:52:50.308593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c39f38-735c-4c92-ab70-2211af5ccb3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.310189 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c39f38-735c-4c92-ab70-2211af5ccb3b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.316882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89da457-e6d8-40ed-9765-eea6b92687b1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.328238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491aa47e-19ac-43cf-a016-77304cbead2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.328857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aa47e-19ac-43cf-a016-77304cbead2b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.329141 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aa47e-19ac-43cf-a016-77304cbead2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.329413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aa47e-19ac-43cf-a016-77304cbead2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.330063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491aa47e-19ac-43cf-a016-77304cbead2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:52:50.330363 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491aa47e-19ac-43cf-a016-77304cbead2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.331430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: WARNING py.warnings [None req-491aa47e-19ac-43cf-a016-77304cbead2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:52:50.331430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: warnings.warn(msg) Sep 11 00:52:50.331430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: Sep 11 00:52:50.355773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491aa47e-19ac-43cf-a016-77304cbead2b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.355967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 774/1538] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:52:50.355967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39f38-735c-4c92-ab70-2211af5ccb3b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.356318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 765/1539] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:52:50.366207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39f38-735c-4c92-ab70-2211af5ccb3b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.374748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491aa47e-19ac-43cf-a016-77304cbead2b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.374994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c464729-1fa0-4ade-babe-c3ca9930f976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.374994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c464729-1fa0-4ade-babe-c3ca9930f976 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.374994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c464729-1fa0-4ade-babe-c3ca9930f976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.374994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c464729-1fa0-4ade-babe-c3ca9930f976 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.380005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c464729-1fa0-4ade-babe-c3ca9930f976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.382762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: WARNING py.warnings [None req-2c464729-1fa0-4ade-babe-c3ca9930f976 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:52:50.382762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: warnings.warn(msg) Sep 11 00:52:50.382762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: Sep 11 00:52:50.382762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c464729-1fa0-4ade-babe-c3ca9930f976 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.390294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491aa47e-19ac-43cf-a016-77304cbead2b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.404658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcbed4-0503-4099-a5ff-a873cab6bfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.404941 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcbed4-0503-4099-a5ff-a873cab6bfad admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.405107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcbed4-0503-4099-a5ff-a873cab6bfad admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.405719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcbed4-0503-4099-a5ff-a873cab6bfad admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.406433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcbed4-0503-4099-a5ff-a873cab6bfad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.408747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcbed4-0503-4099-a5ff-a873cab6bfad admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.457984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 775/1540] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:52:50.459298 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed321a-e9e3-4538-94ef-094f8d7cee3e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.459575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed321a-e9e3-4538-94ef-094f8d7cee3e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.459853 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed321a-e9e3-4538-94ef-094f8d7cee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.468320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 766/1541] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:50.469604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956b438-11ab-42e1-a314-35f5b472d51c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.469895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956b438-11ab-42e1-a314-35f5b472d51c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.470168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956b438-11ab-42e1-a314-35f5b472d51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.510165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e9ed321a-e9e3-4538-94ef-094f8d7cee3e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.511413 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e9ed321a-e9e3-4538-94ef-094f8d7cee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.513085 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4956b438-11ab-42e1-a314-35f5b472d51c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.514190 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4956b438-11ab-42e1-a314-35f5b472d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.576925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 767/1542] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:50.578365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9825f95-2013-4625-8e90-c755ce44fbf2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.578656 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9825f95-2013-4625-8e90-c755ce44fbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.578960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9825f95-2013-4625-8e90-c755ce44fbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.582637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 776/1543] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:50.583290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed321a-e9e3-4538-94ef-094f8d7cee3e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.593007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed321a-e9e3-4538-94ef-094f8d7cee3e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.598170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a484a3-7f6d-4374-97a5-f262ca9cb645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.598786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a484a3-7f6d-4374-97a5-f262ca9cb645 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.599077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a484a3-7f6d-4374-97a5-f262ca9cb645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.599350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a484a3-7f6d-4374-97a5-f262ca9cb645 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.599976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a484a3-7f6d-4374-97a5-f262ca9cb645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.601886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a484a3-7f6d-4374-97a5-f262ca9cb645 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.603138 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a9825f95-2013-4625-8e90-c755ce44fbf2 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.604325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a9825f95-2013-4625-8e90-c755ce44fbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.612808 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 768/1544] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:50.614213 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9825f95-2013-4625-8e90-c755ce44fbf2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.623689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9825f95-2013-4625-8e90-c755ce44fbf2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.624236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 777/1545] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/users => generated 290 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:50.625556 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209797b5-e67b-42e0-85a8-f89bf6c5e1cb None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.625877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209797b5-e67b-42e0-85a8-f89bf6c5e1cb None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.626153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209797b5-e67b-42e0-85a8-f89bf6c5e1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.631868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36c47f-e8ec-4cb0-bd30-d342f553766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.632553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36c47f-e8ec-4cb0-bd30-d342f553766b admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.632836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36c47f-e8ec-4cb0-bd30-d342f553766b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.633108 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36c47f-e8ec-4cb0-bd30-d342f553766b admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.634182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36c47f-e8ec-4cb0-bd30-d342f553766b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.635293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: WARNING py.warnings [None req-2f36c47f-e8ec-4cb0-bd30-d342f553766b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:52:50.635293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: warnings.warn(msg) Sep 11 00:52:50.635293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: Sep 11 00:52:50.636534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36c47f-e8ec-4cb0-bd30-d342f553766b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.645074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-209797b5-e67b-42e0-85a8-f89bf6c5e1cb None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.646269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-209797b5-e67b-42e0-85a8-f89bf6c5e1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.655987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 778/1546] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:50.657190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10250cc8-11f2-4446-91dc-5fd26d87edd1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.657439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10250cc8-11f2-4446-91dc-5fd26d87edd1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.657711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10250cc8-11f2-4446-91dc-5fd26d87edd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.662966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 769/1547] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/users => generated 284 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:50.662966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd9bc9-f7de-48d6-b87d-2e13d9dca33a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.662966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd9bc9-f7de-48d6-b87d-2e13d9dca33a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.662966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd9bc9-f7de-48d6-b87d-2e13d9dca33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.680744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-10250cc8-11f2-4446-91dc-5fd26d87edd1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.681477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-50bd9bc9-f7de-48d6-b87d-2e13d9dca33a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.681942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-10250cc8-11f2-4446-91dc-5fd26d87edd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.682639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-50bd9bc9-f7de-48d6-b87d-2e13d9dca33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.689886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 779/1548] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:50.690524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 770/1549] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:50.691106 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0d4c3-858f-43e1-9ad6-a2a9ca31735e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.691387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0d4c3-858f-43e1-9ad6-a2a9ca31735e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.691657 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0d4c3-858f-43e1-9ad6-a2a9ca31735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.698713 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73874c0-3cf8-4ab7-9d03-05d914d72f17 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.699144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73874c0-3cf8-4ab7-9d03-05d914d72f17 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.699427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73874c0-3cf8-4ab7-9d03-05d914d72f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.715316 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-bac0d4c3-858f-43e1-9ad6-a2a9ca31735e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.716502 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bac0d4c3-858f-43e1-9ad6-a2a9ca31735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.718276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f73874c0-3cf8-4ab7-9d03-05d914d72f17 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.719478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f73874c0-3cf8-4ab7-9d03-05d914d72f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.724988 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 780/1550] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:50.727122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616451d5-dd0b-4a5c-b83b-b5234cf7e805 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.727412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616451d5-dd0b-4a5c-b83b-b5234cf7e805 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.727692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616451d5-dd0b-4a5c-b83b-b5234cf7e805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.730502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 771/1551] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:50.730502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73874c0-3cf8-4ab7-9d03-05d914d72f17 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.740233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73874c0-3cf8-4ab7-9d03-05d914d72f17 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.744867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f94b4e-59db-48ee-a855-a2812cad4036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.745471 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f94b4e-59db-48ee-a855-a2812cad4036 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.745752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f94b4e-59db-48ee-a855-a2812cad4036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.746024 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f94b4e-59db-48ee-a855-a2812cad4036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.746656 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f94b4e-59db-48ee-a855-a2812cad4036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.748052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-616451d5-dd0b-4a5c-b83b-b5234cf7e805 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.748262 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f94b4e-59db-48ee-a855-a2812cad4036 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.749238 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-616451d5-dd0b-4a5c-b83b-b5234cf7e805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.757382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 781/1552] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:50.757986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616451d5-dd0b-4a5c-b83b-b5234cf7e805 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.761195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 772/1553] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:50.761195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb41117-6396-4add-934b-759a82bb2305 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.761195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb41117-6396-4add-934b-759a82bb2305 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.761195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb41117-6396-4add-934b-759a82bb2305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.770977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616451d5-dd0b-4a5c-b83b-b5234cf7e805 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.775684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084082d-3e50-46c5-80f7-02d75919d127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.776274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084082d-3e50-46c5-80f7-02d75919d127 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.776579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084082d-3e50-46c5-80f7-02d75919d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.776848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084082d-3e50-46c5-80f7-02d75919d127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.777510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084082d-3e50-46c5-80f7-02d75919d127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.778827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-dcb41117-6396-4add-934b-759a82bb2305 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.779125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084082d-3e50-46c5-80f7-02d75919d127 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.780008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dcb41117-6396-4add-934b-759a82bb2305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.788742 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 773/1554] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:50.792804 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 782/1555] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:50.792948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05350166-8693-46a5-b475-c1c05c8719ae None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.792948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05350166-8693-46a5-b475-c1c05c8719ae None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.792948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05350166-8693-46a5-b475-c1c05c8719ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.793150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa6682-88c9-4ced-a906-0b1e778f6ec8 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.793150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa6682-88c9-4ced-a906-0b1e778f6ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.793150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa6682-88c9-4ced-a906-0b1e778f6ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.810232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-05350166-8693-46a5-b475-c1c05c8719ae None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.811463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-05350166-8693-46a5-b475-c1c05c8719ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.811604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-44fa6682-88c9-4ced-a906-0b1e778f6ec8 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:50.812895 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-44fa6682-88c9-4ced-a906-0b1e778f6ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:50.819351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 774/1556] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:50.823209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05350166-8693-46a5-b475-c1c05c8719ae None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.823631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 783/1557] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:50.824840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa6682-88c9-4ced-a906-0b1e778f6ec8 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.829635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05350166-8693-46a5-b475-c1c05c8719ae None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.834351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa6682-88c9-4ced-a906-0b1e778f6ec8 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.834864 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62186a-4047-404d-92a9-637c85cf0ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.835452 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62186a-4047-404d-92a9-637c85cf0ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.835729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62186a-4047-404d-92a9-637c85cf0ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.835998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62186a-4047-404d-92a9-637c85cf0ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.836636 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62186a-4047-404d-92a9-637c85cf0ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:52:50.836932 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62186a-4047-404d-92a9-637c85cf0ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.838523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62186a-4047-404d-92a9-637c85cf0ea3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.839057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc478c-e281-4dc6-b6d8-9b68a6de29fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.839644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc478c-e281-4dc6-b6d8-9b68a6de29fa admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.839960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc478c-e281-4dc6-b6d8-9b68a6de29fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.840266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc478c-e281-4dc6-b6d8-9b68a6de29fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.841156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc478c-e281-4dc6-b6d8-9b68a6de29fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:52:50.841842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc478c-e281-4dc6-b6d8-9b68a6de29fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.842814 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc478c-e281-4dc6-b6d8-9b68a6de29fa admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.860517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 775/1558] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:52:50.860517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62186a-4047-404d-92a9-637c85cf0ea3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.863939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 784/1559] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:52:50.864915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc478c-e281-4dc6-b6d8-9b68a6de29fa admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.865913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62186a-4047-404d-92a9-637c85cf0ea3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.870418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df99bdb-0722-4cfe-9de8-c7b91f774d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.871121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df99bdb-0722-4cfe-9de8-c7b91f774d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.871396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df99bdb-0722-4cfe-9de8-c7b91f774d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.871846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df99bdb-0722-4cfe-9de8-c7b91f774d3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.872496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df99bdb-0722-4cfe-9de8-c7b91f774d3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:52:50.872793 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df99bdb-0722-4cfe-9de8-c7b91f774d3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.875015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df99bdb-0722-4cfe-9de8-c7b91f774d3c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.876855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc478c-e281-4dc6-b6d8-9b68a6de29fa admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.882117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4869322-4790-4cb4-b134-98732533b5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.882826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4869322-4790-4cb4-b134-98732533b5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.883172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4869322-4790-4cb4-b134-98732533b5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.883527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4869322-4790-4cb4-b134-98732533b5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.884230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4869322-4790-4cb4-b134-98732533b5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.885884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4869322-4790-4cb4-b134-98732533b5b8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.888228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 776/1560] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:52:50.889099 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df99bdb-0722-4cfe-9de8-c7b91f774d3c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.899400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df99bdb-0722-4cfe-9de8-c7b91f774d3c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.902615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 785/1561] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:50.902615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4869322-4790-4cb4-b134-98732533b5b8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.906772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acb807-7dfc-48e8-8ba6-066d6909d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.907455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acb807-7dfc-48e8-8ba6-066d6909d429 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.907792 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acb807-7dfc-48e8-8ba6-066d6909d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.908123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acb807-7dfc-48e8-8ba6-066d6909d429 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.908828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acb807-7dfc-48e8-8ba6-066d6909d429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:52:50.909196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acb807-7dfc-48e8-8ba6-066d6909d429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.911502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acb807-7dfc-48e8-8ba6-066d6909d429 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.913292 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4869322-4790-4cb4-b134-98732533b5b8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.919050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b36e1-00d9-441e-8761-efd4f8b78505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.919652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b36e1-00d9-441e-8761-efd4f8b78505 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.919932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b36e1-00d9-441e-8761-efd4f8b78505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.920202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b36e1-00d9-441e-8761-efd4f8b78505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.920841 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b36e1-00d9-441e-8761-efd4f8b78505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.922424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b36e1-00d9-441e-8761-efd4f8b78505 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.924821 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 777/1562] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:52:50.925813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acb807-7dfc-48e8-8ba6-066d6909d429 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.936969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 786/1563] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:50.938307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b36e1-00d9-441e-8761-efd4f8b78505 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.943246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acb807-7dfc-48e8-8ba6-066d6909d429 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.948497 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07234212-eab3-4d56-875f-6e9801313cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.949092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07234212-eab3-4d56-875f-6e9801313cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.949366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07234212-eab3-4d56-875f-6e9801313cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.949630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07234212-eab3-4d56-875f-6e9801313cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.950269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07234212-eab3-4d56-875f-6e9801313cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:52:50.950564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07234212-eab3-4d56-875f-6e9801313cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.950850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b36e1-00d9-441e-8761-efd4f8b78505 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.952299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07234212-eab3-4d56-875f-6e9801313cc8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.955449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d0f2-c728-4337-b57e-c48b02ee9cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.956081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d0f2-c728-4337-b57e-c48b02ee9cba admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.956371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d0f2-c728-4337-b57e-c48b02ee9cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.956640 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d0f2-c728-4337-b57e-c48b02ee9cba admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.957812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728d0f2-c728-4337-b57e-c48b02ee9cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:52:50.958114 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728d0f2-c728-4337-b57e-c48b02ee9cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.959756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728d0f2-c728-4337-b57e-c48b02ee9cba admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.961130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:50.961484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:50.970616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 778/1564] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:52:50.971738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07234212-eab3-4d56-875f-6e9801313cc8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.978195 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 787/1565] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:52:50.980320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d0f2-c728-4337-b57e-c48b02ee9cba admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:50.983751 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07234212-eab3-4d56-875f-6e9801313cc8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.988867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ae886-10ee-400a-a74a-b5cd972eb7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.989567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ae886-10ee-400a-a74a-b5cd972eb7dd admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.989911 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ae886-10ee-400a-a74a-b5cd972eb7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:50.990243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ae886-10ee-400a-a74a-b5cd972eb7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:50.991107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ae886-10ee-400a-a74a-b5cd972eb7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:50.993032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ae886-10ee-400a-a74a-b5cd972eb7dd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:50.993492 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d0f2-c728-4337-b57e-c48b02ee9cba admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:50.998597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8360c-d184-44d6-b509-5e1d29efd156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:50.999330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8360c-d184-44d6-b509-5e1d29efd156 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:50.999831 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8360c-d184-44d6-b509-5e1d29efd156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.000107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8360c-d184-44d6-b509-5e1d29efd156 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.000784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8360c-d184-44d6-b509-5e1d29efd156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.002719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8360c-d184-44d6-b509-5e1d29efd156 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.024984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 779/1566] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:51.026211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ae886-10ee-400a-a74a-b5cd972eb7dd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.033645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 788/1567] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:52:50 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:51.034548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8360c-d184-44d6-b509-5e1d29efd156 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.099814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ae886-10ee-400a-a74a-b5cd972eb7dd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.104316 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f57c01-5d92-4954-9995-4c00bc9e1c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.104909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8360c-d184-44d6-b509-5e1d29efd156 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.105011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f57c01-5d92-4954-9995-4c00bc9e1c59 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.105197 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f57c01-5d92-4954-9995-4c00bc9e1c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.105442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f57c01-5d92-4954-9995-4c00bc9e1c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.106093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f57c01-5d92-4954-9995-4c00bc9e1c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.108048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f57c01-5d92-4954-9995-4c00bc9e1c59 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.109647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbef0e0-f3bc-46f2-a5aa-3ab833b662ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.110343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbef0e0-f3bc-46f2-a5aa-3ab833b662ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.110581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbef0e0-f3bc-46f2-a5aa-3ab833b662ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.111022 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbef0e0-f3bc-46f2-a5aa-3ab833b662ae admin admin] PATH_INFO: `/v3/projects/6baba882cba943bfb7bad82fa538248b/users/6aa81fbf97d3485d845d5cc04449efb0/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.126782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbef0e0-f3bc-46f2-a5aa-3ab833b662ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6baba882cba943bfb7bad82fa538248b, user_id=6aa81fbf97d3485d845d5cc04449efb0, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.127985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: WARNING py.warnings [None req-fcbef0e0-f3bc-46f2-a5aa-3ab833b662ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:52:51.127985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: warnings.warn(msg) Sep 11 00:52:51.127985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: Sep 11 00:52:51.130682 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbef0e0-f3bc-46f2-a5aa-3ab833b662ae admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.136180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 780/1568] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:52:51 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:51.137058 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f57c01-5d92-4954-9995-4c00bc9e1c59 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.145175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 789/1569] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:51 2022] PUT /identity/v3/projects/6baba882cba943bfb7bad82fa538248b/users/6aa81fbf97d3485d845d5cc04449efb0/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:51.148893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbef0e0-f3bc-46f2-a5aa-3ab833b662ae admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.200546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f57c01-5d92-4954-9995-4c00bc9e1c59 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.211809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbef0e0-f3bc-46f2-a5aa-3ab833b662ae admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.216991 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2165b13-bd91-4d90-b1f5-ff663e37da32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.217652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2165b13-bd91-4d90-b1f5-ff663e37da32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.217934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2165b13-bd91-4d90-b1f5-ff663e37da32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.218208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2165b13-bd91-4d90-b1f5-ff663e37da32 admin admin] PATH_INFO: `/v3/projects/4b2ad68aa304432cb2693f2b63387110/users/d5559495af904f3ab40abcec18259f63/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.235408 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2165b13-bd91-4d90-b1f5-ff663e37da32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2ad68aa304432cb2693f2b63387110, user_id=d5559495af904f3ab40abcec18259f63, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.238597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2165b13-bd91-4d90-b1f5-ff663e37da32 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.252365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 790/1570] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:51 2022] PUT /identity/v3/projects/4b2ad68aa304432cb2693f2b63387110/users/d5559495af904f3ab40abcec18259f63/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:51.256804 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2165b13-bd91-4d90-b1f5-ff663e37da32 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.263353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261b433-a917-46fd-b0b4-7b0b289432d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.263959 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261b433-a917-46fd-b0b4-7b0b289432d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.264239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261b433-a917-46fd-b0b4-7b0b289432d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.264510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261b433-a917-46fd-b0b4-7b0b289432d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.265134 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261b433-a917-46fd-b0b4-7b0b289432d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.267140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261b433-a917-46fd-b0b4-7b0b289432d3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.281378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:51.294454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:51.295735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 781/1571] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:52:51 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:51.296489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261b433-a917-46fd-b0b4-7b0b289432d3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.317623 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2165b13-bd91-4d90-b1f5-ff663e37da32 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.362351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261b433-a917-46fd-b0b4-7b0b289432d3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.367304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edbeed-9018-4460-b547-1e39a3193150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.367917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edbeed-9018-4460-b547-1e39a3193150 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.368193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edbeed-9018-4460-b547-1e39a3193150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.368467 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edbeed-9018-4460-b547-1e39a3193150 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.369098 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edbeed-9018-4460-b547-1e39a3193150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.371039 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edbeed-9018-4460-b547-1e39a3193150 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.374665 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c8aed-4145-4090-be1d-712e9721cac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.375438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c8aed-4145-4090-be1d-712e9721cac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.375652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c8aed-4145-4090-be1d-712e9721cac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.375919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c8aed-4145-4090-be1d-712e9721cac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.376537 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c8aed-4145-4090-be1d-712e9721cac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.378434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c8aed-4145-4090-be1d-712e9721cac2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.400476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 782/1572] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:52:51 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:51.403678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edbeed-9018-4460-b547-1e39a3193150 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.405552 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 791/1573] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:52:51 2022] POST /identity/v3/projects => generated 399 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:51.406351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c8aed-4145-4090-be1d-712e9721cac2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.466250 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edbeed-9018-4460-b547-1e39a3193150 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.470900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80202506-a0ad-4c5a-b0ca-c95c056ffa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.471505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80202506-a0ad-4c5a-b0ca-c95c056ffa5f admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.471843 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80202506-a0ad-4c5a-b0ca-c95c056ffa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.472117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80202506-a0ad-4c5a-b0ca-c95c056ffa5f admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.472796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80202506-a0ad-4c5a-b0ca-c95c056ffa5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.473695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c8aed-4145-4090-be1d-712e9721cac2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.474786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80202506-a0ad-4c5a-b0ca-c95c056ffa5f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.478302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf05734-01a0-42d4-b4e0-427a2114d91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.478916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf05734-01a0-42d4-b4e0-427a2114d91d admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.479194 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf05734-01a0-42d4-b4e0-427a2114d91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.479484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf05734-01a0-42d4-b4e0-427a2114d91d admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.480101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf05734-01a0-42d4-b4e0-427a2114d91d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.481975 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf05734-01a0-42d4-b4e0-427a2114d91d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.496039 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 783/1574] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:52:51 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:51.499767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80202506-a0ad-4c5a-b0ca-c95c056ffa5f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.505588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 792/1575] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:52:51 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:51.506984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2091f-5c1d-4a29-8832-013b0aa068f1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.507265 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2091f-5c1d-4a29-8832-013b0aa068f1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.507532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2091f-5c1d-4a29-8832-013b0aa068f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.510509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80202506-a0ad-4c5a-b0ca-c95c056ffa5f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.515099 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf0633-1a35-4d0b-805a-bf9b53350d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.515704 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf0633-1a35-4d0b-805a-bf9b53350d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.515995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf0633-1a35-4d0b-805a-bf9b53350d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.516277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf0633-1a35-4d0b-805a-bf9b53350d00 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.516949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf0633-1a35-4d0b-805a-bf9b53350d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.518921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf0633-1a35-4d0b-805a-bf9b53350d00 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.526247 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-35a2091f-5c1d-4a29-8832-013b0aa068f1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:51.527461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-35a2091f-5c1d-4a29-8832-013b0aa068f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:51.535567 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 793/1576] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:51.539783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc5d48-41d6-4b35-8c3c-99d56f748f1d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.540064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc5d48-41d6-4b35-8c3c-99d56f748f1d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.540359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc5d48-41d6-4b35-8c3c-99d56f748f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.544236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 784/1577] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:52:51 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:51.544236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf0633-1a35-4d0b-805a-bf9b53350d00 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.551973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf0633-1a35-4d0b-805a-bf9b53350d00 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.556567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1635d-31f5-4d6b-af35-16099d47199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.557286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1635d-31f5-4d6b-af35-16099d47199a admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.557565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1635d-31f5-4d6b-af35-16099d47199a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.557828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1635d-31f5-4d6b-af35-16099d47199a admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.558445 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1635d-31f5-4d6b-af35-16099d47199a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.560380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1635d-31f5-4d6b-af35-16099d47199a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.560766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2bdc5d48-41d6-4b35-8c3c-99d56f748f1d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:51.561936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2bdc5d48-41d6-4b35-8c3c-99d56f748f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:51.569934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 794/1578] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:51.570673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc5d48-41d6-4b35-8c3c-99d56f748f1d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.581212 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc5d48-41d6-4b35-8c3c-99d56f748f1d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.586998 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe335b87-a640-47f2-8d87-11e4246e319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.587575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe335b87-a640-47f2-8d87-11e4246e319a admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.587848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe335b87-a640-47f2-8d87-11e4246e319a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.588112 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe335b87-a640-47f2-8d87-11e4246e319a admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.588728 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe335b87-a640-47f2-8d87-11e4246e319a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.590476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 785/1579] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:52:51 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:51.591366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1635d-31f5-4d6b-af35-16099d47199a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.593710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe335b87-a640-47f2-8d87-11e4246e319a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.600900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1635d-31f5-4d6b-af35-16099d47199a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.606004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8706e-8245-4873-bc57-03d6b69a624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.606646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8706e-8245-4873-bc57-03d6b69a624a admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.606944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8706e-8245-4873-bc57-03d6b69a624a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.607181 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8706e-8245-4873-bc57-03d6b69a624a admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.607867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8706e-8245-4873-bc57-03d6b69a624a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.609754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8706e-8245-4873-bc57-03d6b69a624a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.619351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 795/1580] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:52:51 2022] POST /identity/v3/users => generated 284 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:51.619351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe335b87-a640-47f2-8d87-11e4246e319a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.630037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe335b87-a640-47f2-8d87-11e4246e319a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.630429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 786/1581] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:52:51 2022] POST /identity/v3/users => generated 300 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:51.631257 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8706e-8245-4873-bc57-03d6b69a624a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.638548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782cd43-cbb6-4cb8-85f5-a37f55e294d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.639191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782cd43-cbb6-4cb8-85f5-a37f55e294d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.639470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782cd43-cbb6-4cb8-85f5-a37f55e294d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.639743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782cd43-cbb6-4cb8-85f5-a37f55e294d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.640382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782cd43-cbb6-4cb8-85f5-a37f55e294d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.640469 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8706e-8245-4873-bc57-03d6b69a624a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.641970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782cd43-cbb6-4cb8-85f5-a37f55e294d7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.645535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e18ce7-d931-4a51-8904-bdbdc9bed26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.646117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e18ce7-d931-4a51-8904-bdbdc9bed26d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.646392 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e18ce7-d931-4a51-8904-bdbdc9bed26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.646658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e18ce7-d931-4a51-8904-bdbdc9bed26d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.647323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e18ce7-d931-4a51-8904-bdbdc9bed26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.648884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e18ce7-d931-4a51-8904-bdbdc9bed26d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.653152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 796/1582] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:51.654013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782cd43-cbb6-4cb8-85f5-a37f55e294d7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.658654 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 787/1583] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:51.659511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e18ce7-d931-4a51-8904-bdbdc9bed26d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.665364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:INSERT=14,keystone:SELECT=86 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:51.666373 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782cd43-cbb6-4cb8-85f5-a37f55e294d7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.671548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f803b31-6cf6-4c4e-8c3c-870430dbf46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.672139 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f803b31-6cf6-4c4e-8c3c-870430dbf46f admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.672424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f803b31-6cf6-4c4e-8c3c-870430dbf46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.672698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f803b31-6cf6-4c4e-8c3c-870430dbf46f admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.673331 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f803b31-6cf6-4c4e-8c3c-870430dbf46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.674946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f803b31-6cf6-4c4e-8c3c-870430dbf46f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.686012 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 797/1584] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:51.686878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f803b31-6cf6-4c4e-8c3c-870430dbf46f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.690432 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3f803b31-6cf6-4c4e-8c3c-870430dbf46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:51.700479 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:51.716960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e18ce7-d931-4a51-8904-bdbdc9bed26d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.720898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7cafd-34d2-4224-b157-c2a8b083f94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.721500 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7cafd-34d2-4224-b157-c2a8b083f94f service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.721774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7cafd-34d2-4224-b157-c2a8b083f94f service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.722102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7cafd-34d2-4224-b157-c2a8b083f94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.731015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7cafd-34d2-4224-b157-c2a8b083f94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.732437 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7cafd-34d2-4224-b157-c2a8b083f94f service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.742665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 788/1585] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:51.747699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7cafd-34d2-4224-b157-c2a8b083f94f service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.748107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f803b31-6cf6-4c4e-8c3c-870430dbf46f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.751823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dc903-3831-4e06-8876-4e44b0110f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.752426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dc903-3831-4e06-8876-4e44b0110f52 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.752700 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dc903-3831-4e06-8876-4e44b0110f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.752969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dc903-3831-4e06-8876-4e44b0110f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.757643 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7cafd-34d2-4224-b157-c2a8b083f94f service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.762704 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da581b5-6714-49da-84d8-c5722b2eb0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.763285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da581b5-6714-49da-84d8-c5722b2eb0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.763562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da581b5-6714-49da-84d8-c5722b2eb0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.763760 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dc903-3831-4e06-8876-4e44b0110f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.763855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da581b5-6714-49da-84d8-c5722b2eb0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.764467 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da581b5-6714-49da-84d8-c5722b2eb0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.765192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dc903-3831-4e06-8876-4e44b0110f52 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.766003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da581b5-6714-49da-84d8-c5722b2eb0e8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.776313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 798/1586] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:51.776925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dc903-3831-4e06-8876-4e44b0110f52 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.786899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 789/1587] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:51.788782 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da581b5-6714-49da-84d8-c5722b2eb0e8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.789902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dc903-3831-4e06-8876-4e44b0110f52 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.794588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7cc2d-4e10-441e-aee4-d5dc518376fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.795220 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7cc2d-4e10-441e-aee4-d5dc518376fc admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.795507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7cc2d-4e10-441e-aee4-d5dc518376fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.795758 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7cc2d-4e10-441e-aee4-d5dc518376fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.796389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7cc2d-4e10-441e-aee4-d5dc518376fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.797965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7cc2d-4e10-441e-aee4-d5dc518376fc admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.807496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da581b5-6714-49da-84d8-c5722b2eb0e8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.810252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 799/1588] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:51.811387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7cc2d-4e10-441e-aee4-d5dc518376fc admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.816231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84108e4-c41e-4087-b7db-3cf56cf9d2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.818269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84108e4-c41e-4087-b7db-3cf56cf9d2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.818843 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84108e4-c41e-4087-b7db-3cf56cf9d2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.819225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84108e4-c41e-4087-b7db-3cf56cf9d2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.820620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84108e4-c41e-4087-b7db-3cf56cf9d2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.823737 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84108e4-c41e-4087-b7db-3cf56cf9d2f5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.825073 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7cc2d-4e10-441e-aee4-d5dc518376fc admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.830645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695225db-ccb6-4c52-b35c-cefc183bca74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.831276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695225db-ccb6-4c52-b35c-cefc183bca74 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.831832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695225db-ccb6-4c52-b35c-cefc183bca74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.832326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695225db-ccb6-4c52-b35c-cefc183bca74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.833161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695225db-ccb6-4c52-b35c-cefc183bca74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.835394 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695225db-ccb6-4c52-b35c-cefc183bca74 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.842572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 790/1589] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:51.844556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84108e4-c41e-4087-b7db-3cf56cf9d2f5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.852132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 800/1590] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:51.853063 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695225db-ccb6-4c52-b35c-cefc183bca74 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.858763 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84108e4-c41e-4087-b7db-3cf56cf9d2f5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.863860 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695225db-ccb6-4c52-b35c-cefc183bca74 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.866479 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41270fdb-965e-4785-806f-eff090d2ee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41270fdb-965e-4785-806f-eff090d2ee50 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.868464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41270fdb-965e-4785-806f-eff090d2ee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.868984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41270fdb-965e-4785-806f-eff090d2ee50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.869424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb82f2a-58e8-4cf0-a697-18f62c49b755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.869967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41270fdb-965e-4785-806f-eff090d2ee50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.870122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb82f2a-58e8-4cf0-a697-18f62c49b755 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.870415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb82f2a-58e8-4cf0-a697-18f62c49b755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.870842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb82f2a-58e8-4cf0-a697-18f62c49b755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.871839 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41270fdb-965e-4785-806f-eff090d2ee50 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.871963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb82f2a-58e8-4cf0-a697-18f62c49b755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.874274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb82f2a-58e8-4cf0-a697-18f62c49b755 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.888739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 791/1591] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:51.888739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41270fdb-965e-4785-806f-eff090d2ee50 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.889465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 801/1592] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:51.890630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb82f2a-58e8-4cf0-a697-18f62c49b755 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.904025 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41270fdb-965e-4785-806f-eff090d2ee50 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.908017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb82f2a-58e8-4cf0-a697-18f62c49b755 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.909873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255aab3f-ed3c-4697-8629-0b3a24de0f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.910888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aab3f-ed3c-4697-8629-0b3a24de0f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.911276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aab3f-ed3c-4697-8629-0b3a24de0f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.911558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aab3f-ed3c-4697-8629-0b3a24de0f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.912405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255aab3f-ed3c-4697-8629-0b3a24de0f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.914293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255aab3f-ed3c-4697-8629-0b3a24de0f12 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.916426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a3d2c-994d-4818-9fd7-8d5698fa1eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.917203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a3d2c-994d-4818-9fd7-8d5698fa1eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.917709 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a3d2c-994d-4818-9fd7-8d5698fa1eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.918203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a3d2c-994d-4818-9fd7-8d5698fa1eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.919310 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a3d2c-994d-4818-9fd7-8d5698fa1eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.921760 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a3d2c-994d-4818-9fd7-8d5698fa1eb3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.928197 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 792/1593] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:51.929311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255aab3f-ed3c-4697-8629-0b3a24de0f12 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.944088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 802/1594] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:51.944306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255aab3f-ed3c-4697-8629-0b3a24de0f12 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.944398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a3d2c-994d-4818-9fd7-8d5698fa1eb3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.947285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cdacf-fca7-4eb3-8554-0a60feefd76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.948288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cdacf-fca7-4eb3-8554-0a60feefd76a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.948579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cdacf-fca7-4eb3-8554-0a60feefd76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.949030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cdacf-fca7-4eb3-8554-0a60feefd76a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.951222 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cdacf-fca7-4eb3-8554-0a60feefd76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:51.953311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cdacf-fca7-4eb3-8554-0a60feefd76a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:51.954284 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a3d2c-994d-4818-9fd7-8d5698fa1eb3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.960222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51640af2-898c-4043-8443-fcc3f8028ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.961395 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51640af2-898c-4043-8443-fcc3f8028ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.962256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51640af2-898c-4043-8443-fcc3f8028ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.962862 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51640af2-898c-4043-8443-fcc3f8028ce4 admin admin] PATH_INFO: `/v3/projects/502f274ce216466d8a3dbff4a784b9bf/users/46b90940e030470d8ab21cb82011b920/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.966905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 793/1595] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:51.972946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cdacf-fca7-4eb3-8554-0a60feefd76a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:51.985119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cdacf-fca7-4eb3-8554-0a60feefd76a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:51.991743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23d884-cb6c-444f-a61f-94c53cf484cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:51.992520 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23d884-cb6c-444f-a61f-94c53cf484cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:51.992799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23d884-cb6c-444f-a61f-94c53cf484cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:51.993079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23d884-cb6c-444f-a61f-94c53cf484cc admin admin] PATH_INFO: `/v3/projects/cd5470aa24e443768b5c26cfdb67bf00/users/d0ad561212284a88ac19caba30f09355/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:51.998301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51640af2-898c-4043-8443-fcc3f8028ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502f274ce216466d8a3dbff4a784b9bf, user_id=46b90940e030470d8ab21cb82011b920, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:52.002292 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51640af2-898c-4043-8443-fcc3f8028ce4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:52.016468 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23d884-cb6c-444f-a61f-94c53cf484cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5470aa24e443768b5c26cfdb67bf00, user_id=d0ad561212284a88ac19caba30f09355, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:52.020699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23d884-cb6c-444f-a61f-94c53cf484cc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:52.025593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 803/1596] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:51 2022] PUT /identity/v3/projects/502f274ce216466d8a3dbff4a784b9bf/users/46b90940e030470d8ab21cb82011b920/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:52.027517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51640af2-898c-4043-8443-fcc3f8028ce4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:52.042040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 794/1597] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:51 2022] PUT /identity/v3/projects/cd5470aa24e443768b5c26cfdb67bf00/users/d0ad561212284a88ac19caba30f09355/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:52.043272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23d884-cb6c-444f-a61f-94c53cf484cc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:52.131290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51640af2-898c-4043-8443-fcc3f8028ce4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:52.138261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c1500-eb50-4e58-9ff0-414b1537364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:52.138388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23d884-cb6c-444f-a61f-94c53cf484cc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:52.139281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c1500-eb50-4e58-9ff0-414b1537364d admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.139565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c1500-eb50-4e58-9ff0-414b1537364d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.144630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a57f7-4f27-4417-9397-4b44e9c499c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:52.145325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a57f7-4f27-4417-9397-4b44e9c499c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.146187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a57f7-4f27-4417-9397-4b44e9c499c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.146463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a57f7-4f27-4417-9397-4b44e9c499c1 admin admin] PATH_INFO: `/v3/projects/df1034d68cb946d98d29ac67eee99f3c/users/c9d5ee68426c47519c72e12d2ff16d96/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.151560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c1500-eb50-4e58-9ff0-414b1537364d admin admin] PATH_INFO: `/v3/projects/493c1eaaa9534d84be2bae9244436185/users/dca09ee28fc34023b42ef301b73df77b/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.174230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c1500-eb50-4e58-9ff0-414b1537364d admin admin] RBAC: Authorizing `identity:create_grant(project_id=493c1eaaa9534d84be2bae9244436185, user_id=dca09ee28fc34023b42ef301b73df77b, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:52.174669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a57f7-4f27-4417-9397-4b44e9c499c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1034d68cb946d98d29ac67eee99f3c, user_id=c9d5ee68426c47519c72e12d2ff16d96, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:52.177685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c1500-eb50-4e58-9ff0-414b1537364d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:52.181936 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a57f7-4f27-4417-9397-4b44e9c499c1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:52.196028 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 804/1598] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:52 2022] PUT /identity/v3/projects/493c1eaaa9534d84be2bae9244436185/users/dca09ee28fc34023b42ef301b73df77b/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:52.213069 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c1500-eb50-4e58-9ff0-414b1537364d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:52.216324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 795/1599] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:52 2022] PUT /identity/v3/projects/df1034d68cb946d98d29ac67eee99f3c/users/c9d5ee68426c47519c72e12d2ff16d96/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:52.219282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a57f7-4f27-4417-9397-4b44e9c499c1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:52.252144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:52.290100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:52.319125 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a57f7-4f27-4417-9397-4b44e9c499c1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:52.325256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2555ad2-42e1-45c0-a7f8-0c71cd9274d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:52.325979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2555ad2-42e1-45c0-a7f8-0c71cd9274d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.326328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2555ad2-42e1-45c0-a7f8-0c71cd9274d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.326669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2555ad2-42e1-45c0-a7f8-0c71cd9274d1 admin admin] PATH_INFO: `/v3/projects/c5bef3c20e7b47f18b0174b748c63902/users/893cfa69cc0f44d89060e7549dac379f/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.350162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2555ad2-42e1-45c0-a7f8-0c71cd9274d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bef3c20e7b47f18b0174b748c63902, user_id=893cfa69cc0f44d89060e7549dac379f, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:52.353588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2555ad2-42e1-45c0-a7f8-0c71cd9274d1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:52.382485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c1500-eb50-4e58-9ff0-414b1537364d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:52.382986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 796/1600] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:52 2022] PUT /identity/v3/projects/c5bef3c20e7b47f18b0174b748c63902/users/893cfa69cc0f44d89060e7549dac379f/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:52.384795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3e68-388a-404d-b467-824ee1ae1e99 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.385476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3e68-388a-404d-b467-824ee1ae1e99 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.385888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3e68-388a-404d-b467-824ee1ae1e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.410635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5b8b3e68-388a-404d-b467-824ee1ae1e99 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:52.411893 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5b8b3e68-388a-404d-b467-824ee1ae1e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:52.486135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f2e27-ee93-4853-be6b-1458a5a2c77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:52.486954 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f2e27-ee93-4853-be6b-1458a5a2c77f admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.487267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f2e27-ee93-4853-be6b-1458a5a2c77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.487607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f2e27-ee93-4853-be6b-1458a5a2c77f admin admin] PATH_INFO: `/v3/projects/c3af7e6cb29a4ad2bb493f2334650f4f/users/d1252684ed7343a8b960b3989419f0dd/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.503027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 797/1601] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:52.505506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db53936-d76f-425c-a405-e28f32f04f1f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.505947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db53936-d76f-425c-a405-e28f32f04f1f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.506552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db53936-d76f-425c-a405-e28f32f04f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.516828 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f2e27-ee93-4853-be6b-1458a5a2c77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3af7e6cb29a4ad2bb493f2334650f4f, user_id=d1252684ed7343a8b960b3989419f0dd, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:52.520194 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f2e27-ee93-4853-be6b-1458a5a2c77f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:52.538052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 805/1602] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:52 2022] PUT /identity/v3/projects/c3af7e6cb29a4ad2bb493f2334650f4f/users/d1252684ed7343a8b960b3989419f0dd/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:52.539338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d24f8c-570f-4b23-bf20-6ab235ca5f07 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.539674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d24f8c-570f-4b23-bf20-6ab235ca5f07 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.539958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d24f8c-570f-4b23-bf20-6ab235ca5f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.542801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1db53936-d76f-425c-a405-e28f32f04f1f None None] MFA Rules not processed for user `d0ad561212284a88ac19caba30f09355`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:52.544665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1db53936-d76f-425c-a405-e28f32f04f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:52.577495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f3d24f8c-570f-4b23-bf20-6ab235ca5f07 None None] MFA Rules not processed for user `dca09ee28fc34023b42ef301b73df77b`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:52.578899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f3d24f8c-570f-4b23-bf20-6ab235ca5f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:52.674305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 806/1603] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:52.674305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3ff76-6bfd-4af4-b44a-5740813d00f5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.674305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3ff76-6bfd-4af4-b44a-5740813d00f5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.674305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3ff76-6bfd-4af4-b44a-5740813d00f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.679632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 798/1604] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:52.685529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706582e0-eef7-4582-a7fb-3f4a78869eee None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.685643 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706582e0-eef7-4582-a7fb-3f4a78869eee None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.685919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706582e0-eef7-4582-a7fb-3f4a78869eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.711578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a6c3ff76-6bfd-4af4-b44a-5740813d00f5 None None] MFA Rules not processed for user `c9d5ee68426c47519c72e12d2ff16d96`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:52.713123 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a6c3ff76-6bfd-4af4-b44a-5740813d00f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:52.751040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-706582e0-eef7-4582-a7fb-3f4a78869eee None None] MFA Rules not processed for user `893cfa69cc0f44d89060e7549dac379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:52.752303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-706582e0-eef7-4582-a7fb-3f4a78869eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:52.763120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:52.787260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:52.818875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 807/1605] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:52.821588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3ff76-6bfd-4af4-b44a-5740813d00f5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:52.899106 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 799/1606] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:52.904499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6047498-b93b-45ae-a477-89cbfada887e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.905044 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6047498-b93b-45ae-a477-89cbfada887e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.905339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6047498-b93b-45ae-a477-89cbfada887e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.917985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3ff76-6bfd-4af4-b44a-5740813d00f5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:52.923839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905eae5d-0a80-46f1-9334-ab456c66b85b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:52.926509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905eae5d-0a80-46f1-9334-ab456c66b85b service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.926839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905eae5d-0a80-46f1-9334-ab456c66b85b service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.927122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905eae5d-0a80-46f1-9334-ab456c66b85b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.974191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e6047498-b93b-45ae-a477-89cbfada887e None None] MFA Rules not processed for user `d1252684ed7343a8b960b3989419f0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:52.975617 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e6047498-b93b-45ae-a477-89cbfada887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:53.041115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905eae5d-0a80-46f1-9334-ab456c66b85b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:53.042833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905eae5d-0a80-46f1-9334-ab456c66b85b service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:53.062582 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 800/1607] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:53.063669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6047498-b93b-45ae-a477-89cbfada887e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.067721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 808/1608] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:53.068598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905eae5d-0a80-46f1-9334-ab456c66b85b service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.083446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6047498-b93b-45ae-a477-89cbfada887e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.089438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905eae5d-0a80-46f1-9334-ab456c66b85b service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.091459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b2066-d973-4cdf-afd9-0155d3660737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.092236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b2066-d973-4cdf-afd9-0155d3660737 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.092619 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b2066-d973-4cdf-afd9-0155d3660737 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.092995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b2066-d973-4cdf-afd9-0155d3660737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:53.100282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a168664-1534-408f-8945-9f2d7282bcb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.101637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a168664-1534-408f-8945-9f2d7282bcb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.101927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a168664-1534-408f-8945-9f2d7282bcb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.102206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a168664-1534-408f-8945-9f2d7282bcb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:53.119775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b2066-d973-4cdf-afd9-0155d3660737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:53.121664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b2066-d973-4cdf-afd9-0155d3660737 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:53.125697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a168664-1534-408f-8945-9f2d7282bcb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:53.127357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a168664-1534-408f-8945-9f2d7282bcb6 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:53.138229 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 801/1609] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:53.139194 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b2066-d973-4cdf-afd9-0155d3660737 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.140344 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 809/1610] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:53.141162 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a168664-1534-408f-8945-9f2d7282bcb6 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.152237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b2066-d973-4cdf-afd9-0155d3660737 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.154399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a168664-1534-408f-8945-9f2d7282bcb6 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.158239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcb06a-2155-48b9-a89b-97c30ebc4a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.158900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcb06a-2155-48b9-a89b-97c30ebc4a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.159330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcb06a-2155-48b9-a89b-97c30ebc4a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.159611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcb06a-2155-48b9-a89b-97c30ebc4a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:53.160762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ec35f-27e0-47a3-9cc1-703a50d7e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.161571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ec35f-27e0-47a3-9cc1-703a50d7e1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.161925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ec35f-27e0-47a3-9cc1-703a50d7e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.162268 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ec35f-27e0-47a3-9cc1-703a50d7e1b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:53.162372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcb06a-2155-48b9-a89b-97c30ebc4a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:53.163216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ec35f-27e0-47a3-9cc1-703a50d7e1b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:53.166756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcb06a-2155-48b9-a89b-97c30ebc4a7c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:53.168458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ec35f-27e0-47a3-9cc1-703a50d7e1b4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:53.216592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 810/1611] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:52:53 2022] POST /identity/v3/projects => generated 397 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:53.217920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ec35f-27e0-47a3-9cc1-703a50d7e1b4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.232778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 802/1612] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:52:53 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:53.234549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcb06a-2155-48b9-a89b-97c30ebc4a7c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.308048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:53.327154 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ec35f-27e0-47a3-9cc1-703a50d7e1b4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.389818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcb06a-2155-48b9-a89b-97c30ebc4a7c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.402639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b1ae6-60da-470e-95f5-22f499e37eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.403773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b1ae6-60da-470e-95f5-22f499e37eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.404345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b1ae6-60da-470e-95f5-22f499e37eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.405541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b1ae6-60da-470e-95f5-22f499e37eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:53.406436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b1ae6-60da-470e-95f5-22f499e37eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:53.412792 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b1ae6-60da-470e-95f5-22f499e37eb6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:53.439710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5439c-e70b-4bae-82ae-095b865d4c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.440487 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5439c-e70b-4bae-82ae-095b865d4c08 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.441906 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5439c-e70b-4bae-82ae-095b865d4c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.442969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5439c-e70b-4bae-82ae-095b865d4c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:53.443621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5439c-e70b-4bae-82ae-095b865d4c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:53.452193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5439c-e70b-4bae-82ae-095b865d4c08 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:53.461156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:53.479696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 803/1613] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:52:53 2022] POST /identity/v3/users => generated 305 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:53.483098 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b1ae6-60da-470e-95f5-22f499e37eb6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.511849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b1ae6-60da-470e-95f5-22f499e37eb6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.519161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bcd4c-8eb5-448b-9d93-23ebbcc69742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.521166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bcd4c-8eb5-448b-9d93-23ebbcc69742 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.522145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bcd4c-8eb5-448b-9d93-23ebbcc69742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.522433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bcd4c-8eb5-448b-9d93-23ebbcc69742 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:53.524371 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bcd4c-8eb5-448b-9d93-23ebbcc69742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:53.528109 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bcd4c-8eb5-448b-9d93-23ebbcc69742 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:53.533692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 811/1614] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:52:53 2022] POST /identity/v3/projects => generated 369 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:53.534681 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5439c-e70b-4bae-82ae-095b865d4c08 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.570329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 804/1615] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:52:53 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:53.571538 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bcd4c-8eb5-448b-9d93-23ebbcc69742 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.588371 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bcd4c-8eb5-448b-9d93-23ebbcc69742 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.678658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5439c-e70b-4bae-82ae-095b865d4c08 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.690229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b369a2-6656-45ee-9c48-4d033932782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.690897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b369a2-6656-45ee-9c48-4d033932782e admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.691691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b369a2-6656-45ee-9c48-4d033932782e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.692034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b369a2-6656-45ee-9c48-4d033932782e admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:53.692681 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b369a2-6656-45ee-9c48-4d033932782e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:53.694281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b369a2-6656-45ee-9c48-4d033932782e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:53.716114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7231ea-aea7-41a3-ac75-8fc49462066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.717220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7231ea-aea7-41a3-ac75-8fc49462066d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.718483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 812/1616] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:53.719235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b369a2-6656-45ee-9c48-4d033932782e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.719597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7231ea-aea7-41a3-ac75-8fc49462066d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.720151 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7231ea-aea7-41a3-ac75-8fc49462066d admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:53.721138 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7231ea-aea7-41a3-ac75-8fc49462066d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:53.723853 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7231ea-aea7-41a3-ac75-8fc49462066d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:53.745009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b369a2-6656-45ee-9c48-4d033932782e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.760101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934ce73-f200-44fc-8e8c-133f2ab406bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.760757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934ce73-f200-44fc-8e8c-133f2ab406bf admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.760983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 805/1617] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:52:53 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:53.761087 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934ce73-f200-44fc-8e8c-133f2ab406bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.761280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934ce73-f200-44fc-8e8c-133f2ab406bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:53.762433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7231ea-aea7-41a3-ac75-8fc49462066d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.762558 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934ce73-f200-44fc-8e8c-133f2ab406bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:53.764216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934ce73-f200-44fc-8e8c-133f2ab406bf admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:53.777196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7231ea-aea7-41a3-ac75-8fc49462066d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.784479 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86707307-d5a3-446a-bd86-59016d61aa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.786201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86707307-d5a3-446a-bd86-59016d61aa6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.786718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86707307-d5a3-446a-bd86-59016d61aa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.787386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86707307-d5a3-446a-bd86-59016d61aa6c admin admin] PATH_INFO: `/v3/projects/b643880d3bfa46e79cf89191db7162d2/users/8e6aed3a4e0846b487fff24e6058d3cc/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:53.796674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 813/1618] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:53.797586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934ce73-f200-44fc-8e8c-133f2ab406bf admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.813279 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86707307-d5a3-446a-bd86-59016d61aa6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b643880d3bfa46e79cf89191db7162d2, user_id=8e6aed3a4e0846b487fff24e6058d3cc, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:53.817394 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934ce73-f200-44fc-8e8c-133f2ab406bf admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.818890 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86707307-d5a3-446a-bd86-59016d61aa6c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:53.829151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56c824-bea9-4613-9703-95dd7e02b9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.829757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56c824-bea9-4613-9703-95dd7e02b9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.830025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56c824-bea9-4613-9703-95dd7e02b9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.830329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56c824-bea9-4613-9703-95dd7e02b9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:53.831060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56c824-bea9-4613-9703-95dd7e02b9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:53.833289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56c824-bea9-4613-9703-95dd7e02b9c9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:53.844564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 814/1619] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:53.845176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 806/1620] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:53 2022] PUT /identity/v3/projects/b643880d3bfa46e79cf89191db7162d2/users/8e6aed3a4e0846b487fff24e6058d3cc/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:53.845561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56c824-bea9-4613-9703-95dd7e02b9c9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.848787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86707307-d5a3-446a-bd86-59016d61aa6c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:53.871806 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56c824-bea9-4613-9703-95dd7e02b9c9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.967665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86707307-d5a3-446a-bd86-59016d61aa6c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:53.973443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda311b3-8c49-4c08-9ed0-761e7ea80248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.974400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda311b3-8c49-4c08-9ed0-761e7ea80248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.974876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda311b3-8c49-4c08-9ed0-761e7ea80248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.975277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda311b3-8c49-4c08-9ed0-761e7ea80248 admin admin] PATH_INFO: `/v3/projects/2a3c2d7f4f88446581a34e8a0e2f2396/users/fa80fa3380c5473398e4c4140181cc93/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:53.977261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:53.986242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a934db-7523-4c66-b583-735624afed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:53.987449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a934db-7523-4c66-b583-735624afed70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:53.989078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a934db-7523-4c66-b583-735624afed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:53.989637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a934db-7523-4c66-b583-735624afed70 admin admin] PATH_INFO: `/v3/projects/0f454a732e464dcf9ce347f6a6300624/users/4649bdb9bf30411493a1d61de853e087/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:54.000924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda311b3-8c49-4c08-9ed0-761e7ea80248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3c2d7f4f88446581a34e8a0e2f2396, user_id=fa80fa3380c5473398e4c4140181cc93, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:54.007303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda311b3-8c49-4c08-9ed0-761e7ea80248 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:54.011621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a934db-7523-4c66-b583-735624afed70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f454a732e464dcf9ce347f6a6300624, user_id=4649bdb9bf30411493a1d61de853e087, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:54.015687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a934db-7523-4c66-b583-735624afed70 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:54.032974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 807/1621] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:53 2022] PUT /identity/v3/projects/2a3c2d7f4f88446581a34e8a0e2f2396/users/fa80fa3380c5473398e4c4140181cc93/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:54.036660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda311b3-8c49-4c08-9ed0-761e7ea80248 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:54.041463 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 815/1622] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:53 2022] PUT /identity/v3/projects/0f454a732e464dcf9ce347f6a6300624/users/4649bdb9bf30411493a1d61de853e087/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:54.041463 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a934db-7523-4c66-b583-735624afed70 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:54.095953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:54.163618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a934db-7523-4c66-b583-735624afed70 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:54.176455 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25787cfc-ad49-4f34-8371-4443abaf3dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:54.176807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda311b3-8c49-4c08-9ed0-761e7ea80248 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:54.178099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25787cfc-ad49-4f34-8371-4443abaf3dfe admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:54.178392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25787cfc-ad49-4f34-8371-4443abaf3dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:54.178668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25787cfc-ad49-4f34-8371-4443abaf3dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:54.181307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25787cfc-ad49-4f34-8371-4443abaf3dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:54.184945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25787cfc-ad49-4f34-8371-4443abaf3dfe admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:54.187761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec738fe-580d-4f44-a99d-f0ef95b66772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:54.188961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec738fe-580d-4f44-a99d-f0ef95b66772 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:54.188961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec738fe-580d-4f44-a99d-f0ef95b66772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:54.189486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec738fe-580d-4f44-a99d-f0ef95b66772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:54.192069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec738fe-580d-4f44-a99d-f0ef95b66772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:54.197241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec738fe-580d-4f44-a99d-f0ef95b66772 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:54.215909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 816/1623] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:54.218017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25787cfc-ad49-4f34-8371-4443abaf3dfe admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:54.226235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 808/1624] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:54.229327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec738fe-580d-4f44-a99d-f0ef95b66772 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:54.244979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25787cfc-ad49-4f34-8371-4443abaf3dfe admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:54.259986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229daa9-394c-4390-bb21-b96510d0d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:54.260871 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec738fe-580d-4f44-a99d-f0ef95b66772 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:54.262092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229daa9-394c-4390-bb21-b96510d0d90f admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:54.262719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229daa9-394c-4390-bb21-b96510d0d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:54.263898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229daa9-394c-4390-bb21-b96510d0d90f admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:54.265170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229daa9-394c-4390-bb21-b96510d0d90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:54.270026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229daa9-394c-4390-bb21-b96510d0d90f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:54.273240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd692c0-da0e-4f06-92d8-d910047121ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:54.276036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd692c0-da0e-4f06-92d8-d910047121ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:54.278354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd692c0-da0e-4f06-92d8-d910047121ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:54.279150 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd692c0-da0e-4f06-92d8-d910047121ad admin admin] PATH_INFO: `/v3/projects/2a3c2d7f4f88446581a34e8a0e2f2396/users/fa80fa3380c5473398e4c4140181cc93/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:54.289267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd692c0-da0e-4f06-92d8-d910047121ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3c2d7f4f88446581a34e8a0e2f2396, user_id=fa80fa3380c5473398e4c4140181cc93, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:54.302235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd692c0-da0e-4f06-92d8-d910047121ad admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:54.314398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 817/1625] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:54.315654 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229daa9-394c-4390-bb21-b96510d0d90f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:54.343725 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229daa9-394c-4390-bb21-b96510d0d90f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:54.360891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 809/1626] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:54 2022] PUT /identity/v3/projects/2a3c2d7f4f88446581a34e8a0e2f2396/users/fa80fa3380c5473398e4c4140181cc93/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:54.365441 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd692c0-da0e-4f06-92d8-d910047121ad admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:54.545400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82aa5c-922e-46bb-8938-47d7917f5a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:54.553308 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82aa5c-922e-46bb-8938-47d7917f5a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:54.556787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82aa5c-922e-46bb-8938-47d7917f5a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:54.556787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82aa5c-922e-46bb-8938-47d7917f5a88 admin admin] PATH_INFO: `/v3/projects/b643880d3bfa46e79cf89191db7162d2/users/8e6aed3a4e0846b487fff24e6058d3cc/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:54.560488 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82aa5c-922e-46bb-8938-47d7917f5a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b643880d3bfa46e79cf89191db7162d2, user_id=8e6aed3a4e0846b487fff24e6058d3cc, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:54.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82aa5c-922e-46bb-8938-47d7917f5a88 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:54.580629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd692c0-da0e-4f06-92d8-d910047121ad admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:54.595277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 818/1627] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:54 2022] PUT /identity/v3/projects/b643880d3bfa46e79cf89191db7162d2/users/8e6aed3a4e0846b487fff24e6058d3cc/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:54.604522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd28cfd-fa85-4e6f-ae6a-a264bb2522b5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:54.605711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd28cfd-fa85-4e6f-ae6a-a264bb2522b5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:54.606057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd28cfd-fa85-4e6f-ae6a-a264bb2522b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:54.695804 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-1dd28cfd-fa85-4e6f-ae6a-a264bb2522b5 None None] MFA Rules not processed for user `fa80fa3380c5473398e4c4140181cc93`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:54.700453 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1dd28cfd-fa85-4e6f-ae6a-a264bb2522b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:54.745848 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24684614-e2bd-4e2d-b7ba-e619b16f140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:54.746676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24684614-e2bd-4e2d-b7ba-e619b16f140c admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:54.747077 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24684614-e2bd-4e2d-b7ba-e619b16f140c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:54.747445 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24684614-e2bd-4e2d-b7ba-e619b16f140c admin admin] PATH_INFO: `/v3/projects/0f454a732e464dcf9ce347f6a6300624/users/4649bdb9bf30411493a1d61de853e087/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:54.751812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24684614-e2bd-4e2d-b7ba-e619b16f140c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f454a732e464dcf9ce347f6a6300624, user_id=4649bdb9bf30411493a1d61de853e087, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:54.754354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24684614-e2bd-4e2d-b7ba-e619b16f140c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:54.797110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 810/1628] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:54 2022] PUT /identity/v3/projects/0f454a732e464dcf9ce347f6a6300624/users/4649bdb9bf30411493a1d61de853e087/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:54.799656 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abbbc6-0073-4ec8-9491-71c6fa176d63 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:54.800768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abbbc6-0073-4ec8-9491-71c6fa176d63 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:54.801141 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abbbc6-0073-4ec8-9491-71c6fa176d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:54.841124 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:54.909267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 819/1629] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:54.922760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b9abbbc6-0073-4ec8-9491-71c6fa176d63 None None] MFA Rules not processed for user `8e6aed3a4e0846b487fff24e6058d3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:54.922760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b9abbbc6-0073-4ec8-9491-71c6fa176d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:54.925398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42224c-f445-4f14-be23-f6210579398f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:54.925889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42224c-f445-4f14-be23-f6210579398f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:54.926317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42224c-f445-4f14-be23-f6210579398f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:54.978515 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:55.015353 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ff42224c-f445-4f14-be23-f6210579398f None None] MFA Rules not processed for user `4649bdb9bf30411493a1d61de853e087`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:55.016704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ff42224c-f445-4f14-be23-f6210579398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:55.045980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 811/1630] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:54 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:55.045980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abbbc6-0073-4ec8-9491-71c6fa176d63 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:55.262280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 820/1631] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:52:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:55.268715 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abbbc6-0073-4ec8-9491-71c6fa176d63 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:55.270837 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42224c-f445-4f14-be23-f6210579398f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:55.282856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acbd15-c60b-4ca4-8fd1-4733af6d4da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:55.285071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acbd15-c60b-4ca4-8fd1-4733af6d4da6 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:55.285513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acbd15-c60b-4ca4-8fd1-4733af6d4da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:55.286362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acbd15-c60b-4ca4-8fd1-4733af6d4da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:55.299572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42224c-f445-4f14-be23-f6210579398f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:55.312009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e27673-a19a-41b4-b156-66e90b91eaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:55.312886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e27673-a19a-41b4-b156-66e90b91eaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:55.314498 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e27673-a19a-41b4-b156-66e90b91eaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:55.315954 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e27673-a19a-41b4-b156-66e90b91eaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:55.452281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acbd15-c60b-4ca4-8fd1-4733af6d4da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:55.454114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acbd15-c60b-4ca4-8fd1-4733af6d4da6 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:55.476633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 812/1632] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:55.477997 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acbd15-c60b-4ca4-8fd1-4733af6d4da6 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:55.500084 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acbd15-c60b-4ca4-8fd1-4733af6d4da6 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:55.506602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e27673-a19a-41b4-b156-66e90b91eaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:55.508335 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e27673-a19a-41b4-b156-66e90b91eaf0 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:55.514413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c88c63-207b-4fa7-8c7a-cea3653e1a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:55.515165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88c63-207b-4fa7-8c7a-cea3653e1a1d service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:55.515550 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88c63-207b-4fa7-8c7a-cea3653e1a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:55.515929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88c63-207b-4fa7-8c7a-cea3653e1a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:55.537249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 821/1633] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:55.538353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c88c63-207b-4fa7-8c7a-cea3653e1a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:55.541685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c88c63-207b-4fa7-8c7a-cea3653e1a1d service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:55.567325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 813/1634] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:57.110364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8c369-ca60-4125-af91-559f06c5e0cd None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:57.110982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8c369-ca60-4125-af91-559f06c5e0cd None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:57.111404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8c369-ca60-4125-af91-559f06c5e0cd None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:57.113095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 822/1635] 10.222.0.33 () {54 vars in 962 bytes} [Sun Sep 11 00:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:52:57.134907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34541c-5495-4ce1-9608-473f89cb3f75 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:57.136025 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34541c-5495-4ce1-9608-473f89cb3f75 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:57.136475 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34541c-5495-4ce1-9608-473f89cb3f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:57.228104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-af34541c-5495-4ce1-9608-473f89cb3f75 None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:57.231049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-af34541c-5495-4ce1-9608-473f89cb3f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:57.369909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:57.411977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8c369-ca60-4125-af91-559f06c5e0cd None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:57.414511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 814/1636] 10.222.0.33 () {58 vars in 1059 bytes} [Sun Sep 11 00:52:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:52:57.435577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8c369-ca60-4125-af91-559f06c5e0cd None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:57.451506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ec59f-bc9b-4176-b6bb-112517db4e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:57.452465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ec59f-bc9b-4176-b6bb-112517db4e89 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:57.452749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ec59f-bc9b-4176-b6bb-112517db4e89 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:57.453017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ec59f-bc9b-4176-b6bb-112517db4e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:57.471028 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ec59f-bc9b-4176-b6bb-112517db4e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:57.473078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ec59f-bc9b-4176-b6bb-112517db4e89 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:57.495672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 823/1637] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:57 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:03.696169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34541c-5495-4ce1-9608-473f89cb3f75 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:03.841225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34541c-5495-4ce1-9608-473f89cb3f75 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:03.859737 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:03.860488 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:03.860766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:03.861036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] PATH_INFO: `/v3/users/d1252684ed7343a8b960b3989419f0dd` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:03.862441 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1252684ed7343a8b960b3989419f0dd)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:03.864456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:03.952549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1252684ed7343a8b960b3989419f0dd'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:03.970538 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1252684ed7343a8b960b3989419f0dd'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:03.983202 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1252684ed7343a8b960b3989419f0dd'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:04.004275 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1252684ed7343a8b960b3989419f0dd'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:04.005166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1252684ed7343a8b960b3989419f0dd'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:04.016489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 815/1638] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:53:03 2022] DELETE /identity/v3/users/d1252684ed7343a8b960b3989419f0dd => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:04.022213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76394cc-ac30-439f-994b-0cd7397c6592 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:04.023063 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76394cc-ac30-439f-994b-0cd7397c6592 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:04.023499 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76394cc-ac30-439f-994b-0cd7397c6592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:04.031979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:04.033499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:04.061302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c76394cc-ac30-439f-994b-0cd7397c6592 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:04.062978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c76394cc-ac30-439f-994b-0cd7397c6592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:04.158752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19b61a-53c7-4756-b2f1-991ef98c8ffc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:04.168010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac904edf-ba62-4a38-8ff7-2f80f079051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:04.170552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac904edf-ba62-4a38-8ff7-2f80f079051c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:04.171125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:04.171252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac904edf-ba62-4a38-8ff7-2f80f079051c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:04.172278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac904edf-ba62-4a38-8ff7-2f80f079051c admin admin] PATH_INFO: `/v3/users/c9d5ee68426c47519c72e12d2ff16d96` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:04.174326 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac904edf-ba62-4a38-8ff7-2f80f079051c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d5ee68426c47519c72e12d2ff16d96)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:04.182133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac904edf-ba62-4a38-8ff7-2f80f079051c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:04.206532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 824/1639] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:04.210481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:04.249101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76394cc-ac30-439f-994b-0cd7397c6592 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:04.250769 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c76394cc-ac30-439f-994b-0cd7397c6592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:04.298047 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ac904edf-ba62-4a38-8ff7-2f80f079051c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d5ee68426c47519c72e12d2ff16d96'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:04.348620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ac904edf-ba62-4a38-8ff7-2f80f079051c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d5ee68426c47519c72e12d2ff16d96'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:04.365862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ac904edf-ba62-4a38-8ff7-2f80f079051c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d5ee68426c47519c72e12d2ff16d96'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:04.384111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ac904edf-ba62-4a38-8ff7-2f80f079051c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d5ee68426c47519c72e12d2ff16d96'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:04.384833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ac904edf-ba62-4a38-8ff7-2f80f079051c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d5ee68426c47519c72e12d2ff16d96'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:04.406372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 816/1640] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:53:04 2022] DELETE /identity/v3/users/c9d5ee68426c47519c72e12d2ff16d96 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:53:04.410715 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c99f6-cbf4-4eec-935b-597692575962 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:04.411036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c99f6-cbf4-4eec-935b-597692575962 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:04.411419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c99f6-cbf4-4eec-935b-597692575962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:04.415088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76394cc-ac30-439f-994b-0cd7397c6592 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:04.436247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1c5c99f6-cbf4-4eec-935b-597692575962 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:04.438187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1c5c99f6-cbf4-4eec-935b-597692575962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:04.538628 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 817/1641] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:53:04.540872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbdeda-a7cf-4104-af1a-66db93d0d0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:04.541695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbdeda-a7cf-4104-af1a-66db93d0d0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:04.542123 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbdeda-a7cf-4104-af1a-66db93d0d0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:04.542539 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbdeda-a7cf-4104-af1a-66db93d0d0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:04.544509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-22cbdeda-a7cf-4104-af1a-66db93d0d0a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:04.562031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbdeda-a7cf-4104-af1a-66db93d0d0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:04.563882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbdeda-a7cf-4104-af1a-66db93d0d0a7 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:04.579899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 825/1642] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:53:04.590423 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c99f6-cbf4-4eec-935b-597692575962 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:04.593285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1c5c99f6-cbf4-4eec-935b-597692575962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:04.634496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c99f6-cbf4-4eec-935b-597692575962 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:04.649337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f2da3-3563-441c-9967-4c13796f5c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:04.649567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f2da3-3563-441c-9967-4c13796f5c1f service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:04.649908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f2da3-3563-441c-9967-4c13796f5c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:04.650240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f2da3-3563-441c-9967-4c13796f5c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:04.670664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f2da3-3563-441c-9967-4c13796f5c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:04.672955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f2da3-3563-441c-9967-4c13796f5c1f service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:04.689323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 818/1643] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:06.970630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbdeda-a7cf-4104-af1a-66db93d0d0a7 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:06.972010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-22cbdeda-a7cf-4104-af1a-66db93d0d0a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:07.001201 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbdeda-a7cf-4104-af1a-66db93d0d0a7 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:07.009410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:07.010258 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:07.012062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:07.012506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] PATH_INFO: `/v3/projects/c3af7e6cb29a4ad2bb493f2334650f4f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:07.017728 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3af7e6cb29a4ad2bb493f2334650f4f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:07.020090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:07.051685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f2da3-3563-441c-9967-4c13796f5c1f service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:07.054001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d20f2da3-3563-441c-9967-4c13796f5c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:07.086790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f2da3-3563-441c-9967-4c13796f5c1f service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:07.104734 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:07.105461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:07.105803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:07.106269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] PATH_INFO: `/v3/projects/df1034d68cb946d98d29ac67eee99f3c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:07.108548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1034d68cb946d98d29ac67eee99f3c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:07.109898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: WARNING py.warnings [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:53:07.109898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: warnings.warn(msg) Sep 11 00:53:07.109898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: Sep 11 00:53:07.111726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:07.193750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3af7e6cb29a4ad2bb493f2334650f4f', 'request_id': 'req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.212788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3af7e6cb29a4ad2bb493f2334650f4f', 'request_id': 'req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.226669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1034d68cb946d98d29ac67eee99f3c', 'request_id': 'req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.231348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3af7e6cb29a4ad2bb493f2334650f4f', 'request_id': 'req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.242933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1034d68cb946d98d29ac67eee99f3c', 'request_id': 'req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.256454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] The token cache is being invalidate because project c3af7e6cb29a4ad2bb493f2334650f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:53:07.256749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.257607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.261873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 826/1644] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:53:06 2022] DELETE /identity/v3/projects/c3af7e6cb29a4ad2bb493f2334650f4f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:07.267196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1034d68cb946d98d29ac67eee99f3c', 'request_id': 'req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.267487 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:07.269932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:07.287493 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] The token cache is being invalidate because project df1034d68cb946d98d29ac67eee99f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:53:07.288321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.289701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.294190 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 819/1645] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:53:07 2022] DELETE /identity/v3/projects/df1034d68cb946d98d29ac67eee99f3c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:07.298682 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:07.304954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:07.310248 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:07.391804 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:07.455293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5b09f-0cfe-43fa-bbd0-1f358ce68a08 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:07.465171 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db5d9f-0bb1-4cab-b4dc-c71f8c24fb7e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:07.468786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b450e-2da9-40b4-ac13-5bed91f92589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:07.469628 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b450e-2da9-40b4-ac13-5bed91f92589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:07.469913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b450e-2da9-40b4-ac13-5bed91f92589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:07.470193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b450e-2da9-40b4-ac13-5bed91f92589 admin admin] PATH_INFO: `/v3/users/4649bdb9bf30411493a1d61de853e087` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:07.475399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b450e-2da9-40b4-ac13-5bed91f92589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4649bdb9bf30411493a1d61de853e087)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:07.480281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b450e-2da9-40b4-ac13-5bed91f92589 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:07.487066 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1028e-6bfe-4df0-b967-2bf6252ffa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:07.488784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1028e-6bfe-4df0-b967-2bf6252ffa6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:07.489790 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1028e-6bfe-4df0-b967-2bf6252ffa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:07.490142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1028e-6bfe-4df0-b967-2bf6252ffa6c admin admin] PATH_INFO: `/v3/users/fa80fa3380c5473398e4c4140181cc93` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:07.491880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1028e-6bfe-4df0-b967-2bf6252ffa6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa80fa3380c5473398e4c4140181cc93)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:07.493312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: WARNING py.warnings [None req-b7d1028e-6bfe-4df0-b967-2bf6252ffa6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:53:07.493312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: warnings.warn(msg) Sep 11 00:53:07.493312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: Sep 11 00:53:07.494750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1028e-6bfe-4df0-b967-2bf6252ffa6c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:07.588025 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dc8b450e-2da9-40b4-ac13-5bed91f92589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4649bdb9bf30411493a1d61de853e087'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.610957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dc8b450e-2da9-40b4-ac13-5bed91f92589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4649bdb9bf30411493a1d61de853e087'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.612962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b7d1028e-6bfe-4df0-b967-2bf6252ffa6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa80fa3380c5473398e4c4140181cc93'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.614130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b7d1028e-6bfe-4df0-b967-2bf6252ffa6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa80fa3380c5473398e4c4140181cc93'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.624208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dc8b450e-2da9-40b4-ac13-5bed91f92589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4649bdb9bf30411493a1d61de853e087'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.635052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b7d1028e-6bfe-4df0-b967-2bf6252ffa6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa80fa3380c5473398e4c4140181cc93'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.648272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dc8b450e-2da9-40b4-ac13-5bed91f92589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4649bdb9bf30411493a1d61de853e087'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.649006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dc8b450e-2da9-40b4-ac13-5bed91f92589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4649bdb9bf30411493a1d61de853e087'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.655643 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b7d1028e-6bfe-4df0-b967-2bf6252ffa6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa80fa3380c5473398e4c4140181cc93'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.666907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 820/1646] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:53:07 2022] DELETE /identity/v3/users/4649bdb9bf30411493a1d61de853e087 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:07.682997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b7d1028e-6bfe-4df0-b967-2bf6252ffa6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa80fa3380c5473398e4c4140181cc93'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:07.697879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 827/1647] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:53:07 2022] DELETE /identity/v3/users/fa80fa3380c5473398e4c4140181cc93 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:08.357517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6ba91-1a38-433f-b14a-1b8abf21c8d0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:08.358371 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6ba91-1a38-433f-b14a-1b8abf21c8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:08.361074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6ba91-1a38-433f-b14a-1b8abf21c8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:08.486178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7cb6ba91-1a38-433f-b14a-1b8abf21c8d0 None None] MFA Rules not processed for user `6aa81fbf97d3485d845d5cc04449efb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:08.487435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7cb6ba91-1a38-433f-b14a-1b8abf21c8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:08.491976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2faa4a-f110-4686-8e28-647401724795 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:08.492781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2faa4a-f110-4686-8e28-647401724795 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:08.493200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2faa4a-f110-4686-8e28-647401724795 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:08.494850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 828/1648] 10.222.0.33 () {54 vars in 921 bytes} [Sun Sep 11 00:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:53:08.545950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad17823-42e6-4119-b7a8-45f0c706fdb2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:08.546518 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad17823-42e6-4119-b7a8-45f0c706fdb2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:08.546971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad17823-42e6-4119-b7a8-45f0c706fdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:08.590142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6ad17823-42e6-4119-b7a8-45f0c706fdb2 None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:08.594150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6ad17823-42e6-4119-b7a8-45f0c706fdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:08.646420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 821/1649] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:08.681765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881244e-aea7-4c75-9dea-785bea2ed264 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:08.682269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881244e-aea7-4c75-9dea-785bea2ed264 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:08.682686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881244e-aea7-4c75-9dea-785bea2ed264 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:08.684628 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 822/1650] 10.222.0.33 () {54 vars in 962 bytes} [Sun Sep 11 00:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:08.700611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44508545-8131-422e-90c7-45c789ccae99 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:08.701908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44508545-8131-422e-90c7-45c789ccae99 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:08.702322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44508545-8131-422e-90c7-45c789ccae99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:08.741091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 829/1651] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 00:53:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:53:08.749837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-44508545-8131-422e-90c7-45c789ccae99 None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:08.753170 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-44508545-8131-422e-90c7-45c789ccae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:08.777969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad17823-42e6-4119-b7a8-45f0c706fdb2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:08.779506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6ad17823-42e6-4119-b7a8-45f0c706fdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:08.784176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:08.811204 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad17823-42e6-4119-b7a8-45f0c706fdb2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:08.819895 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba963bff-61bf-4014-be94-482a8dd884d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:08.820820 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963bff-61bf-4014-be94-482a8dd884d5 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:08.821105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963bff-61bf-4014-be94-482a8dd884d5 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:08.821374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963bff-61bf-4014-be94-482a8dd884d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:08.848772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba963bff-61bf-4014-be94-482a8dd884d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:08.850406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba963bff-61bf-4014-be94-482a8dd884d5 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:08.878272 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 830/1652] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:53:08.932917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 823/1653] 10.222.0.33 () {58 vars in 1059 bytes} [Sun Sep 11 00:53:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 11 00:53:08.954524 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba963bff-61bf-4014-be94-482a8dd884d5 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:08.978811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba963bff-61bf-4014-be94-482a8dd884d5 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:09.003446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbcf1c-fc49-4649-ad10-7111fb81baff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:09.004103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbcf1c-fc49-4649-ad10-7111fb81baff service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:09.004390 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbcf1c-fc49-4649-ad10-7111fb81baff service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:09.004662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbcf1c-fc49-4649-ad10-7111fb81baff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:09.047938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbcf1c-fc49-4649-ad10-7111fb81baff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:09.049475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbcf1c-fc49-4649-ad10-7111fb81baff service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:09.091714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 831/1654] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:09.227611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d13bc2-914b-4989-bd98-46fa2e527524 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:09.227949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d13bc2-914b-4989-bd98-46fa2e527524 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:09.228195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d13bc2-914b-4989-bd98-46fa2e527524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:09.303869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-27d13bc2-914b-4989-bd98-46fa2e527524 None None] MFA Rules not processed for user `d5559495af904f3ab40abcec18259f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:09.305029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-27d13bc2-914b-4989-bd98-46fa2e527524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:09.573068 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 824/1655] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:09.594051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbcf1c-fc49-4649-ad10-7111fb81baff service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:09.595961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-efdbcf1c-fc49-4649-ad10-7111fb81baff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:09.630261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbcf1c-fc49-4649-ad10-7111fb81baff service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:09.643578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2105a-834a-49e6-abf1-1e209a630d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:09.644402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2105a-834a-49e6-abf1-1e209a630d1b service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:09.644879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2105a-834a-49e6-abf1-1e209a630d1b service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:09.645817 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2105a-834a-49e6-abf1-1e209a630d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:09.692573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2105a-834a-49e6-abf1-1e209a630d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:09.694215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2105a-834a-49e6-abf1-1e209a630d1b service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:09.732269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 832/1656] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:10.670629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d13bc2-914b-4989-bd98-46fa2e527524 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:10.673800 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-27d13bc2-914b-4989-bd98-46fa2e527524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:10.881243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d13bc2-914b-4989-bd98-46fa2e527524 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:10.900127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ede95f-7798-4bd1-8305-47c9742dd729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:10.900796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ede95f-7798-4bd1-8305-47c9742dd729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:10.901080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ede95f-7798-4bd1-8305-47c9742dd729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:10.901352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ede95f-7798-4bd1-8305-47c9742dd729 admin admin] PATH_INFO: `/v3/projects/0f454a732e464dcf9ce347f6a6300624` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:10.902528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ede95f-7798-4bd1-8305-47c9742dd729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f454a732e464dcf9ce347f6a6300624)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:10.905237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ede95f-7798-4bd1-8305-47c9742dd729 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:11.002013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:11.022825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c2ede95f-7798-4bd1-8305-47c9742dd729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f454a732e464dcf9ce347f6a6300624', 'request_id': 'req-c2ede95f-7798-4bd1-8305-47c9742dd729'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:11.041420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c2ede95f-7798-4bd1-8305-47c9742dd729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f454a732e464dcf9ce347f6a6300624', 'request_id': 'req-c2ede95f-7798-4bd1-8305-47c9742dd729'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:11.055356 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c2ede95f-7798-4bd1-8305-47c9742dd729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f454a732e464dcf9ce347f6a6300624', 'request_id': 'req-c2ede95f-7798-4bd1-8305-47c9742dd729'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:11.057719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2105a-834a-49e6-abf1-1e209a630d1b service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:11.059448 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9ef2105a-834a-49e6-abf1-1e209a630d1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:11.085536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c2ede95f-7798-4bd1-8305-47c9742dd729 admin admin] The token cache is being invalidate because project 0f454a732e464dcf9ce347f6a6300624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:53:11.085720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c2ede95f-7798-4bd1-8305-47c9742dd729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:11.086389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c2ede95f-7798-4bd1-8305-47c9742dd729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:11.087972 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2105a-834a-49e6-abf1-1e209a630d1b service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:11.091260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 825/1657] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:53:10 2022] DELETE /identity/v3/projects/0f454a732e464dcf9ce347f6a6300624 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:11.092695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00c1de-e365-4fe9-9b98-69b3bb2133f6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:11.092986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00c1de-e365-4fe9-9b98-69b3bb2133f6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:11.093264 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00c1de-e365-4fe9-9b98-69b3bb2133f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:11.110391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:11.155511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7f00c1de-e365-4fe9-9b98-69b3bb2133f6 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:11.156755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7f00c1de-e365-4fe9-9b98-69b3bb2133f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:11.217453 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:11.218099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:11.218374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:11.218642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b admin admin] PATH_INFO: `/v3/projects/2a3c2d7f4f88446581a34e8a0e2f2396` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:11.220026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a3c2d7f4f88446581a34e8a0e2f2396)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:11.222084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:11.316119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a3c2d7f4f88446581a34e8a0e2f2396', 'request_id': 'req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:11.328598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a3c2d7f4f88446581a34e8a0e2f2396', 'request_id': 'req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:11.346534 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a3c2d7f4f88446581a34e8a0e2f2396', 'request_id': 'req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:11.353695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 826/1658] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:11.361576 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61d5e9-6bff-473d-9aab-64e48667c8e5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:11.361888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61d5e9-6bff-473d-9aab-64e48667c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:11.362155 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61d5e9-6bff-473d-9aab-64e48667c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:11.376314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b admin admin] The token cache is being invalidate because project 2a3c2d7f4f88446581a34e8a0e2f2396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:53:11.378050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:11.380560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8bfeb8bd-3f12-4fe5-8ee2-c8fd1095cd8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:11.386942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 833/1659] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:53:11 2022] DELETE /identity/v3/projects/2a3c2d7f4f88446581a34e8a0e2f2396 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:11.392240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d9f90-b53b-49da-a194-7b71da53dd26 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:11.392817 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d9f90-b53b-49da-a194-7b71da53dd26 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:11.393261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d9f90-b53b-49da-a194-7b71da53dd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:11.393741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5a61d5e9-6bff-473d-9aab-64e48667c8e5 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:11.396616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5a61d5e9-6bff-473d-9aab-64e48667c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:11.459627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d92d9f90-b53b-49da-a194-7b71da53dd26 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:11.460657 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d92d9f90-b53b-49da-a194-7b71da53dd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:11.502813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 834/1660] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:53:11.503011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 827/1661] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:53:11.503107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d9f90-b53b-49da-a194-7b71da53dd26 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:11.508301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20a286-e4c6-4fb7-bab1-0c90200f6eee None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:11.512425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20a286-e4c6-4fb7-bab1-0c90200f6eee None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:11.513178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20a286-e4c6-4fb7-bab1-0c90200f6eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:11.525368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d9f90-b53b-49da-a194-7b71da53dd26 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:11.540063 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afa0d7-224b-4eb9-9502-b56e2c9f453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:11.541162 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa0d7-224b-4eb9-9502-b56e2c9f453b admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:11.541380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa0d7-224b-4eb9-9502-b56e2c9f453b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:11.541650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa0d7-224b-4eb9-9502-b56e2c9f453b admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:11.542719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afa0d7-224b-4eb9-9502-b56e2c9f453b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:53:11.542719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afa0d7-224b-4eb9-9502-b56e2c9f453b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:11.544813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afa0d7-224b-4eb9-9502-b56e2c9f453b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:11.576841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3d20a286-e4c6-4fb7-bab1-0c90200f6eee None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:11.579703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3d20a286-e4c6-4fb7-bab1-0c90200f6eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:11.600441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 835/1662] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:53:11.601076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afa0d7-224b-4eb9-9502-b56e2c9f453b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:11.609523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 828/1663] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:11.613443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20a286-e4c6-4fb7-bab1-0c90200f6eee None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:11.636265 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afa0d7-224b-4eb9-9502-b56e2c9f453b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:11.637320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20a286-e4c6-4fb7-bab1-0c90200f6eee None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:11.651871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0083-2787-493c-93ba-86db84f9bd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:11.654226 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0083-2787-493c-93ba-86db84f9bd92 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:11.656333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0083-2787-493c-93ba-86db84f9bd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:11.656716 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0083-2787-493c-93ba-86db84f9bd92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:11.657034 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4df809-9a2c-46b5-87a7-4aa35fe89562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:11.657304 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca0083-2787-493c-93ba-86db84f9bd92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:11.657664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4df809-9a2c-46b5-87a7-4aa35fe89562 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:11.659304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4df809-9a2c-46b5-87a7-4aa35fe89562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:11.659583 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4df809-9a2c-46b5-87a7-4aa35fe89562 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:11.660251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4df809-9a2c-46b5-87a7-4aa35fe89562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:53:11.660581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4df809-9a2c-46b5-87a7-4aa35fe89562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:11.661912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca0083-2787-493c-93ba-86db84f9bd92 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:11.668246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4df809-9a2c-46b5-87a7-4aa35fe89562 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:11.704112 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 829/1664] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:53:11.709534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4df809-9a2c-46b5-87a7-4aa35fe89562 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:11.725388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 836/1665] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:53:11 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:11.730423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0083-2787-493c-93ba-86db84f9bd92 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:11.734770 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4df809-9a2c-46b5-87a7-4aa35fe89562 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:11.875065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:11.921607 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90a503-c9d7-4f7b-931f-8d424f3337c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:11.922247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90a503-c9d7-4f7b-931f-8d424f3337c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:11.922524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90a503-c9d7-4f7b-931f-8d424f3337c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:11.922814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90a503-c9d7-4f7b-931f-8d424f3337c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:11.926074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90a503-c9d7-4f7b-931f-8d424f3337c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:11.931003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0083-2787-493c-93ba-86db84f9bd92 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:11.932518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90a503-c9d7-4f7b-931f-8d424f3337c9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:11.946394 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b703ac-ef53-4c44-afe9-a0f9532601e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:11.947062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b703ac-ef53-4c44-afe9-a0f9532601e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:11.947338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b703ac-ef53-4c44-afe9-a0f9532601e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:11.947604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b703ac-ef53-4c44-afe9-a0f9532601e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:11.948248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b703ac-ef53-4c44-afe9-a0f9532601e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:11.951596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b703ac-ef53-4c44-afe9-a0f9532601e6 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:11.972126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:12.022068 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 830/1666] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:53:11 2022] POST /identity/v3/projects => generated 357 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:12.023425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90a503-c9d7-4f7b-931f-8d424f3337c9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:12.024081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 837/1667] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:53:11 2022] POST /identity/v3/users => generated 296 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:53:12.027080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b703ac-ef53-4c44-afe9-a0f9532601e6 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:12.050622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b703ac-ef53-4c44-afe9-a0f9532601e6 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:12.177537 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ea0ee-0bce-457d-9165-65694de3dec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:12.178205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ea0ee-0bce-457d-9165-65694de3dec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:12.178570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ea0ee-0bce-457d-9165-65694de3dec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:12.178903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ea0ee-0bce-457d-9165-65694de3dec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:12.179554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ea0ee-0bce-457d-9165-65694de3dec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:12.181812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90a503-c9d7-4f7b-931f-8d424f3337c9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:12.181938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ea0ee-0bce-457d-9165-65694de3dec9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:12.195559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 838/1668] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:12.199039 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d5a92-8c80-4d99-8095-b69d4939324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:12.200016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d5a92-8c80-4d99-8095-b69d4939324b admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:12.200235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ea0ee-0bce-457d-9165-65694de3dec9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:12.200338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d5a92-8c80-4d99-8095-b69d4939324b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:12.200557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d5a92-8c80-4d99-8095-b69d4939324b admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:12.201196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d5a92-8c80-4d99-8095-b69d4939324b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:12.203215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d5a92-8c80-4d99-8095-b69d4939324b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:12.212353 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ea0ee-0bce-457d-9165-65694de3dec9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:12.223907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50cb9d-c7d9-46d6-9a0c-be2be26f9119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:12.224538 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50cb9d-c7d9-46d6-9a0c-be2be26f9119 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:12.224812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50cb9d-c7d9-46d6-9a0c-be2be26f9119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:12.225077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50cb9d-c7d9-46d6-9a0c-be2be26f9119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:12.225838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50cb9d-c7d9-46d6-9a0c-be2be26f9119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:12.231655 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50cb9d-c7d9-46d6-9a0c-be2be26f9119 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:12.248661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 831/1669] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:53:12 2022] POST /identity/v3/users => generated 279 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:12.252431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d5a92-8c80-4d99-8095-b69d4939324b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:12.260010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 839/1670] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:12.264122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50cb9d-c7d9-46d6-9a0c-be2be26f9119 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:12.282416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50cb9d-c7d9-46d6-9a0c-be2be26f9119 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:12.283709 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d5a92-8c80-4d99-8095-b69d4939324b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:12.290104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b78f31-6eca-4915-b3f9-8fdeb8618b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:12.291246 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b78f31-6eca-4915-b3f9-8fdeb8618b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:12.291767 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b78f31-6eca-4915-b3f9-8fdeb8618b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:12.292236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b78f31-6eca-4915-b3f9-8fdeb8618b32 admin admin] PATH_INFO: `/v3/projects/6f32a65926ac4621ac502155d2fe297c/users/a9b109eff8ed4ad187393499f53a2477/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:12.309833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adc569-4b71-4969-934b-22cd8a34b47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:12.310578 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adc569-4b71-4969-934b-22cd8a34b47a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:12.310864 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adc569-4b71-4969-934b-22cd8a34b47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:12.311224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adc569-4b71-4969-934b-22cd8a34b47a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:12.311891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adc569-4b71-4969-934b-22cd8a34b47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:12.316714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adc569-4b71-4969-934b-22cd8a34b47a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:12.325207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b78f31-6eca-4915-b3f9-8fdeb8618b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f32a65926ac4621ac502155d2fe297c, user_id=a9b109eff8ed4ad187393499f53a2477, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:12.329039 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b78f31-6eca-4915-b3f9-8fdeb8618b32 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:12.341665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 832/1671] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:53:12.344661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adc569-4b71-4969-934b-22cd8a34b47a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:12.365385 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 840/1672] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:53:12 2022] PUT /identity/v3/projects/6f32a65926ac4621ac502155d2fe297c/users/a9b109eff8ed4ad187393499f53a2477/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:53:12.368076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516ae8-4ecc-4515-add6-5a97d5b49d49 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:12.368425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516ae8-4ecc-4515-add6-5a97d5b49d49 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:12.368751 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516ae8-4ecc-4515-add6-5a97d5b49d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:12.382420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adc569-4b71-4969-934b-22cd8a34b47a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:12.436460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-74516ae8-4ecc-4515-add6-5a97d5b49d49 None None] MFA Rules not processed for user `a9b109eff8ed4ad187393499f53a2477`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:12.438626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-74516ae8-4ecc-4515-add6-5a97d5b49d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:12.527125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 841/1673] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:53:12.560779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ac86c-841d-41e8-a2bf-ba8a91d671ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:12.561415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ac86c-841d-41e8-a2bf-ba8a91d671ba admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:12.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ac86c-841d-41e8-a2bf-ba8a91d671ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:12.561969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ac86c-841d-41e8-a2bf-ba8a91d671ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:12.562624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ac86c-841d-41e8-a2bf-ba8a91d671ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:12.564440 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ac86c-841d-41e8-a2bf-ba8a91d671ba admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:12.586349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74516ae8-4ecc-4515-add6-5a97d5b49d49 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:12.591045 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 833/1674] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:12.591415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-74516ae8-4ecc-4515-add6-5a97d5b49d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:12.592098 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ac86c-841d-41e8-a2bf-ba8a91d671ba admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:12.608272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ac86c-841d-41e8-a2bf-ba8a91d671ba admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:12.620451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e736-9711-42cd-a560-a6095ac8d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:12.621059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e736-9711-42cd-a560-a6095ac8d265 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:12.621338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e736-9711-42cd-a560-a6095ac8d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:12.621609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e736-9711-42cd-a560-a6095ac8d265 admin admin] PATH_INFO: `/v3/projects/47560f443ede445084cac939868d05de/users/1fe8c0e2c30b42e9ad5916bd955226c3/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:12.638608 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512e736-9711-42cd-a560-a6095ac8d265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47560f443ede445084cac939868d05de, user_id=1fe8c0e2c30b42e9ad5916bd955226c3, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:12.641454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512e736-9711-42cd-a560-a6095ac8d265 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:12.664298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 834/1675] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:53:12 2022] PUT /identity/v3/projects/47560f443ede445084cac939868d05de/users/1fe8c0e2c30b42e9ad5916bd955226c3/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:12.675104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b9b6e-9dbd-48ce-814c-63a61a52bc6a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:12.675417 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b9b6e-9dbd-48ce-814c-63a61a52bc6a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:12.675749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b9b6e-9dbd-48ce-814c-63a61a52bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:12.722647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3c9b9b6e-9dbd-48ce-814c-63a61a52bc6a None None] MFA Rules not processed for user `1fe8c0e2c30b42e9ad5916bd955226c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:12.726145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3c9b9b6e-9dbd-48ce-814c-63a61a52bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:12.741382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:12.768633 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:12.801421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74516ae8-4ecc-4515-add6-5a97d5b49d49 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:12.907140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 835/1676] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:12.912125 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b9b6e-9dbd-48ce-814c-63a61a52bc6a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:12.975784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af21b85-5104-4458-af43-238acb671dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:12.976304 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af21b85-5104-4458-af43-238acb671dae service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:12.976683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af21b85-5104-4458-af43-238acb671dae service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:12.977137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af21b85-5104-4458-af43-238acb671dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:13.128659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af21b85-5104-4458-af43-238acb671dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:13.130447 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b9b6e-9dbd-48ce-814c-63a61a52bc6a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:13.135611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af21b85-5104-4458-af43-238acb671dae service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:13.146472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d5c9e-1052-461e-ae47-3387df9b7721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:13.147125 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d5c9e-1052-461e-ae47-3387df9b7721 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:13.147405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d5c9e-1052-461e-ae47-3387df9b7721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:13.147681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d5c9e-1052-461e-ae47-3387df9b7721 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:13.148320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d5c9e-1052-461e-ae47-3387df9b7721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:13.150265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d5c9e-1052-461e-ae47-3387df9b7721 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:13.157940 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 842/1677] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:53:13.224559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 836/1678] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:53:12 2022] POST /identity/v3/projects => generated 355 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:13.228786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af21b85-5104-4458-af43-238acb671dae service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:13.246382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af21b85-5104-4458-af43-238acb671dae service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:13.330314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d5c9e-1052-461e-ae47-3387df9b7721 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:13.346468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d1036-8aa4-402d-be35-e6122e35388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:13.347330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d1036-8aa4-402d-be35-e6122e35388f admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:13.347684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d1036-8aa4-402d-be35-e6122e35388f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:13.349203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d1036-8aa4-402d-be35-e6122e35388f admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:13.350296 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d1036-8aa4-402d-be35-e6122e35388f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:13.352748 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d1036-8aa4-402d-be35-e6122e35388f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:13.387513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 843/1679] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:53:13 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:13.391502 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d1036-8aa4-402d-be35-e6122e35388f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:13.404855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d1036-8aa4-402d-be35-e6122e35388f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:13.413939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72e45f-b018-4ce9-afe1-ce84ac84a49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:13.414804 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72e45f-b018-4ce9-afe1-ce84ac84a49e admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:13.415833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72e45f-b018-4ce9-afe1-ce84ac84a49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:13.416114 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72e45f-b018-4ce9-afe1-ce84ac84a49e admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:13.416826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72e45f-b018-4ce9-afe1-ce84ac84a49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:13.419586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72e45f-b018-4ce9-afe1-ce84ac84a49e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:13.437159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 844/1680] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:53:13.440825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72e45f-b018-4ce9-afe1-ce84ac84a49e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:13.475409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d5c9e-1052-461e-ae47-3387df9b7721 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:13.475858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72e45f-b018-4ce9-afe1-ce84ac84a49e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:13.481025 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8987d-2dc9-44e6-80e7-a8647e0e6f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:13.481841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8987d-2dc9-44e6-80e7-a8647e0e6f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:13.482386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8987d-2dc9-44e6-80e7-a8647e0e6f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:13.482831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8987d-2dc9-44e6-80e7-a8647e0e6f4d admin admin] PATH_INFO: `/v3/users/a9b109eff8ed4ad187393499f53a2477` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:13.484299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8987d-2dc9-44e6-80e7-a8647e0e6f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b109eff8ed4ad187393499f53a2477)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:13.486755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8987d-2dc9-44e6-80e7-a8647e0e6f4d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:13.493340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2f675-9e5d-4b18-8fe8-02d0074c4417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:13.496283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2f675-9e5d-4b18-8fe8-02d0074c4417 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:13.496579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2f675-9e5d-4b18-8fe8-02d0074c4417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:13.496855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2f675-9e5d-4b18-8fe8-02d0074c4417 admin admin] PATH_INFO: `/v3/projects/50af8a896e284f7384eea5a12de8fd49/users/04f008e09f1040efaec676d31dc6ddfc/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:13.544104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2f675-9e5d-4b18-8fe8-02d0074c4417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50af8a896e284f7384eea5a12de8fd49, user_id=04f008e09f1040efaec676d31dc6ddfc, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:13.553299 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2f675-9e5d-4b18-8fe8-02d0074c4417 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:13.573418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:13.594074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 845/1681] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:53:13 2022] PUT /identity/v3/projects/50af8a896e284f7384eea5a12de8fd49/users/04f008e09f1040efaec676d31dc6ddfc/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:13.598063 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2f675-9e5d-4b18-8fe8-02d0074c4417 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:13.603350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4fc8987d-2dc9-44e6-80e7-a8647e0e6f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b109eff8ed4ad187393499f53a2477'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:13.612409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:13.642693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4fc8987d-2dc9-44e6-80e7-a8647e0e6f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b109eff8ed4ad187393499f53a2477'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:13.664696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4fc8987d-2dc9-44e6-80e7-a8647e0e6f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b109eff8ed4ad187393499f53a2477'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:13.678969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4fc8987d-2dc9-44e6-80e7-a8647e0e6f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b109eff8ed4ad187393499f53a2477'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:13.680028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4fc8987d-2dc9-44e6-80e7-a8647e0e6f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b109eff8ed4ad187393499f53a2477'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:13.693415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 837/1682] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:53:13 2022] DELETE /identity/v3/users/a9b109eff8ed4ad187393499f53a2477 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:13.699378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e5256-92b6-43d8-a5db-ffcf3949a4a3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:13.700175 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e5256-92b6-43d8-a5db-ffcf3949a4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:13.700395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e5256-92b6-43d8-a5db-ffcf3949a4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:13.746055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0d9e5256-92b6-43d8-a5db-ffcf3949a4a3 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:13.751222 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0d9e5256-92b6-43d8-a5db-ffcf3949a4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:13.783242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2f675-9e5d-4b18-8fe8-02d0074c4417 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:13.886790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 838/1683] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:13.968856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17220cc6-e30c-4d27-a3e4-94220e1f907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:13.969625 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220cc6-e30c-4d27-a3e4-94220e1f907a admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:13.969911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220cc6-e30c-4d27-a3e4-94220e1f907a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:13.970193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220cc6-e30c-4d27-a3e4-94220e1f907a admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:13.971125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17220cc6-e30c-4d27-a3e4-94220e1f907a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:13.972762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17220cc6-e30c-4d27-a3e4-94220e1f907a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:13.988944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 846/1684] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:13.992766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e5256-92b6-43d8-a5db-ffcf3949a4a3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:13.994494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0d9e5256-92b6-43d8-a5db-ffcf3949a4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:14.009543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17220cc6-e30c-4d27-a3e4-94220e1f907a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:14.011567 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-17220cc6-e30c-4d27-a3e4-94220e1f907a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:14.035665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e5256-92b6-43d8-a5db-ffcf3949a4a3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:14.052289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cbb6f-b691-4bcc-ba68-d55716e8b993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:14.055393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cbb6f-b691-4bcc-ba68-d55716e8b993 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:14.056661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cbb6f-b691-4bcc-ba68-d55716e8b993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:14.057706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cbb6f-b691-4bcc-ba68-d55716e8b993 admin admin] PATH_INFO: `/v3/projects/50af8a896e284f7384eea5a12de8fd49/users/04f008e09f1040efaec676d31dc6ddfc/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:14.063434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cbb6f-b691-4bcc-ba68-d55716e8b993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50af8a896e284f7384eea5a12de8fd49, user_id=04f008e09f1040efaec676d31dc6ddfc, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:14.071395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cbb6f-b691-4bcc-ba68-d55716e8b993 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:14.117799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 839/1685] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:53:13 2022] PUT /identity/v3/projects/50af8a896e284f7384eea5a12de8fd49/users/04f008e09f1040efaec676d31dc6ddfc/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:14.128577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f58489-84f7-415d-a929-5ba0e52e951f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:14.129064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f58489-84f7-415d-a929-5ba0e52e951f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:14.130009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f58489-84f7-415d-a929-5ba0e52e951f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:14.196687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17220cc6-e30c-4d27-a3e4-94220e1f907a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:14.197894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d1f58489-84f7-415d-a929-5ba0e52e951f None None] MFA Rules not processed for user `04f008e09f1040efaec676d31dc6ddfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:14.200169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d1f58489-84f7-415d-a929-5ba0e52e951f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:14.309661 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af20d2-03a7-4d8d-9d78-dd80f5d65b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:14.310279 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af20d2-03a7-4d8d-9d78-dd80f5d65b95 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:14.310279 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af20d2-03a7-4d8d-9d78-dd80f5d65b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:14.311728 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af20d2-03a7-4d8d-9d78-dd80f5d65b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:14.337505 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:14.388437 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 840/1686] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:14.395453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f58489-84f7-415d-a929-5ba0e52e951f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:14.427575 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f58489-84f7-415d-a929-5ba0e52e951f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:14.429061 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af20d2-03a7-4d8d-9d78-dd80f5d65b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:14.430958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af20d2-03a7-4d8d-9d78-dd80f5d65b95 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:14.444857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 847/1687] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:53:14.448064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15fe94-c2c6-4913-870a-c1e771ce5eb1 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f008e09f1040efaec676d31dc6ddfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50af8a896e284f7384eea5a12de8fd49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:14.448686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15fe94-c2c6-4913-870a-c1e771ce5eb1 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:14.449044 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15fe94-c2c6-4913-870a-c1e771ce5eb1 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:14.449218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15fe94-c2c6-4913-870a-c1e771ce5eb1 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:14.450166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15fe94-c2c6-4913-870a-c1e771ce5eb1 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:53:14.451567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15fe94-c2c6-4913-870a-c1e771ce5eb1 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:14.453543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15fe94-c2c6-4913-870a-c1e771ce5eb1 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:14.472499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 841/1688] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:53:14.475153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af20d2-03a7-4d8d-9d78-dd80f5d65b95 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:14.498550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af20d2-03a7-4d8d-9d78-dd80f5d65b95 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:14.508781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3f9e4-7aac-4ba8-9204-bbaf355b80b8 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f008e09f1040efaec676d31dc6ddfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50af8a896e284f7384eea5a12de8fd49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:14.509883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f9e4-7aac-4ba8-9204-bbaf355b80b8 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:14.510364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f9e4-7aac-4ba8-9204-bbaf355b80b8 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:14.510928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f9e4-7aac-4ba8-9204-bbaf355b80b8 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:14.512569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3f9e4-7aac-4ba8-9204-bbaf355b80b8 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:14.515252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3f9e4-7aac-4ba8-9204-bbaf355b80b8 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:14.564876 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 848/1689] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:53:14 2022] POST /identity/v3/projects => generated 350 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:14.569566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15fe94-c2c6-4913-870a-c1e771ce5eb1 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:14.584656 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15fe94-c2c6-4913-870a-c1e771ce5eb1 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:14.617406 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:14.686539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcfe94-907b-42ef-b8db-14c711da114d tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f008e09f1040efaec676d31dc6ddfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50af8a896e284f7384eea5a12de8fd49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:14.687425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcfe94-907b-42ef-b8db-14c711da114d tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:14.687864 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcfe94-907b-42ef-b8db-14c711da114d tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:14.688541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcfe94-907b-42ef-b8db-14c711da114d tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:14.689958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcfe94-907b-42ef-b8db-14c711da114d tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:53:14.690520 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcfe94-907b-42ef-b8db-14c711da114d tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:14.692905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcfe94-907b-42ef-b8db-14c711da114d tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:14.718500 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 842/1690] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:53:14.746796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3f9e4-7aac-4ba8-9204-bbaf355b80b8 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:14.826241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3f9e4-7aac-4ba8-9204-bbaf355b80b8 tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:14.831166 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0526e-77ec-4578-8280-15b552c22649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:14.832176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0526e-77ec-4578-8280-15b552c22649 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:14.832176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0526e-77ec-4578-8280-15b552c22649 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:14.832392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0526e-77ec-4578-8280-15b552c22649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:14.850269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0526e-77ec-4578-8280-15b552c22649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:14.851770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0526e-77ec-4578-8280-15b552c22649 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:14.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 849/1691] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:15.059718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5241b53-bd65-4822-9395-0696deb7ea08 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:15.065258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5241b53-bd65-4822-9395-0696deb7ea08 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:15.072888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5241b53-bd65-4822-9395-0696deb7ea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:15.265637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c5241b53-bd65-4822-9395-0696deb7ea08 None None] MFA Rules not processed for user `46b90940e030470d8ab21cb82011b920`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:15.267107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c5241b53-bd65-4822-9395-0696deb7ea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:15.469811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 843/1692] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:15.473785 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0526e-77ec-4578-8280-15b552c22649 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:15.475336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a5a0526e-77ec-4578-8280-15b552c22649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:15.549605 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5241b53-bd65-4822-9395-0696deb7ea08 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:15.551873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c5241b53-bd65-4822-9395-0696deb7ea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:15.709155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0526e-77ec-4578-8280-15b552c22649 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:15.733857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73321053-94c7-4e36-a970-0ae686a8310d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:15.734486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73321053-94c7-4e36-a970-0ae686a8310d service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:15.734776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73321053-94c7-4e36-a970-0ae686a8310d service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:15.735048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73321053-94c7-4e36-a970-0ae686a8310d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:15.757223 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73321053-94c7-4e36-a970-0ae686a8310d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:15.758843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73321053-94c7-4e36-a970-0ae686a8310d service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:15.771089 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5241b53-bd65-4822-9395-0696deb7ea08 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:15.777106 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 850/1693] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:15.790390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:15.791088 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:15.791369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:15.791637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de admin admin] PATH_INFO: `/v3/projects/6f32a65926ac4621ac502155d2fe297c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:15.799670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f32a65926ac4621ac502155d2fe297c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:15.802521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:15.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:15.911737 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f32a65926ac4621ac502155d2fe297c', 'request_id': 'req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:15.936766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f32a65926ac4621ac502155d2fe297c', 'request_id': 'req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:15.943768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f32a65926ac4621ac502155d2fe297c', 'request_id': 'req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:15.975633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de admin admin] The token cache is being invalidate because project 6f32a65926ac4621ac502155d2fe297c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:53:15.975946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:15.976606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27e92a21-6d7d-48ba-a4b4-0679ee5a34de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:15.981523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 844/1694] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:53:15 2022] DELETE /identity/v3/projects/6f32a65926ac4621ac502155d2fe297c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:15.983246 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ef38-07f6-41ec-958a-75cebe55255c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:15.983545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ef38-07f6-41ec-958a-75cebe55255c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:15.983815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ef38-07f6-41ec-958a-75cebe55255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:16.025527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d0a8ef38-07f6-41ec-958a-75cebe55255c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:16.026816 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d0a8ef38-07f6-41ec-958a-75cebe55255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:16.061017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:16.165488 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 851/1695] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:16.173245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffbfcc-2f7c-4395-b18d-6072e2aa6ba7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:16.173780 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffbfcc-2f7c-4395-b18d-6072e2aa6ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:16.173780 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffbfcc-2f7c-4395-b18d-6072e2aa6ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:16.215879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-16ffbfcc-2f7c-4395-b18d-6072e2aa6ba7 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:16.217130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-16ffbfcc-2f7c-4395-b18d-6072e2aa6ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:16.233626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 845/1696] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:16.237756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8ef38-07f6-41ec-958a-75cebe55255c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:16.255973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8ef38-07f6-41ec-958a-75cebe55255c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:16.266020 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bfea2-fee0-4fe1-8c5a-6c03a36b9277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:16.266648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bfea2-fee0-4fe1-8c5a-6c03a36b9277 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:16.266971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bfea2-fee0-4fe1-8c5a-6c03a36b9277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:16.267241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bfea2-fee0-4fe1-8c5a-6c03a36b9277 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:16.268404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bfea2-fee0-4fe1-8c5a-6c03a36b9277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:53:16.268404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bfea2-fee0-4fe1-8c5a-6c03a36b9277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:16.269821 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bfea2-fee0-4fe1-8c5a-6c03a36b9277 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:16.298114 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 852/1697] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:53:16.303935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffbfcc-2f7c-4395-b18d-6072e2aa6ba7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:16.325706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffbfcc-2f7c-4395-b18d-6072e2aa6ba7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:16.336294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63f20b-2b1e-48ea-a416-5e9cb2bbb593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:16.336952 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63f20b-2b1e-48ea-a416-5e9cb2bbb593 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:16.337216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63f20b-2b1e-48ea-a416-5e9cb2bbb593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:16.337481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63f20b-2b1e-48ea-a416-5e9cb2bbb593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:16.338126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63f20b-2b1e-48ea-a416-5e9cb2bbb593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:16.342902 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63f20b-2b1e-48ea-a416-5e9cb2bbb593 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:16.418454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 846/1698] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:53:16 2022] POST /identity/v3/projects => generated 397 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:53:16.419048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bfea2-fee0-4fe1-8c5a-6c03a36b9277 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:16.435208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bfea2-fee0-4fe1-8c5a-6c03a36b9277 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:16.587855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df22c9a-7a63-4799-98c9-b27fe1dfa557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:16.588713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df22c9a-7a63-4799-98c9-b27fe1dfa557 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:16.588899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df22c9a-7a63-4799-98c9-b27fe1dfa557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:16.589300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df22c9a-7a63-4799-98c9-b27fe1dfa557 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:16.589951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df22c9a-7a63-4799-98c9-b27fe1dfa557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:16.594605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df22c9a-7a63-4799-98c9-b27fe1dfa557 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:16.644819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 853/1699] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:53:16 2022] POST /identity/v3/users => generated 299 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:53:16.649176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63f20b-2b1e-48ea-a416-5e9cb2bbb593 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:16.662639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63f20b-2b1e-48ea-a416-5e9cb2bbb593 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:16.675598 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae199-cd6d-44de-b9f4-0afe500b1646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:16.676238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae199-cd6d-44de-b9f4-0afe500b1646 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:16.677064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae199-cd6d-44de-b9f4-0afe500b1646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:16.677338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae199-cd6d-44de-b9f4-0afe500b1646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:16.678173 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ae199-cd6d-44de-b9f4-0afe500b1646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:16.683641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ae199-cd6d-44de-b9f4-0afe500b1646 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:16.703855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5985bb3-f78f-4c75-b87b-90c478e566d6 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:16.704318 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5985bb3-f78f-4c75-b87b-90c478e566d6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:16.704560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5985bb3-f78f-4c75-b87b-90c478e566d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:16.714889 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 847/1700] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:16.715935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae199-cd6d-44de-b9f4-0afe500b1646 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:16.745993 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c5985bb3-f78f-4c75-b87b-90c478e566d6 None None] MFA Rules not processed for user `6aa81fbf97d3485d845d5cc04449efb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:16.747350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c5985bb3-f78f-4c75-b87b-90c478e566d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:16.749028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae199-cd6d-44de-b9f4-0afe500b1646 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:16.764382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56496-7b31-4b94-a065-c4df1601286c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:16.765391 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56496-7b31-4b94-a065-c4df1601286c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:16.765965 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56496-7b31-4b94-a065-c4df1601286c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:16.766970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56496-7b31-4b94-a065-c4df1601286c admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:16.767819 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56496-7b31-4b94-a065-c4df1601286c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:16.773923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56496-7b31-4b94-a065-c4df1601286c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:16.803168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 848/1701] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:16.804804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56496-7b31-4b94-a065-c4df1601286c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:16.831989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56496-7b31-4b94-a065-c4df1601286c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:16.844784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e339712-5af7-4e35-90c2-cb755131a79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:16.846070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e339712-5af7-4e35-90c2-cb755131a79f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:16.846654 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e339712-5af7-4e35-90c2-cb755131a79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:16.851391 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e339712-5af7-4e35-90c2-cb755131a79f admin admin] PATH_INFO: `/v3/projects/36b4fbd44b4843a0b760c5ecd4a1f52b/users/7cd8caf42bf04de58c1622dcb11d2ef7/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:16.903498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e339712-5af7-4e35-90c2-cb755131a79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b4fbd44b4843a0b760c5ecd4a1f52b, user_id=7cd8caf42bf04de58c1622dcb11d2ef7, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:16.907508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e339712-5af7-4e35-90c2-cb755131a79f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:16.925167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 854/1702] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:53:16.925167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5985bb3-f78f-4c75-b87b-90c478e566d6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:16.936730 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c5985bb3-f78f-4c75-b87b-90c478e566d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:17.001064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 849/1703] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:53:16 2022] PUT /identity/v3/projects/36b4fbd44b4843a0b760c5ecd4a1f52b/users/7cd8caf42bf04de58c1622dcb11d2ef7/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:17.019537 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17075881-dabc-4e1b-a9f9-72d3fbe85fe1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:17.026157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17075881-dabc-4e1b-a9f9-72d3fbe85fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:17.027225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17075881-dabc-4e1b-a9f9-72d3fbe85fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:17.085046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:17.118970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5985bb3-f78f-4c75-b87b-90c478e566d6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:17.129285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-17075881-dabc-4e1b-a9f9-72d3fbe85fe1 None None] MFA Rules not processed for user `7cd8caf42bf04de58c1622dcb11d2ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:17.131553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-17075881-dabc-4e1b-a9f9-72d3fbe85fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:17.277371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f008e09f1040efaec676d31dc6ddfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50af8a896e284f7384eea5a12de8fd49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:17.279422 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:17.279960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:17.281178 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] PATH_INFO: `/v3/projects/9b9ee809fed643f786265f1ec1a0ab5f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:17.283468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b9ee809fed643f786265f1ec1a0ab5f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:17.287200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:17.307558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 850/1704] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:17.308939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82042075-6e10-49bd-b2d0-d20d2ce32505 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:17.309236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82042075-6e10-49bd-b2d0-d20d2ce32505 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:17.309502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82042075-6e10-49bd-b2d0-d20d2ce32505 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:17.317642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 851/1705] 10.222.0.33 () {54 vars in 912 bytes} [Sun Sep 11 00:53:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:17.319002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99df142-0473-4b3f-a469-6e9ae05b0bbc None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:17.319289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99df142-0473-4b3f-a469-6e9ae05b0bbc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:17.319558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99df142-0473-4b3f-a469-6e9ae05b0bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:17.352735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b99df142-0473-4b3f-a469-6e9ae05b0bbc None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:17.354161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b99df142-0473-4b3f-a469-6e9ae05b0bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:17.423654 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9ee809fed643f786265f1ec1a0ab5f', 'request_id': 'req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:17.444505 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9ee809fed643f786265f1ec1a0ab5f', 'request_id': 'req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:17.461036 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9ee809fed643f786265f1ec1a0ab5f', 'request_id': 'req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:17.474029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:17.489605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] The token cache is being invalidate because project 9b9ee809fed643f786265f1ec1a0ab5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:53:17.490123 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:17.491330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:17.500182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 855/1706] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:53:16 2022] DELETE /identity/v3/projects/9b9ee809fed643f786265f1ec1a0ab5f => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:17.500182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:17.502247 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:17.552608 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 852/1707] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 00:53:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:17.576121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99df142-0473-4b3f-a469-6e9ae05b0bbc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:17.577794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b99df142-0473-4b3f-a469-6e9ae05b0bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:17.700418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeae95-e0f1-45e4-9713-7be8d133e7fb tempest-QuotasTest-841572407 tempest-QuotasTest-841572407-project-admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:17.714433 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e144f1-20b3-4086-9154-f5717b3597b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:17.715425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e144f1-20b3-4086-9154-f5717b3597b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:17.716738 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e144f1-20b3-4086-9154-f5717b3597b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:17.717173 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e144f1-20b3-4086-9154-f5717b3597b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:17.724846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c1e144f1-20b3-4086-9154-f5717b3597b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:17.885226 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:17.905450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99df142-0473-4b3f-a469-6e9ae05b0bbc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:17.991819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e144f1-20b3-4086-9154-f5717b3597b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:18.001252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e144f1-20b3-4086-9154-f5717b3597b0 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:18.056463 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 856/1708] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:17 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:18.073373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43d4e4-c3d8-4822-bc1e-66d2e1fdebf9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dfdb9054ac4fef97d8e30aa5a8bd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:18.074043 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43d4e4-c3d8-4822-bc1e-66d2e1fdebf9 service glance] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:18.074323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43d4e4-c3d8-4822-bc1e-66d2e1fdebf9 service glance] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:18.074588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43d4e4-c3d8-4822-bc1e-66d2e1fdebf9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:18.246101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43d4e4-c3d8-4822-bc1e-66d2e1fdebf9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:18.248315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43d4e4-c3d8-4822-bc1e-66d2e1fdebf9 service glance] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:18.291020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 853/1709] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:18.421699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e144f1-20b3-4086-9154-f5717b3597b0 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:18.423755 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c1e144f1-20b3-4086-9154-f5717b3597b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:18.631041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e144f1-20b3-4086-9154-f5717b3597b0 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:18.638713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb1546-b885-473b-a15c-91857037d233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:18.662037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1546-b885-473b-a15c-91857037d233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:18.662621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1546-b885-473b-a15c-91857037d233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:18.674038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f70b-aedc-40f0-aec4-ab121e07a47f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:18.674588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f70b-aedc-40f0-aec4-ab121e07a47f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:18.674588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f70b-aedc-40f0-aec4-ab121e07a47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:18.698326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1546-b885-473b-a15c-91857037d233 admin admin] PATH_INFO: `/v3/users/1fe8c0e2c30b42e9ad5916bd955226c3` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:18.702248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb1546-b885-473b-a15c-91857037d233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe8c0e2c30b42e9ad5916bd955226c3)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:18.706858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb1546-b885-473b-a15c-91857037d233 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:18.787909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d6d6f70b-aedc-40f0-aec4-ab121e07a47f None None] MFA Rules not processed for user `d5559495af904f3ab40abcec18259f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:18.793256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d6d6f70b-aedc-40f0-aec4-ab121e07a47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:18.798821 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-70cb1546-b885-473b-a15c-91857037d233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe8c0e2c30b42e9ad5916bd955226c3'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:18.799686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-70cb1546-b885-473b-a15c-91857037d233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe8c0e2c30b42e9ad5916bd955226c3'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:18.809870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:18.810663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-70cb1546-b885-473b-a15c-91857037d233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe8c0e2c30b42e9ad5916bd955226c3'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:18.825794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-70cb1546-b885-473b-a15c-91857037d233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe8c0e2c30b42e9ad5916bd955226c3'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:18.866811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-70cb1546-b885-473b-a15c-91857037d233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe8c0e2c30b42e9ad5916bd955226c3'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:18.890879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 857/1710] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:53:18 2022] DELETE /identity/v3/users/1fe8c0e2c30b42e9ad5916bd955226c3 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:18.893302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274299a-68dc-4db3-9d9b-1ca6afa126b9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:18.894212 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274299a-68dc-4db3-9d9b-1ca6afa126b9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:18.896033 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274299a-68dc-4db3-9d9b-1ca6afa126b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:18.949254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4274299a-68dc-4db3-9d9b-1ca6afa126b9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:18.953164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4274299a-68dc-4db3-9d9b-1ca6afa126b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:18.975511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 854/1711] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:19.074315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:19.110882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 858/1712] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:19.118198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a17d4f-dbea-4378-8884-c30daeef7598 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:19.119000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a17d4f-dbea-4378-8884-c30daeef7598 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:19.119000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a17d4f-dbea-4378-8884-c30daeef7598 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:19.120984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 855/1713] 10.222.0.33 () {54 vars in 912 bytes} [Sun Sep 11 00:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:19.128355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7a95-18d1-4618-980c-19104f187839 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:19.128648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7a95-18d1-4618-980c-19104f187839 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:19.128918 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7a95-18d1-4618-980c-19104f187839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:19.155949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9fed7a95-18d1-4618-980c-19104f187839 None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:19.157651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9fed7a95-18d1-4618-980c-19104f187839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:19.209058 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a17d4f-dbea-4378-8884-c30daeef7598 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:19.211009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-02a17d4f-dbea-4378-8884-c30daeef7598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:19.345068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 859/1714] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 00:53:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:19.359977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed7a95-18d1-4618-980c-19104f187839 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:19.365356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9fed7a95-18d1-4618-980c-19104f187839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:19.410110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a17d4f-dbea-4378-8884-c30daeef7598 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:19.420716 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac290a-1d19-475d-8b21-6ef8d142bc14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:19.421352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac290a-1d19-475d-8b21-6ef8d142bc14 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:19.421632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac290a-1d19-475d-8b21-6ef8d142bc14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:19.421968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac290a-1d19-475d-8b21-6ef8d142bc14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:19.446900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac290a-1d19-475d-8b21-6ef8d142bc14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:19.450074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac290a-1d19-475d-8b21-6ef8d142bc14 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:19.488715 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 856/1715] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:19.528024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed7a95-18d1-4618-980c-19104f187839 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:19.549505 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f9cb1-ed37-4aa0-ac89-6f51f8dee766 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dfdb9054ac4fef97d8e30aa5a8bd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:19.551016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9cb1-ed37-4aa0-ac89-6f51f8dee766 service glance] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:19.551357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9cb1-ed37-4aa0-ac89-6f51f8dee766 service glance] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:19.552298 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9cb1-ed37-4aa0-ac89-6f51f8dee766 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:19.574120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f9cb1-ed37-4aa0-ac89-6f51f8dee766 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:19.579211 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f9cb1-ed37-4aa0-ac89-6f51f8dee766 service glance] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:19.624814 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 860/1716] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:20.855313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93484d-c352-4930-b90e-bfaffda69943 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:20.855814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93484d-c352-4930-b90e-bfaffda69943 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:20.855888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93484d-c352-4930-b90e-bfaffda69943 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:20.858505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 857/1717] 10.222.0.33 () {54 vars in 912 bytes} [Sun Sep 11 00:53:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:20.871409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85050b91-401f-4758-a84b-d436514e90af None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:20.873003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85050b91-401f-4758-a84b-d436514e90af None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:20.873487 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85050b91-401f-4758-a84b-d436514e90af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:20.934410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-85050b91-401f-4758-a84b-d436514e90af None None] MFA Rules not processed for user `c45d8e2b0b674e9a814167db4d78749e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:20.936949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-85050b91-401f-4758-a84b-d436514e90af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:20.947942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 861/1718] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 00:53:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:21.015552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93484d-c352-4930-b90e-bfaffda69943 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:21.020102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7d93484d-c352-4930-b90e-bfaffda69943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:21.038936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85050b91-401f-4758-a84b-d436514e90af None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:21.040335 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-85050b91-401f-4758-a84b-d436514e90af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:21.054974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93484d-c352-4930-b90e-bfaffda69943 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:21.060403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109b0e1-fcf2-430e-888f-74e2dccc2b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:21.061577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109b0e1-fcf2-430e-888f-74e2dccc2b62 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:21.062152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109b0e1-fcf2-430e-888f-74e2dccc2b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:21.062502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109b0e1-fcf2-430e-888f-74e2dccc2b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:21.081593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109b0e1-fcf2-430e-888f-74e2dccc2b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:21.084673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85050b91-401f-4758-a84b-d436514e90af None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:21.085652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109b0e1-fcf2-430e-888f-74e2dccc2b62 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:21.103645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36891e4-a292-4d56-b9e2-b0788584ebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:21.104657 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36891e4-a292-4d56-b9e2-b0788584ebdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:21.105395 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36891e4-a292-4d56-b9e2-b0788584ebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:21.105774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36891e4-a292-4d56-b9e2-b0788584ebdc admin admin] PATH_INFO: `/v3/projects/47560f443ede445084cac939868d05de` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:21.107267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36891e4-a292-4d56-b9e2-b0788584ebdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=47560f443ede445084cac939868d05de)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:21.111451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 858/1719] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:21.111991 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36891e4-a292-4d56-b9e2-b0788584ebdc admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:21.117324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a79cb5-ba14-4698-afce-08dc0382b0af None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:21.117815 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a79cb5-ba14-4698-afce-08dc0382b0af None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:21.119092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a79cb5-ba14-4698-afce-08dc0382b0af None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:21.121916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 859/1720] 10.222.0.33 () {54 vars in 921 bytes} [Sun Sep 11 00:53:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:21.123302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c73a1-8790-409e-bf29-0cf2c6846be6 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:21.130074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c73a1-8790-409e-bf29-0cf2c6846be6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:21.130540 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c73a1-8790-409e-bf29-0cf2c6846be6 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:21.133552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 860/1721] 10.222.0.33 () {54 vars in 912 bytes} [Sun Sep 11 00:53:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:21.139986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cdbc0-61af-4969-bb63-fa1399615091 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:21.140499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cdbc0-61af-4969-bb63-fa1399615091 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:21.140905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cdbc0-61af-4969-bb63-fa1399615091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:21.191549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9d7cdbc0-61af-4969-bb63-fa1399615091 None None] MFA Rules not processed for user `c45d8e2b0b674e9a814167db4d78749e`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:21.195910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9d7cdbc0-61af-4969-bb63-fa1399615091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:21.213101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e36891e4-a292-4d56-b9e2-b0788584ebdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47560f443ede445084cac939868d05de', 'request_id': 'req-e36891e4-a292-4d56-b9e2-b0788584ebdc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:21.225895 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e36891e4-a292-4d56-b9e2-b0788584ebdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47560f443ede445084cac939868d05de', 'request_id': 'req-e36891e4-a292-4d56-b9e2-b0788584ebdc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:21.243242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e36891e4-a292-4d56-b9e2-b0788584ebdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47560f443ede445084cac939868d05de', 'request_id': 'req-e36891e4-a292-4d56-b9e2-b0788584ebdc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:21.245959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:21.265967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e36891e4-a292-4d56-b9e2-b0788584ebdc admin admin] The token cache is being invalidate because project 47560f443ede445084cac939868d05de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:53:21.266709 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e36891e4-a292-4d56-b9e2-b0788584ebdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:21.268126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e36891e4-a292-4d56-b9e2-b0788584ebdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:21.276042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 862/1722] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:53:21 2022] DELETE /identity/v3/projects/47560f443ede445084cac939868d05de => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:21.279691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13467401-70e4-460c-9b8b-bcac6749ffca None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:21.280203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13467401-70e4-460c-9b8b-bcac6749ffca None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:21.280894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13467401-70e4-460c-9b8b-bcac6749ffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:21.330346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-13467401-70e4-460c-9b8b-bcac6749ffca None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:21.332435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 861/1723] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 00:53:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:21.333977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cdbc0-61af-4969-bb63-fa1399615091 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:21.335949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-13467401-70e4-460c-9b8b-bcac6749ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:21.340555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9d7cdbc0-61af-4969-bb63-fa1399615091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:21.471106 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 863/1724] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 00:53:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:21.472362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13467401-70e4-460c-9b8b-bcac6749ffca None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:21.475412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-13467401-70e4-460c-9b8b-bcac6749ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:21.483797 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:21.492024 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cdbc0-61af-4969-bb63-fa1399615091 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:21.499965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13467401-70e4-460c-9b8b-bcac6749ffca None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:21.502750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:21.503399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:21.503676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:21.503942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] PATH_INFO: `/v3/users/04f008e09f1040efaec676d31dc6ddfc` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:21.506399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f008e09f1040efaec676d31dc6ddfc)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:21.509488 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3e4fe-79ed-4e7f-b2b2-a673394e652e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:21.509758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:21.510539 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3e4fe-79ed-4e7f-b2b2-a673394e652e service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:21.510959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3e4fe-79ed-4e7f-b2b2-a673394e652e service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:21.513301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3e4fe-79ed-4e7f-b2b2-a673394e652e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:21.538335 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3e4fe-79ed-4e7f-b2b2-a673394e652e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:21.544055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3e4fe-79ed-4e7f-b2b2-a673394e652e service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:21.573257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 864/1725] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:21.575325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3e4fe-79ed-4e7f-b2b2-a673394e652e service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:21.582385 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4af3e4fe-79ed-4e7f-b2b2-a673394e652e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:21.625894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f008e09f1040efaec676d31dc6ddfc'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:21.634910 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3e4fe-79ed-4e7f-b2b2-a673394e652e service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:21.655563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c887613-b1df-4c0c-beb1-7c61f0752987 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:21.656180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c887613-b1df-4c0c-beb1-7c61f0752987 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:21.657814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f008e09f1040efaec676d31dc6ddfc'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:21.659404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c887613-b1df-4c0c-beb1-7c61f0752987 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:21.659686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c887613-b1df-4c0c-beb1-7c61f0752987 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:21.676240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f008e09f1040efaec676d31dc6ddfc'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:21.684847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c887613-b1df-4c0c-beb1-7c61f0752987 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:21.685847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c887613-b1df-4c0c-beb1-7c61f0752987 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:21.703227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f008e09f1040efaec676d31dc6ddfc'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:21.703964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f008e09f1040efaec676d31dc6ddfc'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:21.723568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 862/1726] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:53:21 2022] DELETE /identity/v3/users/04f008e09f1040efaec676d31dc6ddfc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:21.726374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 865/1727] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:22.681007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:22.682598 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:22.818943 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38174e2a-60ce-4ee0-87ae-3fce7ed37bcf admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:22.827333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e09fb-1942-4fc4-bb16-c7470f2cd125 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:22.829384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e09fb-1942-4fc4-bb16-c7470f2cd125 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:22.830524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e09fb-1942-4fc4-bb16-c7470f2cd125 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:22.835066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e09fb-1942-4fc4-bb16-c7470f2cd125 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:22.861729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-161e09fb-1942-4fc4-bb16-c7470f2cd125 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:22.898496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e09fb-1942-4fc4-bb16-c7470f2cd125 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:22.900482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e09fb-1942-4fc4-bb16-c7470f2cd125 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:22.922251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 863/1728] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:22.994605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c887613-b1df-4c0c-beb1-7c61f0752987 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:23.032616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c887613-b1df-4c0c-beb1-7c61f0752987 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:23.203051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639568e0-ba70-45b5-93df-8cafc7b632cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:23.203718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639568e0-ba70-45b5-93df-8cafc7b632cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:23.204592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639568e0-ba70-45b5-93df-8cafc7b632cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:23.204592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639568e0-ba70-45b5-93df-8cafc7b632cb admin admin] PATH_INFO: `/v3/projects/50af8a896e284f7384eea5a12de8fd49` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:23.206757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639568e0-ba70-45b5-93df-8cafc7b632cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=50af8a896e284f7384eea5a12de8fd49)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:23.210083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639568e0-ba70-45b5-93df-8cafc7b632cb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:23.361949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-639568e0-ba70-45b5-93df-8cafc7b632cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50af8a896e284f7384eea5a12de8fd49', 'request_id': 'req-639568e0-ba70-45b5-93df-8cafc7b632cb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:23.373183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-639568e0-ba70-45b5-93df-8cafc7b632cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50af8a896e284f7384eea5a12de8fd49', 'request_id': 'req-639568e0-ba70-45b5-93df-8cafc7b632cb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:23.384942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-639568e0-ba70-45b5-93df-8cafc7b632cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50af8a896e284f7384eea5a12de8fd49', 'request_id': 'req-639568e0-ba70-45b5-93df-8cafc7b632cb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:23.394665 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=1,keystone:DELETE=7,keystone:SELECT=92 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:23.419507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-639568e0-ba70-45b5-93df-8cafc7b632cb admin admin] The token cache is being invalidate because project 50af8a896e284f7384eea5a12de8fd49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:53:23.437948 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-639568e0-ba70-45b5-93df-8cafc7b632cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:23.439958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-639568e0-ba70-45b5-93df-8cafc7b632cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:23.450414 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cfd4a-8951-48ec-9cb3-b7183773882a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:23.450878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cfd4a-8951-48ec-9cb3-b7183773882a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:23.451189 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cfd4a-8951-48ec-9cb3-b7183773882a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:23.454070 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 866/1729] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:53:22 2022] DELETE /identity/v3/projects/50af8a896e284f7384eea5a12de8fd49 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:23.504380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ca2cfd4a-8951-48ec-9cb3-b7183773882a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:23.506342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ca2cfd4a-8951-48ec-9cb3-b7183773882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:23.696349 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 864/1730] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:23.708466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123051d1-fb69-4d37-a320-d0677ce6e8a3 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:23.708466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123051d1-fb69-4d37-a320-d0677ce6e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:23.708951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123051d1-fb69-4d37-a320-d0677ce6e8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:23.746328 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-123051d1-fb69-4d37-a320-d0677ce6e8a3 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:23.747726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-123051d1-fb69-4d37-a320-d0677ce6e8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:23.772640 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 867/1731] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:23.777745 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cfd4a-8951-48ec-9cb3-b7183773882a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:23.785886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:23.803112 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cfd4a-8951-48ec-9cb3-b7183773882a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:23.823307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921e8a1-44a1-4d50-b8bc-c528d5481705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:23.826126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921e8a1-44a1-4d50-b8bc-c528d5481705 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:23.826530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921e8a1-44a1-4d50-b8bc-c528d5481705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:23.828336 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921e8a1-44a1-4d50-b8bc-c528d5481705 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:23.829159 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921e8a1-44a1-4d50-b8bc-c528d5481705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:53:23.831050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921e8a1-44a1-4d50-b8bc-c528d5481705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:23.836879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921e8a1-44a1-4d50-b8bc-c528d5481705 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:23.889419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 865/1732] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:53:23.894973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123051d1-fb69-4d37-a320-d0677ce6e8a3 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:23.910111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123051d1-fb69-4d37-a320-d0677ce6e8a3 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:23.924931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1d980-12b5-4187-b354-32a0343bf275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:23.927974 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d980-12b5-4187-b354-32a0343bf275 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:23.929636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d980-12b5-4187-b354-32a0343bf275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:23.930144 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d980-12b5-4187-b354-32a0343bf275 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:23.930962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1d980-12b5-4187-b354-32a0343bf275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:23.936600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1d980-12b5-4187-b354-32a0343bf275 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:24.011107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 868/1733] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:53:23 2022] POST /identity/v3/projects => generated 361 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:24.014127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921e8a1-44a1-4d50-b8bc-c528d5481705 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:24.029027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921e8a1-44a1-4d50-b8bc-c528d5481705 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:24.180904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136c668-0ca6-4956-b7fc-57a0f6b69f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:24.181542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136c668-0ca6-4956-b7fc-57a0f6b69f22 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:24.181826 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136c668-0ca6-4956-b7fc-57a0f6b69f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:24.182102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136c668-0ca6-4956-b7fc-57a0f6b69f22 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:24.182793 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136c668-0ca6-4956-b7fc-57a0f6b69f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:24.194593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136c668-0ca6-4956-b7fc-57a0f6b69f22 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:24.240220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 866/1734] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:53:24 2022] POST /identity/v3/users => generated 281 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:24.241586 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1d980-12b5-4187-b354-32a0343bf275 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:24.260081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1d980-12b5-4187-b354-32a0343bf275 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:24.268945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d363b93-d0b6-4035-859c-67c0cc7be910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:24.270994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d363b93-d0b6-4035-859c-67c0cc7be910 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:24.271403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d363b93-d0b6-4035-859c-67c0cc7be910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:24.272433 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d363b93-d0b6-4035-859c-67c0cc7be910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:24.273965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d363b93-d0b6-4035-859c-67c0cc7be910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:24.278670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d363b93-d0b6-4035-859c-67c0cc7be910 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:24.324064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 869/1735] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:24.327145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136c668-0ca6-4956-b7fc-57a0f6b69f22 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:24.339179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136c668-0ca6-4956-b7fc-57a0f6b69f22 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:24.358505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a50c8-48f5-4720-941e-db2d08830225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:24.360251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a50c8-48f5-4720-941e-db2d08830225 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:24.361410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a50c8-48f5-4720-941e-db2d08830225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:24.361885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a50c8-48f5-4720-941e-db2d08830225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:24.363728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a50c8-48f5-4720-941e-db2d08830225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:24.369599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a50c8-48f5-4720-941e-db2d08830225 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:24.415827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 867/1736] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:24.422402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d363b93-d0b6-4035-859c-67c0cc7be910 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:24.443922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d363b93-d0b6-4035-859c-67c0cc7be910 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:24.452075 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083260-617c-46f5-86d0-c9484113a9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:24.453246 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083260-617c-46f5-86d0-c9484113a9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:24.453789 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083260-617c-46f5-86d0-c9484113a9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:24.454381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083260-617c-46f5-86d0-c9484113a9e9 admin admin] PATH_INFO: `/v3/projects/2b0bf847ede046fe9c5891c5b3dd7150/users/b72bd37bbea24ef19ec1c0a7d60a88a7/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:24.505883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083260-617c-46f5-86d0-c9484113a9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0bf847ede046fe9c5891c5b3dd7150, user_id=b72bd37bbea24ef19ec1c0a7d60a88a7, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:24.508848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083260-617c-46f5-86d0-c9484113a9e9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:24.575923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 870/1737] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:53:24 2022] PUT /identity/v3/projects/2b0bf847ede046fe9c5891c5b3dd7150/users/b72bd37bbea24ef19ec1c0a7d60a88a7/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:24.586672 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1ef8f-ab57-4705-b3ea-095adc42f0fb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:24.586947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1ef8f-ab57-4705-b3ea-095adc42f0fb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:24.587263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1ef8f-ab57-4705-b3ea-095adc42f0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:24.635617 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-77e1ef8f-ab57-4705-b3ea-095adc42f0fb None None] MFA Rules not processed for user `b72bd37bbea24ef19ec1c0a7d60a88a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:24.637336 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-77e1ef8f-ab57-4705-b3ea-095adc42f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:24.741625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 868/1738] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:24.763850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083260-617c-46f5-86d0-c9484113a9e9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:24.765619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-36083260-617c-46f5-86d0-c9484113a9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:24.952873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083260-617c-46f5-86d0-c9484113a9e9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:24.958196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad750b6b-95b4-449f-a3be-6472133c050d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:24.960439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad750b6b-95b4-449f-a3be-6472133c050d service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:24.960924 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad750b6b-95b4-449f-a3be-6472133c050d service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:24.961403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad750b6b-95b4-449f-a3be-6472133c050d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:24.979857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad750b6b-95b4-449f-a3be-6472133c050d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:24.985846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad750b6b-95b4-449f-a3be-6472133c050d service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:25.003873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 871/1739] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:25.513856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e71688-379e-41de-af97-8fc5e652f831 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:25.514571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e71688-379e-41de-af97-8fc5e652f831 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:25.515093 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e71688-379e-41de-af97-8fc5e652f831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:25.571644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-09e71688-379e-41de-af97-8fc5e652f831 None None] MFA Rules not processed for user `46b90940e030470d8ab21cb82011b920`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:25.574126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-09e71688-379e-41de-af97-8fc5e652f831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:25.718640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 869/1740] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:26.409797 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deead14-be5f-4182-b20c-d0389f7826d9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:26.410288 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deead14-be5f-4182-b20c-d0389f7826d9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:26.410400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deead14-be5f-4182-b20c-d0389f7826d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:26.517651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9deead14-be5f-4182-b20c-d0389f7826d9 None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:26.520199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9deead14-be5f-4182-b20c-d0389f7826d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:26.676128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 872/1741] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 00:53:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:26.939352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e71688-379e-41de-af97-8fc5e652f831 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:26.940817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-09e71688-379e-41de-af97-8fc5e652f831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:26.951366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:27.112740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deead14-be5f-4182-b20c-d0389f7826d9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:27.115152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9deead14-be5f-4182-b20c-d0389f7826d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:27.120967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:27.147294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e71688-379e-41de-af97-8fc5e652f831 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:27.155744 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96be2df-fe8c-44bd-be7d-d9206c1257af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:27.156536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96be2df-fe8c-44bd-be7d-d9206c1257af service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:27.156854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96be2df-fe8c-44bd-be7d-d9206c1257af service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:27.157120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96be2df-fe8c-44bd-be7d-d9206c1257af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:27.168450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96be2df-fe8c-44bd-be7d-d9206c1257af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:27.171375 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96be2df-fe8c-44bd-be7d-d9206c1257af service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:27.195057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 870/1742] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 00:53:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 00:53:27.250135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deead14-be5f-4182-b20c-d0389f7826d9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:27.264815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:27.265901 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:27.266368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:27.266843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] PATH_INFO: `/v3/users/893cfa69cc0f44d89060e7549dac379f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:27.268123 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=893cfa69cc0f44d89060e7549dac379f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:27.270284 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:27.351172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893cfa69cc0f44d89060e7549dac379f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:27.352090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893cfa69cc0f44d89060e7549dac379f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:27.384384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893cfa69cc0f44d89060e7549dac379f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:27.402414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893cfa69cc0f44d89060e7549dac379f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:27.432997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893cfa69cc0f44d89060e7549dac379f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:27.451521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 873/1743] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:53:27 2022] DELETE /identity/v3/users/893cfa69cc0f44d89060e7549dac379f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:27.452812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe090e5-a6c0-47c3-879d-08c6375c27d2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:27.453366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe090e5-a6c0-47c3-879d-08c6375c27d2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:27.453747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe090e5-a6c0-47c3-879d-08c6375c27d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:27.525087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cfe090e5-a6c0-47c3-879d-08c6375c27d2 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:27.530910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cfe090e5-a6c0-47c3-879d-08c6375c27d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:27.761808 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 871/1744] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:27.782352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:27.784053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:27.934740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2310bf-6855-4889-80be-4c6dc05c09e8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:27.947018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd216d-2db1-47a9-a452-51a4b88014b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:27.948872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd216d-2db1-47a9-a452-51a4b88014b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:27.951267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd216d-2db1-47a9-a452-51a4b88014b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:27.951652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd216d-2db1-47a9-a452-51a4b88014b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:27.984901 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd216d-2db1-47a9-a452-51a4b88014b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:27.992791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd216d-2db1-47a9-a452-51a4b88014b8 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:28.038907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 874/1745] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:30.049747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe090e5-a6c0-47c3-879d-08c6375c27d2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:30.052590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cfe090e5-a6c0-47c3-879d-08c6375c27d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:30.081863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe090e5-a6c0-47c3-879d-08c6375c27d2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:30.109001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:30.110040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:30.112028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:30.112028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] PATH_INFO: `/v3/projects/c5bef3c20e7b47f18b0174b748c63902` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:30.118296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5bef3c20e7b47f18b0174b748c63902)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:30.120514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:30.266792 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5bef3c20e7b47f18b0174b748c63902', 'request_id': 'req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:30.281320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5bef3c20e7b47f18b0174b748c63902', 'request_id': 'req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:30.293740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5bef3c20e7b47f18b0174b748c63902', 'request_id': 'req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:30.325295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:30.347644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] The token cache is being invalidate because project c5bef3c20e7b47f18b0174b748c63902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:53:30.351196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:30.395676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:30.409185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 872/1746] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:53:30 2022] DELETE /identity/v3/projects/c5bef3c20e7b47f18b0174b748c63902 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:30.414813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd216d-2db1-47a9-a452-51a4b88014b8 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:30.434410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd216d-2db1-47a9-a452-51a4b88014b8 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:30.570867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:30.765596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21371d-1047-474d-a45a-d15ac874d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:30.766296 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21371d-1047-474d-a45a-d15ac874d14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:30.766580 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21371d-1047-474d-a45a-d15ac874d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:30.766953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21371d-1047-474d-a45a-d15ac874d14f admin admin] PATH_INFO: `/v3/users/8e6aed3a4e0846b487fff24e6058d3cc` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:30.774236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21371d-1047-474d-a45a-d15ac874d14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6aed3a4e0846b487fff24e6058d3cc)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:30.776716 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21371d-1047-474d-a45a-d15ac874d14f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:30.906467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ea21371d-1047-474d-a45a-d15ac874d14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6aed3a4e0846b487fff24e6058d3cc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:30.908517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ea21371d-1047-474d-a45a-d15ac874d14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6aed3a4e0846b487fff24e6058d3cc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:30.929891 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ea21371d-1047-474d-a45a-d15ac874d14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6aed3a4e0846b487fff24e6058d3cc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:30.942274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ea21371d-1047-474d-a45a-d15ac874d14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6aed3a4e0846b487fff24e6058d3cc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:30.980442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ea21371d-1047-474d-a45a-d15ac874d14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6aed3a4e0846b487fff24e6058d3cc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:30.997801 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 875/1747] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:53:30 2022] DELETE /identity/v3/users/8e6aed3a4e0846b487fff24e6058d3cc => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:32.778327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:32.780885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:32.811143 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20fcc4-e836-40b8-b855-4e2e8a5ba955 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:32.991992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33e509-b89e-4e60-b540-2da18d4a90a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:32.993191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33e509-b89e-4e60-b540-2da18d4a90a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:32.993633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33e509-b89e-4e60-b540-2da18d4a90a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:32.994058 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33e509-b89e-4e60-b540-2da18d4a90a0 admin admin] PATH_INFO: `/v3/projects/b643880d3bfa46e79cf89191db7162d2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:32.995712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33e509-b89e-4e60-b540-2da18d4a90a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b643880d3bfa46e79cf89191db7162d2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:32.997861 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33e509-b89e-4e60-b540-2da18d4a90a0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:33.153300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6a33e509-b89e-4e60-b540-2da18d4a90a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b643880d3bfa46e79cf89191db7162d2', 'request_id': 'req-6a33e509-b89e-4e60-b540-2da18d4a90a0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:33.180822 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6a33e509-b89e-4e60-b540-2da18d4a90a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b643880d3bfa46e79cf89191db7162d2', 'request_id': 'req-6a33e509-b89e-4e60-b540-2da18d4a90a0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:33.199232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6a33e509-b89e-4e60-b540-2da18d4a90a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b643880d3bfa46e79cf89191db7162d2', 'request_id': 'req-6a33e509-b89e-4e60-b540-2da18d4a90a0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:33.224553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6a33e509-b89e-4e60-b540-2da18d4a90a0 admin admin] The token cache is being invalidate because project b643880d3bfa46e79cf89191db7162d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:53:33.224877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6a33e509-b89e-4e60-b540-2da18d4a90a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:33.226488 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6a33e509-b89e-4e60-b540-2da18d4a90a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:33.233236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 873/1748] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:53:32 2022] DELETE /identity/v3/projects/b643880d3bfa46e79cf89191db7162d2 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:33.234834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee83a43-3b99-4acd-9ae6-2dd4a53bb597 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:33.235315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee83a43-3b99-4acd-9ae6-2dd4a53bb597 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:33.235395 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee83a43-3b99-4acd-9ae6-2dd4a53bb597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:33.287841 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4ee83a43-3b99-4acd-9ae6-2dd4a53bb597 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:33.289295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4ee83a43-3b99-4acd-9ae6-2dd4a53bb597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:33.432028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777a2c8-4b77-42be-b099-571b8a067a4d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:33.432480 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777a2c8-4b77-42be-b099-571b8a067a4d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:33.432567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777a2c8-4b77-42be-b099-571b8a067a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:33.446918 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 876/1749] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:53:33.470496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c777a2c8-4b77-42be-b099-571b8a067a4d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:33.476735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c777a2c8-4b77-42be-b099-571b8a067a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:33.501393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 874/1750] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:33.502558 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee83a43-3b99-4acd-9ae6-2dd4a53bb597 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:33.513958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee83a43-3b99-4acd-9ae6-2dd4a53bb597 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:33.529345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd60aa-ab8f-4c05-af2d-d702bd929ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:33.530036 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd60aa-ab8f-4c05-af2d-d702bd929ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:33.530360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd60aa-ab8f-4c05-af2d-d702bd929ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:33.530635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd60aa-ab8f-4c05-af2d-d702bd929ba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:33.535446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd60aa-ab8f-4c05-af2d-d702bd929ba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:53:33.535789 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd60aa-ab8f-4c05-af2d-d702bd929ba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:33.550252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd60aa-ab8f-4c05-af2d-d702bd929ba1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:33.595505 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 877/1751] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:53:33.600623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777a2c8-4b77-42be-b099-571b8a067a4d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:33.614240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777a2c8-4b77-42be-b099-571b8a067a4d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:33.640014 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a38e0-23c4-488a-b028-872f3df5677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:33.640735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a38e0-23c4-488a-b028-872f3df5677e admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:33.641039 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a38e0-23c4-488a-b028-872f3df5677e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:33.641310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a38e0-23c4-488a-b028-872f3df5677e admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:33.642003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a38e0-23c4-488a-b028-872f3df5677e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:33.652113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a38e0-23c4-488a-b028-872f3df5677e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:33.735633 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd60aa-ab8f-4c05-af2d-d702bd929ba1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:33.738892 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 875/1752] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:53:33 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:33.754318 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd60aa-ab8f-4c05-af2d-d702bd929ba1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:33.835800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:33.956521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7b895-7073-4e87-a4f0-be6ca422eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:33.959187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7b895-7073-4e87-a4f0-be6ca422eba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:33.959842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7b895-7073-4e87-a4f0-be6ca422eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:33.962356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7b895-7073-4e87-a4f0-be6ca422eba2 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:33.963269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7b895-7073-4e87-a4f0-be6ca422eba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:33.965779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7b895-7073-4e87-a4f0-be6ca422eba2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:34.034955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 878/1753] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:53:33 2022] POST /identity/v3/users => generated 288 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:34.041342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a38e0-23c4-488a-b028-872f3df5677e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:34.059236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a38e0-23c4-488a-b028-872f3df5677e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:34.077783 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d856b8e-e0cc-4782-be7f-83ac1a424e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:34.078420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d856b8e-e0cc-4782-be7f-83ac1a424e12 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:34.078699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d856b8e-e0cc-4782-be7f-83ac1a424e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:34.078987 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d856b8e-e0cc-4782-be7f-83ac1a424e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:34.087964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d856b8e-e0cc-4782-be7f-83ac1a424e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:34.090334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d856b8e-e0cc-4782-be7f-83ac1a424e12 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:34.119717 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 876/1754] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:34.125350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7b895-7073-4e87-a4f0-be6ca422eba2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:34.151604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7b895-7073-4e87-a4f0-be6ca422eba2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:34.184487 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60281b7f-2db1-46bf-86d1-81730e81b44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:34.185874 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60281b7f-2db1-46bf-86d1-81730e81b44a admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:34.186690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60281b7f-2db1-46bf-86d1-81730e81b44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:34.187216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60281b7f-2db1-46bf-86d1-81730e81b44a admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:34.188153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60281b7f-2db1-46bf-86d1-81730e81b44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:34.190011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60281b7f-2db1-46bf-86d1-81730e81b44a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:34.243387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 879/1755] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:34.247556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d856b8e-e0cc-4782-be7f-83ac1a424e12 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:34.267498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d856b8e-e0cc-4782-be7f-83ac1a424e12 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:34.283089 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3171a-2c0d-49d6-99c9-2fd94f5c6528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:34.284562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3171a-2c0d-49d6-99c9-2fd94f5c6528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:34.285015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3171a-2c0d-49d6-99c9-2fd94f5c6528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:34.285461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3171a-2c0d-49d6-99c9-2fd94f5c6528 admin admin] PATH_INFO: `/v3/projects/47660191b9d7481c8e0632e918f34f41/users/3439217535e24f87940c16cfb71243db/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:34.340272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3171a-2c0d-49d6-99c9-2fd94f5c6528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47660191b9d7481c8e0632e918f34f41, user_id=3439217535e24f87940c16cfb71243db, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:34.345546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3171a-2c0d-49d6-99c9-2fd94f5c6528 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:34.447127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 877/1756] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:53:34 2022] PUT /identity/v3/projects/47660191b9d7481c8e0632e918f34f41/users/3439217535e24f87940c16cfb71243db/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:34.461677 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53338e5f-f1c1-425a-ac3a-6086b5350ac7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:34.463044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53338e5f-f1c1-425a-ac3a-6086b5350ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:34.463824 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53338e5f-f1c1-425a-ac3a-6086b5350ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:34.555269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-53338e5f-f1c1-425a-ac3a-6086b5350ac7 None None] MFA Rules not processed for user `3439217535e24f87940c16cfb71243db`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:34.559506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-53338e5f-f1c1-425a-ac3a-6086b5350ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:34.768522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 880/1757] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:34.773230 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3171a-2c0d-49d6-99c9-2fd94f5c6528 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:34.831070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:34.856805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53338e5f-f1c1-425a-ac3a-6086b5350ac7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:34.859942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-53338e5f-f1c1-425a-ac3a-6086b5350ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:34.921142 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3171a-2c0d-49d6-99c9-2fd94f5c6528 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:34.936644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac8015-1be4-4f92-a4cf-ce2322faef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:34.937264 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac8015-1be4-4f92-a4cf-ce2322faef58 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:34.937949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac8015-1be4-4f92-a4cf-ce2322faef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:34.938288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac8015-1be4-4f92-a4cf-ce2322faef58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:34.939251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac8015-1be4-4f92-a4cf-ce2322faef58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:34.941779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac8015-1be4-4f92-a4cf-ce2322faef58 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:35.007033 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 878/1758] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:53:34 2022] POST /identity/v3/projects => generated 375 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:35.007033 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116900e4-abf3-4505-902c-6d21143e86e9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:35.007033 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116900e4-abf3-4505-902c-6d21143e86e9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:35.007033 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116900e4-abf3-4505-902c-6d21143e86e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:35.034550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53338e5f-f1c1-425a-ac3a-6086b5350ac7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:35.051736 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-116900e4-abf3-4505-902c-6d21143e86e9 None None] MFA Rules not processed for user `c45d8e2b0b674e9a814167db4d78749e`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:35.053899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-116900e4-abf3-4505-902c-6d21143e86e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:35.165674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 879/1759] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Sep 11 00:53:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:35.166516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116900e4-abf3-4505-902c-6d21143e86e9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:35.187776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:35.235958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:35.236589 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:35.236874 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:35.237146 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] PATH_INFO: `/v3/users/dca09ee28fc34023b42ef301b73df77b` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:35.242763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca09ee28fc34023b42ef301b73df77b)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:35.247713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:35.365100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116900e4-abf3-4505-902c-6d21143e86e9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:35.382894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ab887-166a-48b1-a3d1-25bf87acc1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:35.383560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ab887-166a-48b1-a3d1-25bf87acc1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:35.383829 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ab887-166a-48b1-a3d1-25bf87acc1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:35.384291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ab887-166a-48b1-a3d1-25bf87acc1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:35.385090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ab887-166a-48b1-a3d1-25bf87acc1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:35.388673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca09ee28fc34023b42ef301b73df77b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:35.389382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca09ee28fc34023b42ef301b73df77b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:35.413444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ab887-166a-48b1-a3d1-25bf87acc1a6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:35.427813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca09ee28fc34023b42ef301b73df77b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:35.465434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca09ee28fc34023b42ef301b73df77b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:35.487963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 880/1760] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:53:35 2022] POST /identity/v3/users => generated 294 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:35.488950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ab887-166a-48b1-a3d1-25bf87acc1a6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:35.496111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1f4ab887-166a-48b1-a3d1-25bf87acc1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:35.526390 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca09ee28fc34023b42ef301b73df77b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:35.544382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ab887-166a-48b1-a3d1-25bf87acc1a6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:35.558130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445230b-3990-429f-97e5-9fbe74b1f555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:35.558680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445230b-3990-429f-97e5-9fbe74b1f555 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:35.558982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445230b-3990-429f-97e5-9fbe74b1f555 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:35.559351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 881/1761] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:53:34 2022] DELETE /identity/v3/users/dca09ee28fc34023b42ef301b73df77b => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:35.560348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:35.565924 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:35.566445 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445230b-3990-429f-97e5-9fbe74b1f555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:35.574627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b445230b-3990-429f-97e5-9fbe74b1f555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:35.609746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445230b-3990-429f-97e5-9fbe74b1f555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:35.615634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445230b-3990-429f-97e5-9fbe74b1f555 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:35.656051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 881/1762] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:35.660673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea2724-08bb-4dc5-b079-15cb2d58e341 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:35.660958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea2724-08bb-4dc5-b079-15cb2d58e341 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:35.661279 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea2724-08bb-4dc5-b079-15cb2d58e341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:35.741723 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-06ea2724-08bb-4dc5-b079-15cb2d58e341 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:35.750173 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-06ea2724-08bb-4dc5-b079-15cb2d58e341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:35.787696 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449cee1-3ce0-4a73-92c9-f853269b6b19 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:35.802420 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ddb8a-7404-40c2-866c-bce3d7792943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:35.803149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ddb8a-7404-40c2-866c-bce3d7792943 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:35.803434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ddb8a-7404-40c2-866c-bce3d7792943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:35.803734 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ddb8a-7404-40c2-866c-bce3d7792943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:35.804376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ddb8a-7404-40c2-866c-bce3d7792943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:35.805998 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ddb8a-7404-40c2-866c-bce3d7792943 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:35.835465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 882/1763] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:35.836376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ddb8a-7404-40c2-866c-bce3d7792943 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:35.888878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:36.015555 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ddb8a-7404-40c2-866c-bce3d7792943 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:36.017950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 882/1764] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:36.026596 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea2724-08bb-4dc5-b079-15cb2d58e341 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:36.033460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9980999-ba07-4092-bdfd-93fec9a33254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:36.033984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9980999-ba07-4092-bdfd-93fec9a33254 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:36.034269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9980999-ba07-4092-bdfd-93fec9a33254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:36.034544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9980999-ba07-4092-bdfd-93fec9a33254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:36.059658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea2724-08bb-4dc5-b079-15cb2d58e341 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:36.060806 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9980999-ba07-4092-bdfd-93fec9a33254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:36.065058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9980999-ba07-4092-bdfd-93fec9a33254 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:36.074963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68df542-28e0-405e-bc70-9f5f24f9270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:36.075958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68df542-28e0-405e-bc70-9f5f24f9270d admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:36.076255 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68df542-28e0-405e-bc70-9f5f24f9270d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:36.076825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68df542-28e0-405e-bc70-9f5f24f9270d admin admin] PATH_INFO: `/v3/projects/b27466fa761d4b6f828b191c1acc6217/users/b57e267f00e8464688721b2d2bfbca47/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:36.079289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 883/1765] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:36.104130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68df542-28e0-405e-bc70-9f5f24f9270d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27466fa761d4b6f828b191c1acc6217, user_id=b57e267f00e8464688721b2d2bfbca47, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:36.110068 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68df542-28e0-405e-bc70-9f5f24f9270d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:36.155946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 883/1766] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:53:36 2022] PUT /identity/v3/projects/b27466fa761d4b6f828b191c1acc6217/users/b57e267f00e8464688721b2d2bfbca47/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:36.160240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9980999-ba07-4092-bdfd-93fec9a33254 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:36.171495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:36.182016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68df542-28e0-405e-bc70-9f5f24f9270d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:36.191581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9980999-ba07-4092-bdfd-93fec9a33254 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:36.337761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb9517-71d1-4300-9200-b9dc323e6ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:36.338714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9517-71d1-4300-9200-b9dc323e6ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:36.338970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9517-71d1-4300-9200-b9dc323e6ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:36.339387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9517-71d1-4300-9200-b9dc323e6ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:36.340346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb9517-71d1-4300-9200-b9dc323e6ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:36.346130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb9517-71d1-4300-9200-b9dc323e6ca2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:36.403993 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 884/1767] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:36.410946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68df542-28e0-405e-bc70-9f5f24f9270d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:36.413475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb9517-71d1-4300-9200-b9dc323e6ca2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:36.428321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847521a6-f0c7-47e1-ace1-1d8f5edd8038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:36.428963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847521a6-f0c7-47e1-ace1-1d8f5edd8038 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:36.432371 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847521a6-f0c7-47e1-ace1-1d8f5edd8038 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:36.432732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847521a6-f0c7-47e1-ace1-1d8f5edd8038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:36.442550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb9517-71d1-4300-9200-b9dc323e6ca2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:36.451126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266d3e9-547c-41ac-a360-98e36fa2e62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:36.452284 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266d3e9-547c-41ac-a360-98e36fa2e62a admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:36.453302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266d3e9-547c-41ac-a360-98e36fa2e62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:36.453801 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266d3e9-547c-41ac-a360-98e36fa2e62a admin admin] PATH_INFO: `/v3/projects/b27466fa761d4b6f828b191c1acc6217/users/b57e267f00e8464688721b2d2bfbca47/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:36.457720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266d3e9-547c-41ac-a360-98e36fa2e62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27466fa761d4b6f828b191c1acc6217, user_id=b57e267f00e8464688721b2d2bfbca47, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:36.467003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266d3e9-547c-41ac-a360-98e36fa2e62a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:36.471761 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847521a6-f0c7-47e1-ace1-1d8f5edd8038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:36.474421 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847521a6-f0c7-47e1-ace1-1d8f5edd8038 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:36.508365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 884/1768] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:36.508581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 885/1769] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:53:36 2022] PUT /identity/v3/projects/b27466fa761d4b6f828b191c1acc6217/users/b57e267f00e8464688721b2d2bfbca47/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:36.520307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ef6dc-3beb-4d02-ab77-85432de29882 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:36.520685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ef6dc-3beb-4d02-ab77-85432de29882 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:36.521048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ef6dc-3beb-4d02-ab77-85432de29882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:36.589869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-978ef6dc-3beb-4d02-ab77-85432de29882 None None] MFA Rules not processed for user `b57e267f00e8464688721b2d2bfbca47`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:36.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-978ef6dc-3beb-4d02-ab77-85432de29882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:36.803333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 885/1770] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:36.888859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266d3e9-547c-41ac-a360-98e36fa2e62a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:36.890631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6266d3e9-547c-41ac-a360-98e36fa2e62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:37.089885 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266d3e9-547c-41ac-a360-98e36fa2e62a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:37.094456 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba41373-1025-45ca-a66b-266e4cbc285f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:37.095257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba41373-1025-45ca-a66b-266e4cbc285f service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:37.095546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba41373-1025-45ca-a66b-266e4cbc285f service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:37.095834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba41373-1025-45ca-a66b-266e4cbc285f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:37.125579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba41373-1025-45ca-a66b-266e4cbc285f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:37.127045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba41373-1025-45ca-a66b-266e4cbc285f service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:37.159679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 886/1771] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:38.728520 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ef6dc-3beb-4d02-ab77-85432de29882 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:38.731239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-978ef6dc-3beb-4d02-ab77-85432de29882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:38.852287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:38.890035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ef6dc-3beb-4d02-ab77-85432de29882 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:38.897680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6814cb-48d4-449e-8760-993e60c621fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:38.898860 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6814cb-48d4-449e-8760-993e60c621fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:38.899333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6814cb-48d4-449e-8760-993e60c621fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:38.899746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6814cb-48d4-449e-8760-993e60c621fb admin admin] PATH_INFO: `/v3/projects/493c1eaaa9534d84be2bae9244436185` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:38.901130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6814cb-48d4-449e-8760-993e60c621fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=493c1eaaa9534d84be2bae9244436185)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:38.903562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6814cb-48d4-449e-8760-993e60c621fb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:38.974756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb6814cb-48d4-449e-8760-993e60c621fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493c1eaaa9534d84be2bae9244436185', 'request_id': 'req-fb6814cb-48d4-449e-8760-993e60c621fb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:38.986419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb6814cb-48d4-449e-8760-993e60c621fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493c1eaaa9534d84be2bae9244436185', 'request_id': 'req-fb6814cb-48d4-449e-8760-993e60c621fb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:38.999957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb6814cb-48d4-449e-8760-993e60c621fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493c1eaaa9534d84be2bae9244436185', 'request_id': 'req-fb6814cb-48d4-449e-8760-993e60c621fb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:39.074656 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb6814cb-48d4-449e-8760-993e60c621fb admin admin] The token cache is being invalidate because project 493c1eaaa9534d84be2bae9244436185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:53:39.075600 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb6814cb-48d4-449e-8760-993e60c621fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:39.077603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb6814cb-48d4-449e-8760-993e60c621fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:53:39.080226 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 886/1772] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:53:38 2022] DELETE /identity/v3/projects/493c1eaaa9534d84be2bae9244436185 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:53:39.085522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b439a95-533d-4d28-ad09-f28e1bc1ab26 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:39.086478 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b439a95-533d-4d28-ad09-f28e1bc1ab26 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:39.086949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b439a95-533d-4d28-ad09-f28e1bc1ab26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:39.118453 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5b439a95-533d-4d28-ad09-f28e1bc1ab26 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:39.122670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5b439a95-533d-4d28-ad09-f28e1bc1ab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:39.210908 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 887/1773] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:39.218786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276f96b-a4df-4243-80d7-f625d5b8f4fa None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:39.219424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276f96b-a4df-4243-80d7-f625d5b8f4fa None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:39.222663 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276f96b-a4df-4243-80d7-f625d5b8f4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:39.287333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f276f96b-a4df-4243-80d7-f625d5b8f4fa None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:39.288577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f276f96b-a4df-4243-80d7-f625d5b8f4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:39.307777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 887/1774] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:39.312544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b439a95-533d-4d28-ad09-f28e1bc1ab26 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:39.328242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b439a95-533d-4d28-ad09-f28e1bc1ab26 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:39.363297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f2f5d-b319-498e-9a70-4780b5996e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:39.364780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f2f5d-b319-498e-9a70-4780b5996e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:39.367139 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f2f5d-b319-498e-9a70-4780b5996e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:39.367635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f2f5d-b319-498e-9a70-4780b5996e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:39.368962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f2f5d-b319-498e-9a70-4780b5996e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:53:39.370327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f2f5d-b319-498e-9a70-4780b5996e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:39.372221 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f2f5d-b319-498e-9a70-4780b5996e89 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:39.390877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 888/1775] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:53:39.394686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276f96b-a4df-4243-80d7-f625d5b8f4fa None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:39.407087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276f96b-a4df-4243-80d7-f625d5b8f4fa None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:39.414936 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a29a2-6a3d-4305-a6c3-8c9300a5783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:39.415947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a29a2-6a3d-4305-a6c3-8c9300a5783c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:39.416446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a29a2-6a3d-4305-a6c3-8c9300a5783c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:39.417104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a29a2-6a3d-4305-a6c3-8c9300a5783c admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:39.418092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a29a2-6a3d-4305-a6c3-8c9300a5783c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:39.421735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a29a2-6a3d-4305-a6c3-8c9300a5783c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:39.492332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 888/1776] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:53:39 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:39.496185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f2f5d-b319-498e-9a70-4780b5996e89 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:39.524345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f2f5d-b319-498e-9a70-4780b5996e89 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:39.548205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:39.650571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2524f47-5712-4c91-ab9e-fa15964d90db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:39.652620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2524f47-5712-4c91-ab9e-fa15964d90db admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:39.653042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2524f47-5712-4c91-ab9e-fa15964d90db admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:39.653660 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2524f47-5712-4c91-ab9e-fa15964d90db admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:39.654457 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2524f47-5712-4c91-ab9e-fa15964d90db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:39.656947 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2524f47-5712-4c91-ab9e-fa15964d90db admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:39.694339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 889/1777] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:53:39 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:39.699653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a29a2-6a3d-4305-a6c3-8c9300a5783c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:39.725141 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a29a2-6a3d-4305-a6c3-8c9300a5783c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:39.730995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138709a-7828-48dc-997b-a6e69498e9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:39.732675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138709a-7828-48dc-997b-a6e69498e9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:39.733815 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138709a-7828-48dc-997b-a6e69498e9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:39.734317 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138709a-7828-48dc-997b-a6e69498e9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:39.735890 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138709a-7828-48dc-997b-a6e69498e9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:39.738087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138709a-7828-48dc-997b-a6e69498e9b3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:39.757149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2524f47-5712-4c91-ab9e-fa15964d90db admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:39.758030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 889/1778] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:39.780639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2524f47-5712-4c91-ab9e-fa15964d90db admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:39.790293 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402cc89-51e9-467c-9629-420ca8b0ed23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:39.791415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402cc89-51e9-467c-9629-420ca8b0ed23 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:39.791920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402cc89-51e9-467c-9629-420ca8b0ed23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:39.792407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402cc89-51e9-467c-9629-420ca8b0ed23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:39.793489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402cc89-51e9-467c-9629-420ca8b0ed23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:39.795368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402cc89-51e9-467c-9629-420ca8b0ed23 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:39.814741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138709a-7828-48dc-997b-a6e69498e9b3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:39.822942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 890/1779] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:53:39.827788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138709a-7828-48dc-997b-a6e69498e9b3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:39.834491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071eb97-e772-47d6-8466-d67057370eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:39.835545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071eb97-e772-47d6-8466-d67057370eee admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:39.836057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071eb97-e772-47d6-8466-d67057370eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:39.836554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071eb97-e772-47d6-8466-d67057370eee admin admin] PATH_INFO: `/v3/projects/a68eb62465884c9c8aaf2baae5833f0b/users/2358b85b074146c6afc51753db8235ff/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:39.854886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071eb97-e772-47d6-8466-d67057370eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68eb62465884c9c8aaf2baae5833f0b, user_id=2358b85b074146c6afc51753db8235ff, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:39.858043 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071eb97-e772-47d6-8466-d67057370eee admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:39.898165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f870b1-8991-41bb-ad7b-ec1a96647a77 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:39.898811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f870b1-8991-41bb-ad7b-ec1a96647a77 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:39.899588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f870b1-8991-41bb-ad7b-ec1a96647a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:39.903012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 890/1780] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:53:39 2022] PUT /identity/v3/projects/a68eb62465884c9c8aaf2baae5833f0b/users/2358b85b074146c6afc51753db8235ff/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:53:39.954025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-06f870b1-8991-41bb-ad7b-ec1a96647a77 None None] MFA Rules not processed for user `2358b85b074146c6afc51753db8235ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:39.960358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-06f870b1-8991-41bb-ad7b-ec1a96647a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:39.970013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124ed42-fdd8-44c2-9a84-3fdc9a631c03 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:39.970689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124ed42-fdd8-44c2-9a84-3fdc9a631c03 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:39.971346 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124ed42-fdd8-44c2-9a84-3fdc9a631c03 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:39.974036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 891/1781] 10.222.0.33 () {54 vars in 921 bytes} [Sun Sep 11 00:53:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:40.104893 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75b83-1f8b-4f8e-932c-fd7f759c74cf None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:40.105385 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75b83-1f8b-4f8e-932c-fd7f759c74cf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:40.105678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75b83-1f8b-4f8e-932c-fd7f759c74cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:40.128038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 891/1782] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:53:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:40.138329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f4a75b83-1f8b-4f8e-932c-fd7f759c74cf None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:40.139949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f4a75b83-1f8b-4f8e-932c-fd7f759c74cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:40.257388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:40.275616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 892/1783] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 00:53:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:40.346290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f870b1-8991-41bb-ad7b-ec1a96647a77 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:40.347853 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-06f870b1-8991-41bb-ad7b-ec1a96647a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:40.371774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a75b83-1f8b-4f8e-932c-fd7f759c74cf None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:40.374099 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f4a75b83-1f8b-4f8e-932c-fd7f759c74cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:40.404294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a75b83-1f8b-4f8e-932c-fd7f759c74cf None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:40.412781 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cdcba-a41a-4af4-a17f-78ba8c84c58e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:40.414227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cdcba-a41a-4af4-a17f-78ba8c84c58e service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:40.414662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cdcba-a41a-4af4-a17f-78ba8c84c58e service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:40.415781 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cdcba-a41a-4af4-a17f-78ba8c84c58e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:40.419497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f870b1-8991-41bb-ad7b-ec1a96647a77 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:40.428961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cdcba-a41a-4af4-a17f-78ba8c84c58e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:40.431111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cdcba-a41a-4af4-a17f-78ba8c84c58e service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:40.436043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679138e-b0d5-42b6-bbc9-3980c3397ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:40.436869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679138e-b0d5-42b6-bbc9-3980c3397ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:40.437309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679138e-b0d5-42b6-bbc9-3980c3397ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:40.437743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679138e-b0d5-42b6-bbc9-3980c3397ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:40.468311 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679138e-b0d5-42b6-bbc9-3980c3397ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:40.472371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679138e-b0d5-42b6-bbc9-3980c3397ba4 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:40.475383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 893/1784] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:53:40.499468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 892/1785] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:48.541106 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2028be-4a1c-42e4-94e7-9577ce655217 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:48.542186 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2028be-4a1c-42e4-94e7-9577ce655217 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:48.542670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2028be-4a1c-42e4-94e7-9577ce655217 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:48.544643 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 894/1786] 10.222.0.33 () {54 vars in 921 bytes} [Sun Sep 11 00:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:48.611271 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bce29-7e11-4f66-a199-179fd6676428 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:48.612244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bce29-7e11-4f66-a199-179fd6676428 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:48.612775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bce29-7e11-4f66-a199-179fd6676428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:48.659389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ea8bce29-7e11-4f66-a199-179fd6676428 None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:48.663045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ea8bce29-7e11-4f66-a199-179fd6676428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:48.697019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 893/1787] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 00:53:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:48.756488 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2028be-4a1c-42e4-94e7-9577ce655217 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:48.788959 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2028be-4a1c-42e4-94e7-9577ce655217 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:48.797653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f7904-7cdb-4c3e-a726-5f4c51fdbfa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:48.798318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f7904-7cdb-4c3e-a726-5f4c51fdbfa9 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:48.798602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f7904-7cdb-4c3e-a726-5f4c51fdbfa9 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:48.798961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f7904-7cdb-4c3e-a726-5f4c51fdbfa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:48.809141 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f7904-7cdb-4c3e-a726-5f4c51fdbfa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:48.810765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f7904-7cdb-4c3e-a726-5f4c51fdbfa9 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:48.833637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 895/1788] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:58.637961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:58.828084 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=13 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:58.836371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bce29-7e11-4f66-a199-179fd6676428 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:58.840513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ea8bce29-7e11-4f66-a199-179fd6676428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:59.109641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bce29-7e11-4f66-a199-179fd6676428 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:59.123389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777fc74-299e-4b4c-af13-20edb11e309c tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57e267f00e8464688721b2d2bfbca47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b27466fa761d4b6f828b191c1acc6217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:59.127071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777fc74-299e-4b4c-af13-20edb11e309c tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:59.129078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777fc74-299e-4b4c-af13-20edb11e309c tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:59.133629 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777fc74-299e-4b4c-af13-20edb11e309c tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:59.136364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777fc74-299e-4b4c-af13-20edb11e309c tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:53:59.136848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777fc74-299e-4b4c-af13-20edb11e309c tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:59.141661 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777fc74-299e-4b4c-af13-20edb11e309c tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:59.177230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 894/1789] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:53:59.181733 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f7904-7cdb-4c3e-a726-5f4c51fdbfa9 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:59.198498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f7904-7cdb-4c3e-a726-5f4c51fdbfa9 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:59.212716 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f8d54-3bcd-44ac-8b64-a884037d8c37 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57e267f00e8464688721b2d2bfbca47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b27466fa761d4b6f828b191c1acc6217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:59.213720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f8d54-3bcd-44ac-8b64-a884037d8c37 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:59.214372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f8d54-3bcd-44ac-8b64-a884037d8c37 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:59.214916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f8d54-3bcd-44ac-8b64-a884037d8c37 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:59.215988 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f8d54-3bcd-44ac-8b64-a884037d8c37 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:59.223337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f8d54-3bcd-44ac-8b64-a884037d8c37 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:59.263543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 896/1790] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:53:59 2022] POST /identity/v3/projects => generated 348 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:53:59.263748 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777fc74-299e-4b4c-af13-20edb11e309c tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:59.275827 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777fc74-299e-4b4c-af13-20edb11e309c tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:59.357337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdc91b-00d4-454d-96d3-34cdb73a5db0 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57e267f00e8464688721b2d2bfbca47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b27466fa761d4b6f828b191c1acc6217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:59.358191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdc91b-00d4-454d-96d3-34cdb73a5db0 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:59.358481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdc91b-00d4-454d-96d3-34cdb73a5db0 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:59.358922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdc91b-00d4-454d-96d3-34cdb73a5db0 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:59.359636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdc91b-00d4-454d-96d3-34cdb73a5db0 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:53:59.359983 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdc91b-00d4-454d-96d3-34cdb73a5db0 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:59.362345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdc91b-00d4-454d-96d3-34cdb73a5db0 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:59.382039 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 895/1791] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:53:59.550428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec75a-f2c3-47a9-bae6-9a995b6e22c9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:59.550811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec75a-f2c3-47a9-bae6-9a995b6e22c9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:59.551180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec75a-f2c3-47a9-bae6-9a995b6e22c9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:59.552909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 897/1792] 10.222.0.33 () {54 vars in 921 bytes} [Sun Sep 11 00:53:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:59.581238 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f7c4b-7754-4293-b949-a2eb432435cd None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:59.581536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f7c4b-7754-4293-b949-a2eb432435cd None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:59.582064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f7c4b-7754-4293-b949-a2eb432435cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:59.626642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-652f7c4b-7754-4293-b949-a2eb432435cd None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:59.629236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-652f7c4b-7754-4293-b949-a2eb432435cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:59.761949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 896/1793] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 00:53:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:00.189986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ec75a-f2c3-47a9-bae6-9a995b6e22c9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:00.192380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b15ec75a-f2c3-47a9-bae6-9a995b6e22c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:00.235365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ec75a-f2c3-47a9-bae6-9a995b6e22c9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:00.241809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a7701-0c5a-4db9-a584-5c3f9ec4b307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:00.242604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a7701-0c5a-4db9-a584-5c3f9ec4b307 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:00.243049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a7701-0c5a-4db9-a584-5c3f9ec4b307 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:00.243450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a7701-0c5a-4db9-a584-5c3f9ec4b307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:00.264220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a7701-0c5a-4db9-a584-5c3f9ec4b307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:00.266669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a7701-0c5a-4db9-a584-5c3f9ec4b307 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:00.305239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 898/1794] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:01.471473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f7c4b-7754-4293-b949-a2eb432435cd None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:01.494924 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f7c4b-7754-4293-b949-a2eb432435cd None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:01.507988 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57e267f00e8464688721b2d2bfbca47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b27466fa761d4b6f828b191c1acc6217', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:01.509078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:01.509595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:01.510113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] PATH_INFO: `/v3/projects/3a25a3d598b7468288b8abd97e73c27f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:01.511819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3a25a3d598b7468288b8abd97e73c27f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:01.514161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:01.558030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:01.629110 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a25a3d598b7468288b8abd97e73c27f', 'request_id': 'req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:01.637419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a25a3d598b7468288b8abd97e73c27f', 'request_id': 'req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:01.667994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a25a3d598b7468288b8abd97e73c27f', 'request_id': 'req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:01.696904 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] The token cache is being invalidate because project 3a25a3d598b7468288b8abd97e73c27f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:54:01.697599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:01.698703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:01.704935 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 897/1795] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:54:01 2022] DELETE /identity/v3/projects/3a25a3d598b7468288b8abd97e73c27f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:01.719634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a7701-0c5a-4db9-a584-5c3f9ec4b307 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:01.722482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-908a7701-0c5a-4db9-a584-5c3f9ec4b307 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:01.817937 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a7701-0c5a-4db9-a584-5c3f9ec4b307 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:01.952475 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ad9b6-d11e-4c52-bc33-06c7d0df8ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:01.953162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ad9b6-d11e-4c52-bc33-06c7d0df8ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:01.953473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ad9b6-d11e-4c52-bc33-06c7d0df8ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:01.953737 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ad9b6-d11e-4c52-bc33-06c7d0df8ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:01.956229 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2c1ad9b6-d11e-4c52-bc33-06c7d0df8ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:02.075375 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ad9b6-d11e-4c52-bc33-06c7d0df8ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:02.076616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ad9b6-d11e-4c52-bc33-06c7d0df8ea9 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:02.097561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 899/1796] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:54:07.613686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:07.615662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:07.791600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba93e75-7d08-4beb-bbca-a00e2828b2a1 tempest-RoutersIpV6AdminTest-149647461 tempest-RoutersIpV6AdminTest-149647461-project-admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:07.801052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:07.802381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:07.802884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:07.803594 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] PATH_INFO: `/v3/users/7cd8caf42bf04de58c1622dcb11d2ef7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:07.805772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd8caf42bf04de58c1622dcb11d2ef7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:07.809224 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:07.906136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd8caf42bf04de58c1622dcb11d2ef7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:07.907239 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd8caf42bf04de58c1622dcb11d2ef7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:07.924665 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd8caf42bf04de58c1622dcb11d2ef7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:07.940922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd8caf42bf04de58c1622dcb11d2ef7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:07.955622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd8caf42bf04de58c1622dcb11d2ef7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:07.975465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 898/1797] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:54:07 2022] DELETE /identity/v3/users/7cd8caf42bf04de58c1622dcb11d2ef7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:07.977519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd79682-5ae2-41e9-8404-2b15220f245c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:07.978529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd79682-5ae2-41e9-8404-2b15220f245c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:07.978980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd79682-5ae2-41e9-8404-2b15220f245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:08.002626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ecd79682-5ae2-41e9-8404-2b15220f245c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:08.004452 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ecd79682-5ae2-41e9-8404-2b15220f245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:08.040214 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:08.089296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 900/1798] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:08.127775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:08.129238 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:08.158664 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:08.202296 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff960b-ef98-44b1-b03c-6c20aa1b6e68 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:08.208304 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a7681-3dde-420b-a2f2-9c298d976982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:08.209082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a7681-3dde-420b-a2f2-9c298d976982 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:08.209455 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a7681-3dde-420b-a2f2-9c298d976982 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:08.209819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a7681-3dde-420b-a2f2-9c298d976982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:08.222073 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a7681-3dde-420b-a2f2-9c298d976982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:08.224138 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a7681-3dde-420b-a2f2-9c298d976982 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:08.237835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 899/1799] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:54:08.869549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd79682-5ae2-41e9-8404-2b15220f245c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:08.870487 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ecd79682-5ae2-41e9-8404-2b15220f245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:08.883374 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd79682-5ae2-41e9-8404-2b15220f245c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:08.891427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dcd83-f449-492f-b0ad-5eae29694399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:08.894965 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dcd83-f449-492f-b0ad-5eae29694399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:08.895467 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dcd83-f449-492f-b0ad-5eae29694399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:08.896087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dcd83-f449-492f-b0ad-5eae29694399 admin admin] PATH_INFO: `/v3/projects/36b4fbd44b4843a0b760c5ecd4a1f52b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:08.899750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dcd83-f449-492f-b0ad-5eae29694399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b4fbd44b4843a0b760c5ecd4a1f52b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:08.902324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dcd83-f449-492f-b0ad-5eae29694399 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:08.912177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a7681-3dde-420b-a2f2-9c298d976982 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:08.913632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1a6a7681-3dde-420b-a2f2-9c298d976982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:08.935387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a7681-3dde-420b-a2f2-9c298d976982 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:08.947552 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7152329-cf1c-495a-aa0d-abebfbfdf672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:08.948990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7152329-cf1c-495a-aa0d-abebfbfdf672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:08.949869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7152329-cf1c-495a-aa0d-abebfbfdf672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:08.950288 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7152329-cf1c-495a-aa0d-abebfbfdf672 admin admin] PATH_INFO: `/v3/users/2358b85b074146c6afc51753db8235ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:08.953285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7152329-cf1c-495a-aa0d-abebfbfdf672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2358b85b074146c6afc51753db8235ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:08.961704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7152329-cf1c-495a-aa0d-abebfbfdf672 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:08.966254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4c3dcd83-f449-492f-b0ad-5eae29694399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b4fbd44b4843a0b760c5ecd4a1f52b', 'request_id': 'req-4c3dcd83-f449-492f-b0ad-5eae29694399'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:08.978759 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4c3dcd83-f449-492f-b0ad-5eae29694399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b4fbd44b4843a0b760c5ecd4a1f52b', 'request_id': 'req-4c3dcd83-f449-492f-b0ad-5eae29694399'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:08.991386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4c3dcd83-f449-492f-b0ad-5eae29694399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b4fbd44b4843a0b760c5ecd4a1f52b', 'request_id': 'req-4c3dcd83-f449-492f-b0ad-5eae29694399'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:09.009963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4c3dcd83-f449-492f-b0ad-5eae29694399 admin admin] The token cache is being invalidate because project 36b4fbd44b4843a0b760c5ecd4a1f52b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:54:09.010328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4c3dcd83-f449-492f-b0ad-5eae29694399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:09.012117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4c3dcd83-f449-492f-b0ad-5eae29694399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:09.019011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 901/1800] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:54:08 2022] DELETE /identity/v3/projects/36b4fbd44b4843a0b760c5ecd4a1f52b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:09.025518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e136d-1ff4-460f-b842-71980f3d86b8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:09.025810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e136d-1ff4-460f-b842-71980f3d86b8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:09.026625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e136d-1ff4-460f-b842-71980f3d86b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:09.059847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a7152329-cf1c-495a-aa0d-abebfbfdf672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2358b85b074146c6afc51753db8235ff'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:09.060545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a7152329-cf1c-495a-aa0d-abebfbfdf672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2358b85b074146c6afc51753db8235ff'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:09.070932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a7152329-cf1c-495a-aa0d-abebfbfdf672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2358b85b074146c6afc51753db8235ff'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:09.093450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a7152329-cf1c-495a-aa0d-abebfbfdf672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2358b85b074146c6afc51753db8235ff'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:09.112533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a7152329-cf1c-495a-aa0d-abebfbfdf672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2358b85b074146c6afc51753db8235ff'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:09.114758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-565e136d-1ff4-460f-b842-71980f3d86b8 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:09.118979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-565e136d-1ff4-460f-b842-71980f3d86b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:09.127905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 900/1801] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:54:08 2022] DELETE /identity/v3/users/2358b85b074146c6afc51753db8235ff => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:09.129544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299c1eb-17c1-4dd4-ac78-53479d97c1a9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:09.129830 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299c1eb-17c1-4dd4-ac78-53479d97c1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:09.130152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299c1eb-17c1-4dd4-ac78-53479d97c1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:09.156314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0299c1eb-17c1-4dd4-ac78-53479d97c1a9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:09.158606 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0299c1eb-17c1-4dd4-ac78-53479d97c1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:09.250645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 901/1802] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:09.278067 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299c1eb-17c1-4dd4-ac78-53479d97c1a9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:09.280165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0299c1eb-17c1-4dd4-ac78-53479d97c1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:09.317587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 902/1803] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:09.325140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635a54-a168-453c-8ff5-196c830052a9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:09.325636 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635a54-a168-453c-8ff5-196c830052a9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:09.326053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635a54-a168-453c-8ff5-196c830052a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:09.361741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-49635a54-a168-453c-8ff5-196c830052a9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:09.362989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-49635a54-a168-453c-8ff5-196c830052a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:09.382291 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:09.389462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 903/1804] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:54:09.390621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635a54-a168-453c-8ff5-196c830052a9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:09.410503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299c1eb-17c1-4dd4-ac78-53479d97c1a9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:09.414776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fb29b-a735-41a4-85c7-d54aed30b397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:09.415090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fb29b-a735-41a4-85c7-d54aed30b397 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:09.415345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fb29b-a735-41a4-85c7-d54aed30b397 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:09.415803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fb29b-a735-41a4-85c7-d54aed30b397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:09.421783 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635a54-a168-453c-8ff5-196c830052a9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:09.434015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfc5f9-1d1f-4b3d-9965-d10b134e35c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:09.434857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfc5f9-1d1f-4b3d-9965-d10b134e35c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:09.435420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfc5f9-1d1f-4b3d-9965-d10b134e35c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:09.436113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfc5f9-1d1f-4b3d-9965-d10b134e35c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:09.437498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfc5f9-1d1f-4b3d-9965-d10b134e35c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:54:09.437615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fb29b-a735-41a4-85c7-d54aed30b397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:09.438525 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfc5f9-1d1f-4b3d-9965-d10b134e35c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:09.439303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fb29b-a735-41a4-85c7-d54aed30b397 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:09.441563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfc5f9-1d1f-4b3d-9965-d10b134e35c9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:09.451900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 902/1805] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:54:09.476618 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 904/1806] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:54:09.478466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fb29b-a735-41a4-85c7-d54aed30b397 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:09.491900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fb29b-a735-41a4-85c7-d54aed30b397 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:09.517040 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f94e87-95c2-4fee-b365-5e25469d11f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:09.517877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f94e87-95c2-4fee-b365-5e25469d11f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:09.519183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f94e87-95c2-4fee-b365-5e25469d11f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:09.519776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f94e87-95c2-4fee-b365-5e25469d11f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:09.520606 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f94e87-95c2-4fee-b365-5e25469d11f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:09.522529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f94e87-95c2-4fee-b365-5e25469d11f8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:09.562432 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 903/1807] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:54:09 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:54:09.566467 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfc5f9-1d1f-4b3d-9965-d10b134e35c9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:09.577349 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfc5f9-1d1f-4b3d-9965-d10b134e35c9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:09.669392 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:09.725267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2ea5f-bb2b-4945-aa94-8cc9d15033dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:09.726456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2ea5f-bb2b-4945-aa94-8cc9d15033dc admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:09.727068 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2ea5f-bb2b-4945-aa94-8cc9d15033dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:09.727475 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2ea5f-bb2b-4945-aa94-8cc9d15033dc admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:09.728811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2ea5f-bb2b-4945-aa94-8cc9d15033dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:09.731504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2ea5f-bb2b-4945-aa94-8cc9d15033dc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:09.761065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 905/1808] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:54:09 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:54:09.765117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f94e87-95c2-4fee-b365-5e25469d11f8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:09.779663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f94e87-95c2-4fee-b365-5e25469d11f8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:09.785515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89761f0-cb4e-4547-ae12-a6c35e3c1ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:09.786203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89761f0-cb4e-4547-ae12-a6c35e3c1ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:09.786550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89761f0-cb4e-4547-ae12-a6c35e3c1ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:09.787485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89761f0-cb4e-4547-ae12-a6c35e3c1ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:09.788156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89761f0-cb4e-4547-ae12-a6c35e3c1ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:09.790045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89761f0-cb4e-4547-ae12-a6c35e3c1ac7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:09.806602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 904/1809] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:54:09.807767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2ea5f-bb2b-4945-aa94-8cc9d15033dc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:09.821019 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2ea5f-bb2b-4945-aa94-8cc9d15033dc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:09.827056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1298920-3366-49c2-8fcb-d5cf7e0fc1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:09.827762 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1298920-3366-49c2-8fcb-d5cf7e0fc1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:09.828147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1298920-3366-49c2-8fcb-d5cf7e0fc1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:09.828503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1298920-3366-49c2-8fcb-d5cf7e0fc1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:09.829807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1298920-3366-49c2-8fcb-d5cf7e0fc1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:09.831831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1298920-3366-49c2-8fcb-d5cf7e0fc1d3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:09.848505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 906/1810] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:54:09.850080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89761f0-cb4e-4547-ae12-a6c35e3c1ac7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:09.865968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89761f0-cb4e-4547-ae12-a6c35e3c1ac7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:09.872633 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0ebf8-ed5f-4397-865b-4b7ed0f818a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:09.875085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0ebf8-ed5f-4397-865b-4b7ed0f818a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:09.883027 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0ebf8-ed5f-4397-865b-4b7ed0f818a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:09.883634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0ebf8-ed5f-4397-865b-4b7ed0f818a0 admin admin] PATH_INFO: `/v3/projects/69e3cf0dce824ffebb77b4b258eba9a5/users/00abdeb877524c58a68c7479fcb0e751/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:09.934306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0ebf8-ed5f-4397-865b-4b7ed0f818a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e3cf0dce824ffebb77b4b258eba9a5, user_id=00abdeb877524c58a68c7479fcb0e751, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:09.939336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0ebf8-ed5f-4397-865b-4b7ed0f818a0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:09.954581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1298920-3366-49c2-8fcb-d5cf7e0fc1d3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:09.957542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f1298920-3366-49c2-8fcb-d5cf7e0fc1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:09.988430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 905/1811] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:54:09 2022] PUT /identity/v3/projects/69e3cf0dce824ffebb77b4b258eba9a5/users/00abdeb877524c58a68c7479fcb0e751/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:54:09.988669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1298920-3366-49c2-8fcb-d5cf7e0fc1d3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:09.990129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad71f3-f4a5-4b31-bef6-99a17561e9d5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:09.990417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad71f3-f4a5-4b31-bef6-99a17561e9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:09.991261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad71f3-f4a5-4b31-bef6-99a17561e9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:10.092739 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-72ad71f3-f4a5-4b31-bef6-99a17561e9d5 None None] MFA Rules not processed for user `00abdeb877524c58a68c7479fcb0e751`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:10.099239 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-72ad71f3-f4a5-4b31-bef6-99a17561e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:10.215826 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f158a-4894-4e0a-aab7-0f3822c49b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:10.224117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f158a-4894-4e0a-aab7-0f3822c49b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:10.228226 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f158a-4894-4e0a-aab7-0f3822c49b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:10.234342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f158a-4894-4e0a-aab7-0f3822c49b48 admin admin] PATH_INFO: `/v3/projects/a68eb62465884c9c8aaf2baae5833f0b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:10.239739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f158a-4894-4e0a-aab7-0f3822c49b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a68eb62465884c9c8aaf2baae5833f0b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:10.241870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f158a-4894-4e0a-aab7-0f3822c49b48 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:10.348966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 906/1812] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:10.371891 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad71f3-f4a5-4b31-bef6-99a17561e9d5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:10.374880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-72ad71f3-f4a5-4b31-bef6-99a17561e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:10.427974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6c8f158a-4894-4e0a-aab7-0f3822c49b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a68eb62465884c9c8aaf2baae5833f0b', 'request_id': 'req-6c8f158a-4894-4e0a-aab7-0f3822c49b48'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:10.452452 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6c8f158a-4894-4e0a-aab7-0f3822c49b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a68eb62465884c9c8aaf2baae5833f0b', 'request_id': 'req-6c8f158a-4894-4e0a-aab7-0f3822c49b48'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:10.464092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6c8f158a-4894-4e0a-aab7-0f3822c49b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a68eb62465884c9c8aaf2baae5833f0b', 'request_id': 'req-6c8f158a-4894-4e0a-aab7-0f3822c49b48'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:10.484105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad71f3-f4a5-4b31-bef6-99a17561e9d5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:10.490468 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6c8f158a-4894-4e0a-aab7-0f3822c49b48 admin admin] The token cache is being invalidate because project a68eb62465884c9c8aaf2baae5833f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:54:10.491053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6c8f158a-4894-4e0a-aab7-0f3822c49b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:10.491931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6c8f158a-4894-4e0a-aab7-0f3822c49b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:10.494708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 907/1813] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:54:09 2022] DELETE /identity/v3/projects/a68eb62465884c9c8aaf2baae5833f0b => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:10.500418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfe294-64c3-448e-ad59-8d3275f4daee None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:10.500980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfe294-64c3-448e-ad59-8d3275f4daee None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:10.501920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfe294-64c3-448e-ad59-8d3275f4daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:10.530258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2cbfe294-64c3-448e-ad59-8d3275f4daee None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:10.533212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2cbfe294-64c3-448e-ad59-8d3275f4daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:10.559399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:10.618620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699d7a5-ac55-4f4c-871c-faee822440e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:10.619282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d7a5-ac55-4f4c-871c-faee822440e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:10.619566 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d7a5-ac55-4f4c-871c-faee822440e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:10.621584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d7a5-ac55-4f4c-871c-faee822440e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:10.623760 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0699d7a5-ac55-4f4c-871c-faee822440e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:10.635790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:10.674831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 908/1814] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:10.683307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d6808-aecd-490d-8bce-513e3bdd0a54 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:10.683710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d6808-aecd-490d-8bce-513e3bdd0a54 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:10.684020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d6808-aecd-490d-8bce-513e3bdd0a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:10.730183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8c3d6808-aecd-490d-8bce-513e3bdd0a54 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:10.731450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8c3d6808-aecd-490d-8bce-513e3bdd0a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:10.736621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699d7a5-ac55-4f4c-871c-faee822440e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:10.740105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699d7a5-ac55-4f4c-871c-faee822440e2 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:10.753411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 909/1815] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:54:10.757982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d6808-aecd-490d-8bce-513e3bdd0a54 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:10.763123 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 907/1816] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:54:10.773169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d6808-aecd-490d-8bce-513e3bdd0a54 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:10.787314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3c119-7e7f-4a0e-86d0-40ad122223b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:10.787945 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3c119-7e7f-4a0e-86d0-40ad122223b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:10.788225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3c119-7e7f-4a0e-86d0-40ad122223b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:10.788498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3c119-7e7f-4a0e-86d0-40ad122223b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:10.789228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3c119-7e7f-4a0e-86d0-40ad122223b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:54:10.789534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3c119-7e7f-4a0e-86d0-40ad122223b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:10.791176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3c119-7e7f-4a0e-86d0-40ad122223b7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:10.818798 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 910/1817] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:54:10.824025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699d7a5-ac55-4f4c-871c-faee822440e2 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:10.864497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699d7a5-ac55-4f4c-871c-faee822440e2 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:10.880355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f9c03-8f9b-4adb-ac94-da235052dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:10.882257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f9c03-8f9b-4adb-ac94-da235052dde8 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:10.883927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f9c03-8f9b-4adb-ac94-da235052dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:10.884499 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f9c03-8f9b-4adb-ac94-da235052dde8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:10.886357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f9c03-8f9b-4adb-ac94-da235052dde8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:10.894325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f9c03-8f9b-4adb-ac94-da235052dde8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:10.966164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 908/1818] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:54:10 2022] POST /identity/v3/projects => generated 359 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:54:10.968957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3c119-7e7f-4a0e-86d0-40ad122223b7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:10.984453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3c119-7e7f-4a0e-86d0-40ad122223b7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:11.215559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16e082-4153-479f-8142-bf32c7285630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:11.216231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16e082-4153-479f-8142-bf32c7285630 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:11.219299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16e082-4153-479f-8142-bf32c7285630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:11.221541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16e082-4153-479f-8142-bf32c7285630 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:11.225178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16e082-4153-479f-8142-bf32c7285630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:11.238414 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16e082-4153-479f-8142-bf32c7285630 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:11.332223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 911/1819] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:54:10 2022] POST /identity/v3/users => generated 280 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:54:11.336370 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f9c03-8f9b-4adb-ac94-da235052dde8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:11.353614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f9c03-8f9b-4adb-ac94-da235052dde8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:11.364719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c49204-d837-4b61-bf1e-c92388670da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:11.371331 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c49204-d837-4b61-bf1e-c92388670da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:11.371614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c49204-d837-4b61-bf1e-c92388670da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:11.372057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c49204-d837-4b61-bf1e-c92388670da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:11.373372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c49204-d837-4b61-bf1e-c92388670da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:11.375217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c49204-d837-4b61-bf1e-c92388670da0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:11.413929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 909/1820] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:54:11.414339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16e082-4153-479f-8142-bf32c7285630 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:11.440939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16e082-4153-479f-8142-bf32c7285630 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:11.447581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff17772-1e3e-409f-816d-b94a9a798431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:11.450135 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff17772-1e3e-409f-816d-b94a9a798431 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:11.450615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff17772-1e3e-409f-816d-b94a9a798431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:11.451195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff17772-1e3e-409f-816d-b94a9a798431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:11.452527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff17772-1e3e-409f-816d-b94a9a798431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:11.455204 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff17772-1e3e-409f-816d-b94a9a798431 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:11.478442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 912/1821] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:54:11.482625 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c49204-d837-4b61-bf1e-c92388670da0 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:11.496152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c49204-d837-4b61-bf1e-c92388670da0 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:11.508899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441459f-faaa-4beb-bb95-28c6edf46213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:11.509851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441459f-faaa-4beb-bb95-28c6edf46213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:11.510297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441459f-faaa-4beb-bb95-28c6edf46213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:11.510976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441459f-faaa-4beb-bb95-28c6edf46213 admin admin] PATH_INFO: `/v3/projects/3b3c32a44ad74716b424e55d98c791f0/users/2ed40b6a3e0141cdbe76260d5b665df8/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:11.548039 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441459f-faaa-4beb-bb95-28c6edf46213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3c32a44ad74716b424e55d98c791f0, user_id=2ed40b6a3e0141cdbe76260d5b665df8, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:11.551817 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441459f-faaa-4beb-bb95-28c6edf46213 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:11.575697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 910/1822] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:54:11 2022] PUT /identity/v3/projects/3b3c32a44ad74716b424e55d98c791f0/users/2ed40b6a3e0141cdbe76260d5b665df8/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:11.586710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d62de-2987-46eb-bd5f-adc58ad267ba None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:11.587923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d62de-2987-46eb-bd5f-adc58ad267ba None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:11.588455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d62de-2987-46eb-bd5f-adc58ad267ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:11.623794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-775d62de-2987-46eb-bd5f-adc58ad267ba None None] MFA Rules not processed for user `2ed40b6a3e0141cdbe76260d5b665df8`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:11.625195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-775d62de-2987-46eb-bd5f-adc58ad267ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:11.706177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 913/1823] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:11.734783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441459f-faaa-4beb-bb95-28c6edf46213 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:11.740028 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7441459f-faaa-4beb-bb95-28c6edf46213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:11.823522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441459f-faaa-4beb-bb95-28c6edf46213 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:11.827350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67974f0-b27a-4577-abb2-a754ec001d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:11.828105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67974f0-b27a-4577-abb2-a754ec001d69 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:11.828469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67974f0-b27a-4577-abb2-a754ec001d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:11.828807 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67974f0-b27a-4577-abb2-a754ec001d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:11.840295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67974f0-b27a-4577-abb2-a754ec001d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:11.841594 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67974f0-b27a-4577-abb2-a754ec001d69 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:11.853468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 911/1824] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:16.714424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d62de-2987-46eb-bd5f-adc58ad267ba None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:16.715929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-775d62de-2987-46eb-bd5f-adc58ad267ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:16.792899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:16.842266 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d62de-2987-46eb-bd5f-adc58ad267ba None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:16.848698 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:16.849509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:16.849621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:16.850435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] PATH_INFO: `/v3/users/d0ad561212284a88ac19caba30f09355` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:16.851705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ad561212284a88ac19caba30f09355)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:16.855594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:16.930315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ad561212284a88ac19caba30f09355'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:16.947571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ad561212284a88ac19caba30f09355'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:16.968079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ad561212284a88ac19caba30f09355'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:16.992200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ad561212284a88ac19caba30f09355'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:16.993566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ad561212284a88ac19caba30f09355'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:17.020247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 914/1825] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:54:16 2022] DELETE /identity/v3/users/d0ad561212284a88ac19caba30f09355 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:17.024632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f0880-58b8-47eb-8a89-05ce8c6d03cc None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:17.025177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f0880-58b8-47eb-8a89-05ce8c6d03cc None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:17.025267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f0880-58b8-47eb-8a89-05ce8c6d03cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:17.064930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ee9f0880-58b8-47eb-8a89-05ce8c6d03cc None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:17.066182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ee9f0880-58b8-47eb-8a89-05ce8c6d03cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:17.110790 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:17.187161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 912/1826] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:17.207966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:17.211803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:17.331568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e358c72-6d70-4c2c-98e8-41b56e231d7c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:17.345808 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693ecab-b5bb-4fa7-bc19-36c70eb0214a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:17.346913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693ecab-b5bb-4fa7-bc19-36c70eb0214a service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:17.347398 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693ecab-b5bb-4fa7-bc19-36c70eb0214a service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:17.347882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693ecab-b5bb-4fa7-bc19-36c70eb0214a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:17.389351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693ecab-b5bb-4fa7-bc19-36c70eb0214a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:17.392953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693ecab-b5bb-4fa7-bc19-36c70eb0214a service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:17.418598 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 915/1827] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:17.878193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f0880-58b8-47eb-8a89-05ce8c6d03cc None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:17.879725 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ee9f0880-58b8-47eb-8a89-05ce8c6d03cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:17.892416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f0880-58b8-47eb-8a89-05ce8c6d03cc None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:17.897822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976c428-c714-495b-882d-8904c1a939d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:17.898582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976c428-c714-495b-882d-8904c1a939d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:17.898928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976c428-c714-495b-882d-8904c1a939d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:17.899267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976c428-c714-495b-882d-8904c1a939d8 admin admin] PATH_INFO: `/v3/projects/cd5470aa24e443768b5c26cfdb67bf00` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:17.900531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976c428-c714-495b-882d-8904c1a939d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5470aa24e443768b5c26cfdb67bf00)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:17.902855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976c428-c714-495b-882d-8904c1a939d8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:17.960365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f976c428-c714-495b-882d-8904c1a939d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5470aa24e443768b5c26cfdb67bf00', 'request_id': 'req-f976c428-c714-495b-882d-8904c1a939d8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:17.968118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f976c428-c714-495b-882d-8904c1a939d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5470aa24e443768b5c26cfdb67bf00', 'request_id': 'req-f976c428-c714-495b-882d-8904c1a939d8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:17.976851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f976c428-c714-495b-882d-8904c1a939d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5470aa24e443768b5c26cfdb67bf00', 'request_id': 'req-f976c428-c714-495b-882d-8904c1a939d8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:17.999905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f976c428-c714-495b-882d-8904c1a939d8 admin admin] The token cache is being invalidate because project cd5470aa24e443768b5c26cfdb67bf00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:54:18.000078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f976c428-c714-495b-882d-8904c1a939d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:18.000909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f976c428-c714-495b-882d-8904c1a939d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:18.002758 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 913/1828] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:54:17 2022] DELETE /identity/v3/projects/cd5470aa24e443768b5c26cfdb67bf00 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:18.007396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a462a-331e-4d08-8a26-24714e355119 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:18.007889 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a462a-331e-4d08-8a26-24714e355119 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:18.007995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a462a-331e-4d08-8a26-24714e355119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:18.030129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-311a462a-331e-4d08-8a26-24714e355119 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:18.031443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-311a462a-331e-4d08-8a26-24714e355119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:18.110582 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:18.139092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 916/1829] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:18.141300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd95b7-0698-4b08-95d1-d032704a0f0a None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:18.142486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd95b7-0698-4b08-95d1-d032704a0f0a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:18.142486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd95b7-0698-4b08-95d1-d032704a0f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:18.179731 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-41fd95b7-0698-4b08-95d1-d032704a0f0a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:18.181134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-41fd95b7-0698-4b08-95d1-d032704a0f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:18.199146 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 914/1830] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:18.203027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a462a-331e-4d08-8a26-24714e355119 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:18.212943 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a462a-331e-4d08-8a26-24714e355119 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:18.218045 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bbeb8-9983-4180-941b-2a1b4829f7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:18.218800 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bbeb8-9983-4180-941b-2a1b4829f7ff admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:18.219203 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bbeb8-9983-4180-941b-2a1b4829f7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:18.219533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bbeb8-9983-4180-941b-2a1b4829f7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:18.220332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bbeb8-9983-4180-941b-2a1b4829f7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:54:18.220623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bbeb8-9983-4180-941b-2a1b4829f7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:18.223987 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bbeb8-9983-4180-941b-2a1b4829f7ff admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:18.240527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 917/1831] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:54:18.245075 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd95b7-0698-4b08-95d1-d032704a0f0a None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:18.261201 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd95b7-0698-4b08-95d1-d032704a0f0a None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:18.271732 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd212b6-0c2c-45c1-ac1b-c5103ff6319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:18.273650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd212b6-0c2c-45c1-ac1b-c5103ff6319a admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:18.274565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd212b6-0c2c-45c1-ac1b-c5103ff6319a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:18.275087 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd212b6-0c2c-45c1-ac1b-c5103ff6319a admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:18.276208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd212b6-0c2c-45c1-ac1b-c5103ff6319a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:18.279476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd212b6-0c2c-45c1-ac1b-c5103ff6319a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:18.331494 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bbeb8-9983-4180-941b-2a1b4829f7ff admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:18.334979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 915/1832] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:54:18 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:54:18.353622 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bbeb8-9983-4180-941b-2a1b4829f7ff admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:18.449240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa5d32-a6d9-410c-9333-7dd4ce0bbef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:18.450562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa5d32-a6d9-410c-9333-7dd4ce0bbef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:18.450562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa5d32-a6d9-410c-9333-7dd4ce0bbef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:18.450790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa5d32-a6d9-410c-9333-7dd4ce0bbef6 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:18.451711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa5d32-a6d9-410c-9333-7dd4ce0bbef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:18.453833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa5d32-a6d9-410c-9333-7dd4ce0bbef6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:18.483912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 918/1833] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:54:18 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:54:18.488296 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd212b6-0c2c-45c1-ac1b-c5103ff6319a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:18.501588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd212b6-0c2c-45c1-ac1b-c5103ff6319a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:18.506659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e1238-d82f-4f8a-9b1c-39b56fa063cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:18.507349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e1238-d82f-4f8a-9b1c-39b56fa063cd admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:18.507634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e1238-d82f-4f8a-9b1c-39b56fa063cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:18.507945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e1238-d82f-4f8a-9b1c-39b56fa063cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:18.508944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e1238-d82f-4f8a-9b1c-39b56fa063cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:18.512306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e1238-d82f-4f8a-9b1c-39b56fa063cd admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:18.543641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 916/1834] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:54:18.546106 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa5d32-a6d9-410c-9333-7dd4ce0bbef6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:18.559919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa5d32-a6d9-410c-9333-7dd4ce0bbef6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:18.567309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cec41e-c8cd-45b8-89ea-b266982a2769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:18.567987 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec41e-c8cd-45b8-89ea-b266982a2769 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:18.568603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec41e-c8cd-45b8-89ea-b266982a2769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:18.568603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec41e-c8cd-45b8-89ea-b266982a2769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:18.569242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cec41e-c8cd-45b8-89ea-b266982a2769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:18.570967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cec41e-c8cd-45b8-89ea-b266982a2769 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:18.598313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e1238-d82f-4f8a-9b1c-39b56fa063cd admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:18.612563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 919/1835] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:54:18.613128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e1238-d82f-4f8a-9b1c-39b56fa063cd admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:18.621928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1225fe-31f5-40a5-8761-64221ccb4b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:18.622869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1225fe-31f5-40a5-8761-64221ccb4b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:18.623154 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1225fe-31f5-40a5-8761-64221ccb4b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:18.623428 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1225fe-31f5-40a5-8761-64221ccb4b91 admin admin] PATH_INFO: `/v3/projects/66c4ecf936d54070a2e80ad610312fe8/users/1049a0bbb35f408bae0126fe570bca98/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:18.647474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1225fe-31f5-40a5-8761-64221ccb4b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c4ecf936d54070a2e80ad610312fe8, user_id=1049a0bbb35f408bae0126fe570bca98, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:18.650896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1225fe-31f5-40a5-8761-64221ccb4b91 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:18.674862 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 917/1836] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:54:18 2022] PUT /identity/v3/projects/66c4ecf936d54070a2e80ad610312fe8/users/1049a0bbb35f408bae0126fe570bca98/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:18.685318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbfc9a-69e6-441d-b9ec-39e2063c8ee8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:18.685604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbfc9a-69e6-441d-b9ec-39e2063c8ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:18.685878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbfc9a-69e6-441d-b9ec-39e2063c8ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:18.716232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-62bbfc9a-69e6-441d-b9ec-39e2063c8ee8 None None] MFA Rules not processed for user `1049a0bbb35f408bae0126fe570bca98`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:18.717462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-62bbfc9a-69e6-441d-b9ec-39e2063c8ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:18.804543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 920/1837] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:18.818711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1225fe-31f5-40a5-8761-64221ccb4b91 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:18.821271 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fb1225fe-31f5-40a5-8761-64221ccb4b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:18.905519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:18.928721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1225fe-31f5-40a5-8761-64221ccb4b91 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:18.940229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea32ef-3072-4cdd-927a-e62ed207ed5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:18.942206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea32ef-3072-4cdd-927a-e62ed207ed5b service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:18.942496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea32ef-3072-4cdd-927a-e62ed207ed5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:18.942943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea32ef-3072-4cdd-927a-e62ed207ed5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:18.956869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea32ef-3072-4cdd-927a-e62ed207ed5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:18.959219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea32ef-3072-4cdd-927a-e62ed207ed5b service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:18.976309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 918/1838] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:28.800184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:28.965294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:36.527944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbfc9a-69e6-441d-b9ec-39e2063c8ee8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:36.529724 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-62bbfc9a-69e6-441d-b9ec-39e2063c8ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:36.631870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbfc9a-69e6-441d-b9ec-39e2063c8ee8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:36.645738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:36.645738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:36.645738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:36.645738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] PATH_INFO: `/v3/users/2ed40b6a3e0141cdbe76260d5b665df8` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:36.646051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed40b6a3e0141cdbe76260d5b665df8)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:36.649261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:36.730765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed40b6a3e0141cdbe76260d5b665df8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:36.750212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed40b6a3e0141cdbe76260d5b665df8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:36.760005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed40b6a3e0141cdbe76260d5b665df8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:36.768475 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed40b6a3e0141cdbe76260d5b665df8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:36.769278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed40b6a3e0141cdbe76260d5b665df8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:36.776731 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 921/1839] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:54:36 2022] DELETE /identity/v3/users/2ed40b6a3e0141cdbe76260d5b665df8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:36.780933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7c5f6-a8ba-4c5e-a60d-839a05fcdf73 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:36.781417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7c5f6-a8ba-4c5e-a60d-839a05fcdf73 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:36.782759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7c5f6-a8ba-4c5e-a60d-839a05fcdf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:36.807499 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-cff7c5f6-a8ba-4c5e-a60d-839a05fcdf73 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:36.809057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cff7c5f6-a8ba-4c5e-a60d-839a05fcdf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:36.881897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 919/1840] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:36.893257 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:36.894830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:36.972290 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c23f4-02e3-457c-9c78-b3d31ba5bb37 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:36.976151 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f9b00-0a9c-4b43-98da-817d955f65e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:36.976844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f9b00-0a9c-4b43-98da-817d955f65e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:36.977193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f9b00-0a9c-4b43-98da-817d955f65e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:36.977535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f9b00-0a9c-4b43-98da-817d955f65e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:36.988896 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f9b00-0a9c-4b43-98da-817d955f65e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:36.990883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f9b00-0a9c-4b43-98da-817d955f65e6 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:37.009771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 922/1841] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:37.414857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7c5f6-a8ba-4c5e-a60d-839a05fcdf73 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:37.416440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cff7c5f6-a8ba-4c5e-a60d-839a05fcdf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:37.444694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7c5f6-a8ba-4c5e-a60d-839a05fcdf73 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:37.455731 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5839aab-5019-441e-a2ba-10ac93033529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:37.456403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5839aab-5019-441e-a2ba-10ac93033529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:37.456679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5839aab-5019-441e-a2ba-10ac93033529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:37.457481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5839aab-5019-441e-a2ba-10ac93033529 admin admin] PATH_INFO: `/v3/projects/3b3c32a44ad74716b424e55d98c791f0` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:37.459275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5839aab-5019-441e-a2ba-10ac93033529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b3c32a44ad74716b424e55d98c791f0)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:37.462594 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5839aab-5019-441e-a2ba-10ac93033529 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:37.545164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e5839aab-5019-441e-a2ba-10ac93033529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b3c32a44ad74716b424e55d98c791f0', 'request_id': 'req-e5839aab-5019-441e-a2ba-10ac93033529'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:37.553317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e5839aab-5019-441e-a2ba-10ac93033529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b3c32a44ad74716b424e55d98c791f0', 'request_id': 'req-e5839aab-5019-441e-a2ba-10ac93033529'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:37.573834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e5839aab-5019-441e-a2ba-10ac93033529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b3c32a44ad74716b424e55d98c791f0', 'request_id': 'req-e5839aab-5019-441e-a2ba-10ac93033529'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:37.625774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e5839aab-5019-441e-a2ba-10ac93033529 admin admin] The token cache is being invalidate because project 3b3c32a44ad74716b424e55d98c791f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:54:37.626995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e5839aab-5019-441e-a2ba-10ac93033529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:37.627875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e5839aab-5019-441e-a2ba-10ac93033529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:37.630339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 920/1842] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:54:37 2022] DELETE /identity/v3/projects/3b3c32a44ad74716b424e55d98c791f0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:37.636745 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7e59-ed49-4a07-ab11-771992d6cde9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:37.637621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7e59-ed49-4a07-ab11-771992d6cde9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:37.638041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7e59-ed49-4a07-ab11-771992d6cde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:37.671534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7f7c7e59-ed49-4a07-ab11-771992d6cde9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:37.672801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7f7c7e59-ed49-4a07-ab11-771992d6cde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:37.708551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:37.790079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 923/1843] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:37.798014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2e1e2-f5a6-496b-a94d-b24be5f47d18 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:37.798508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2e1e2-f5a6-496b-a94d-b24be5f47d18 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:37.798601 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2e1e2-f5a6-496b-a94d-b24be5f47d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:37.856445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-57f2e1e2-f5a6-496b-a94d-b24be5f47d18 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:37.872463 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-57f2e1e2-f5a6-496b-a94d-b24be5f47d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:37.887906 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 921/1844] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:37.893042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c7e59-ed49-4a07-ab11-771992d6cde9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:37.907682 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c7e59-ed49-4a07-ab11-771992d6cde9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:37.913322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6b4d5-d715-4f00-b393-86b333700294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:37.914340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b4d5-d715-4f00-b393-86b333700294 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:37.914879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b4d5-d715-4f00-b393-86b333700294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:37.915383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b4d5-d715-4f00-b393-86b333700294 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:37.916286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6b4d5-d715-4f00-b393-86b333700294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:54:37.916786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6b4d5-d715-4f00-b393-86b333700294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:37.918830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6b4d5-d715-4f00-b393-86b333700294 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:37.935356 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 924/1845] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:54:37.939936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2e1e2-f5a6-496b-a94d-b24be5f47d18 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:37.952883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2e1e2-f5a6-496b-a94d-b24be5f47d18 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:37.958207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d26bb0-f1bf-4d75-82a1-8ce42c14a5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:37.959102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d26bb0-f1bf-4d75-82a1-8ce42c14a5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:37.959584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d26bb0-f1bf-4d75-82a1-8ce42c14a5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:37.960051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d26bb0-f1bf-4d75-82a1-8ce42c14a5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:37.961840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d26bb0-f1bf-4d75-82a1-8ce42c14a5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:37.965285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d26bb0-f1bf-4d75-82a1-8ce42c14a5a2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:37.999078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 922/1846] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:54:37 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:54:38.002908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6b4d5-d715-4f00-b393-86b333700294 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:38.021196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6b4d5-d715-4f00-b393-86b333700294 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:38.119337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64382fc4-9368-4981-ae4f-0305ae5ae39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:38.119337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64382fc4-9368-4981-ae4f-0305ae5ae39d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:38.119337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64382fc4-9368-4981-ae4f-0305ae5ae39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:38.119337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64382fc4-9368-4981-ae4f-0305ae5ae39d admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:38.119712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64382fc4-9368-4981-ae4f-0305ae5ae39d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:38.119712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64382fc4-9368-4981-ae4f-0305ae5ae39d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:38.153801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 925/1847] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:54:38 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:54:38.157775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d26bb0-f1bf-4d75-82a1-8ce42c14a5a2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:38.173685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d26bb0-f1bf-4d75-82a1-8ce42c14a5a2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:38.178871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19793e-424b-46f8-8c8a-58d2ef5f58af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:38.179819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19793e-424b-46f8-8c8a-58d2ef5f58af admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:38.180190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19793e-424b-46f8-8c8a-58d2ef5f58af admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:38.180629 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19793e-424b-46f8-8c8a-58d2ef5f58af admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:38.181900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19793e-424b-46f8-8c8a-58d2ef5f58af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:38.184324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19793e-424b-46f8-8c8a-58d2ef5f58af admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:38.197920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 923/1848] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:54:38.201582 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64382fc4-9368-4981-ae4f-0305ae5ae39d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:38.212951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64382fc4-9368-4981-ae4f-0305ae5ae39d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:38.219339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3567b3-b331-4487-8716-17edc980c59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:38.221016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3567b3-b331-4487-8716-17edc980c59c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:38.221390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3567b3-b331-4487-8716-17edc980c59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:38.221758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3567b3-b331-4487-8716-17edc980c59c admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:38.223873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3567b3-b331-4487-8716-17edc980c59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:38.227089 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3567b3-b331-4487-8716-17edc980c59c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:38.255154 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 926/1849] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:54:38.255571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19793e-424b-46f8-8c8a-58d2ef5f58af admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:38.280113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19793e-424b-46f8-8c8a-58d2ef5f58af admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:38.301036 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf3012-a462-4433-afc4-d40e9b7442c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:38.305075 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3012-a462-4433-afc4-d40e9b7442c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:38.305613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3012-a462-4433-afc4-d40e9b7442c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:38.306087 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3012-a462-4433-afc4-d40e9b7442c3 admin admin] PATH_INFO: `/v3/projects/87db26a292e749968abd80f6ca087409/users/caaed653dc884f61863b07413b22cd76/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:38.343520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf3012-a462-4433-afc4-d40e9b7442c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87db26a292e749968abd80f6ca087409, user_id=caaed653dc884f61863b07413b22cd76, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:38.346716 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf3012-a462-4433-afc4-d40e9b7442c3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:38.385169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 924/1850] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:54:38 2022] PUT /identity/v3/projects/87db26a292e749968abd80f6ca087409/users/caaed653dc884f61863b07413b22cd76/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:38.386709 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8579e0-68df-499b-a4db-568c3ef82008 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:38.387059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8579e0-68df-499b-a4db-568c3ef82008 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:38.387346 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8579e0-68df-499b-a4db-568c3ef82008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:38.439857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cb8579e0-68df-499b-a4db-568c3ef82008 None None] MFA Rules not processed for user `caaed653dc884f61863b07413b22cd76`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:38.441324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cb8579e0-68df-499b-a4db-568c3ef82008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:38.534078 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 927/1851] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:38.596147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf3012-a462-4433-afc4-d40e9b7442c3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:38.599288 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-49bf3012-a462-4433-afc4-d40e9b7442c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:38.664232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:38.728423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf3012-a462-4433-afc4-d40e9b7442c3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:38.731876 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51398c-a1b0-47db-b410-793c757b2050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:38.732517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51398c-a1b0-47db-b410-793c757b2050 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:38.733335 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51398c-a1b0-47db-b410-793c757b2050 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:38.733637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51398c-a1b0-47db-b410-793c757b2050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:38.743563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51398c-a1b0-47db-b410-793c757b2050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:38.748594 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51398c-a1b0-47db-b410-793c757b2050 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:38.763347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 925/1852] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:48.527200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:48.756651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=17 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:50.123506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8579e0-68df-499b-a4db-568c3ef82008 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:50.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cb8579e0-68df-499b-a4db-568c3ef82008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:50.250000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8579e0-68df-499b-a4db-568c3ef82008 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:50.254896 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:50.256222 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:50.256501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:50.256770 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] PATH_INFO: `/v3/users/b72bd37bbea24ef19ec1c0a7d60a88a7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:50.258175 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72bd37bbea24ef19ec1c0a7d60a88a7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:50.260379 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:50.339991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72bd37bbea24ef19ec1c0a7d60a88a7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:50.355683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72bd37bbea24ef19ec1c0a7d60a88a7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:50.379526 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72bd37bbea24ef19ec1c0a7d60a88a7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:50.391129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72bd37bbea24ef19ec1c0a7d60a88a7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:50.392192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72bd37bbea24ef19ec1c0a7d60a88a7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:50.408283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 928/1853] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:54:50 2022] DELETE /identity/v3/users/b72bd37bbea24ef19ec1c0a7d60a88a7 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:50.410668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f88b-c2d0-4938-9497-d086b4240130 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:50.411215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f88b-c2d0-4938-9497-d086b4240130 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:50.411422 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f88b-c2d0-4938-9497-d086b4240130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:50.433368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a379f88b-c2d0-4938-9497-d086b4240130 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:50.434911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a379f88b-c2d0-4938-9497-d086b4240130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:50.531870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 926/1854] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:50.592650 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:50.594478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:50.772573 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30a248-2cc2-4960-8b3a-aff31cc441fe admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:50.776802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d4c7d-c839-4f68-89df-e93d12a2404e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:50.777627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d4c7d-c839-4f68-89df-e93d12a2404e service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:50.778128 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d4c7d-c839-4f68-89df-e93d12a2404e service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:50.778764 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d4c7d-c839-4f68-89df-e93d12a2404e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:50.796528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d4c7d-c839-4f68-89df-e93d12a2404e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:50.798862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d4c7d-c839-4f68-89df-e93d12a2404e service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:50.812475 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 929/1855] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:52.066626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379f88b-c2d0-4938-9497-d086b4240130 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:52.067372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a379f88b-c2d0-4938-9497-d086b4240130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:52.089451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379f88b-c2d0-4938-9497-d086b4240130 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:52.102869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93936ea8-643a-4dd4-a417-8f9efdc774bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:52.103522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93936ea8-643a-4dd4-a417-8f9efdc774bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:52.103800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93936ea8-643a-4dd4-a417-8f9efdc774bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:52.104068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93936ea8-643a-4dd4-a417-8f9efdc774bd admin admin] PATH_INFO: `/v3/projects/2b0bf847ede046fe9c5891c5b3dd7150` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:52.105287 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93936ea8-643a-4dd4-a417-8f9efdc774bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0bf847ede046fe9c5891c5b3dd7150)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:52.107875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93936ea8-643a-4dd4-a417-8f9efdc774bd admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:52.261449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-93936ea8-643a-4dd4-a417-8f9efdc774bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0bf847ede046fe9c5891c5b3dd7150', 'request_id': 'req-93936ea8-643a-4dd4-a417-8f9efdc774bd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:52.275445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-93936ea8-643a-4dd4-a417-8f9efdc774bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0bf847ede046fe9c5891c5b3dd7150', 'request_id': 'req-93936ea8-643a-4dd4-a417-8f9efdc774bd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:52.289176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-93936ea8-643a-4dd4-a417-8f9efdc774bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0bf847ede046fe9c5891c5b3dd7150', 'request_id': 'req-93936ea8-643a-4dd4-a417-8f9efdc774bd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:52.323810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-93936ea8-643a-4dd4-a417-8f9efdc774bd admin admin] The token cache is being invalidate because project 2b0bf847ede046fe9c5891c5b3dd7150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:54:52.324708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-93936ea8-643a-4dd4-a417-8f9efdc774bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:52.325482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-93936ea8-643a-4dd4-a417-8f9efdc774bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:52.327365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 927/1856] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:54:52 2022] DELETE /identity/v3/projects/2b0bf847ede046fe9c5891c5b3dd7150 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:52.332127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f895751-46ac-417d-9cd6-c0f621c3c21b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:52.332595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f895751-46ac-417d-9cd6-c0f621c3c21b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:52.332706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f895751-46ac-417d-9cd6-c0f621c3c21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:52.356259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4f895751-46ac-417d-9cd6-c0f621c3c21b None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:52.359411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4f895751-46ac-417d-9cd6-c0f621c3c21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:52.381629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:52.474185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33524df6-1275-483b-8e0a-9a0a9cc7bcc0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:52.474692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33524df6-1275-483b-8e0a-9a0a9cc7bcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:52.474903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 930/1857] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:52.475551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33524df6-1275-483b-8e0a-9a0a9cc7bcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:52.519699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-33524df6-1275-483b-8e0a-9a0a9cc7bcc0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:52.521097 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-33524df6-1275-483b-8e0a-9a0a9cc7bcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:52.543161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 928/1858] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:54:52.543907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f895751-46ac-417d-9cd6-c0f621c3c21b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:52.557905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f895751-46ac-417d-9cd6-c0f621c3c21b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:52.563425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b455f-f162-41d1-bbe9-2ac98a644d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:52.564304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b455f-f162-41d1-bbe9-2ac98a644d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:52.564806 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b455f-f162-41d1-bbe9-2ac98a644d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:52.565384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b455f-f162-41d1-bbe9-2ac98a644d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:52.566254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b455f-f162-41d1-bbe9-2ac98a644d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:54:52.566801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b455f-f162-41d1-bbe9-2ac98a644d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:52.568598 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b455f-f162-41d1-bbe9-2ac98a644d43 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:52.600896 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 931/1859] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:54:52.605979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33524df6-1275-483b-8e0a-9a0a9cc7bcc0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:52.620715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33524df6-1275-483b-8e0a-9a0a9cc7bcc0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:52.639705 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0906a-4c95-4d21-bc64-fd3a400a3b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:52.641778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0906a-4c95-4d21-bc64-fd3a400a3b6a admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:52.642257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0906a-4c95-4d21-bc64-fd3a400a3b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:52.642761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0906a-4c95-4d21-bc64-fd3a400a3b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:52.643746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0906a-4c95-4d21-bc64-fd3a400a3b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:52.646372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0906a-4c95-4d21-bc64-fd3a400a3b6a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:52.684380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 929/1860] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:54:52 2022] POST /identity/v3/projects => generated 361 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:54:52.691652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b455f-f162-41d1-bbe9-2ac98a644d43 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:52.729049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b455f-f162-41d1-bbe9-2ac98a644d43 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:52.838476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ae3f8-1d2a-4e6d-9ee4-76f2a5048f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:52.839835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ae3f8-1d2a-4e6d-9ee4-76f2a5048f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:52.840204 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ae3f8-1d2a-4e6d-9ee4-76f2a5048f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:52.840599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ae3f8-1d2a-4e6d-9ee4-76f2a5048f66 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:52.842062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ae3f8-1d2a-4e6d-9ee4-76f2a5048f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:52.846090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ae3f8-1d2a-4e6d-9ee4-76f2a5048f66 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:52.886436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 932/1861] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:54:52 2022] POST /identity/v3/users => generated 281 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:54:52.889115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0906a-4c95-4d21-bc64-fd3a400a3b6a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:52.905374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0906a-4c95-4d21-bc64-fd3a400a3b6a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:52.922574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7f053-ee4a-4115-b763-d266f9d66703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:52.923329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7f053-ee4a-4115-b763-d266f9d66703 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:52.925445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7f053-ee4a-4115-b763-d266f9d66703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:52.925802 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7f053-ee4a-4115-b763-d266f9d66703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:52.926823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7f053-ee4a-4115-b763-d266f9d66703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:52.930306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7f053-ee4a-4115-b763-d266f9d66703 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:52.958589 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 930/1862] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:54:52.964311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ae3f8-1d2a-4e6d-9ee4-76f2a5048f66 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:52.988458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ae3f8-1d2a-4e6d-9ee4-76f2a5048f66 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:52.999144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b481fd-209b-418c-99d0-510299a029e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:53.000122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b481fd-209b-418c-99d0-510299a029e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:53.000314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b481fd-209b-418c-99d0-510299a029e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:53.000592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b481fd-209b-418c-99d0-510299a029e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:53.002837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b481fd-209b-418c-99d0-510299a029e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:53.006462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b481fd-209b-418c-99d0-510299a029e3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:53.057155 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 933/1863] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:54:53.058426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7f053-ee4a-4115-b763-d266f9d66703 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:53.084774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7f053-ee4a-4115-b763-d266f9d66703 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:53.144676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d3e90-9265-45f1-80b8-d76283263d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:53.147627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d3e90-9265-45f1-80b8-d76283263d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:53.149189 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d3e90-9265-45f1-80b8-d76283263d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:53.150217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d3e90-9265-45f1-80b8-d76283263d23 admin admin] PATH_INFO: `/v3/projects/290f7e0058d74266be61cb4464703389/users/389cbfbdb368417ca976261ec1e06914/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:53.201174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d3e90-9265-45f1-80b8-d76283263d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290f7e0058d74266be61cb4464703389, user_id=389cbfbdb368417ca976261ec1e06914, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:53.208919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d3e90-9265-45f1-80b8-d76283263d23 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:53.248145 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 931/1864] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:54:53 2022] PUT /identity/v3/projects/290f7e0058d74266be61cb4464703389/users/389cbfbdb368417ca976261ec1e06914/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:54:53.262075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f67ac-b68b-4306-b0a2-cbaddb58d7a0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:53.262206 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f67ac-b68b-4306-b0a2-cbaddb58d7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:53.262431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f67ac-b68b-4306-b0a2-cbaddb58d7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:53.326744 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d15f67ac-b68b-4306-b0a2-cbaddb58d7a0 None None] MFA Rules not processed for user `389cbfbdb368417ca976261ec1e06914`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:53.332669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d15f67ac-b68b-4306-b0a2-cbaddb58d7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:53.540574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 934/1865] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:53.631502 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d3e90-9265-45f1-80b8-d76283263d23 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:53.633551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-313d3e90-9265-45f1-80b8-d76283263d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:53.694899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:53.748532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d3e90-9265-45f1-80b8-d76283263d23 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:53.752745 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fb9c4-4854-4cdb-9f4e-13e90300c044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:53.753550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fb9c4-4854-4cdb-9f4e-13e90300c044 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:53.754392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fb9c4-4854-4cdb-9f4e-13e90300c044 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:53.755241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fb9c4-4854-4cdb-9f4e-13e90300c044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:53.768163 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fb9c4-4854-4cdb-9f4e-13e90300c044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:53.771147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fb9c4-4854-4cdb-9f4e-13e90300c044 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:53.784212 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 932/1866] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:57.837112 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f67ac-b68b-4306-b0a2-cbaddb58d7a0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:57.841012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d15f67ac-b68b-4306-b0a2-cbaddb58d7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:57.917156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:58.024221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f67ac-b68b-4306-b0a2-cbaddb58d7a0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:58.064989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d38ae3-dad0-490a-b9cb-ff406a52ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:58.067509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38ae3-dad0-490a-b9cb-ff406a52ff6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:58.068276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38ae3-dad0-490a-b9cb-ff406a52ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:58.070293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38ae3-dad0-490a-b9cb-ff406a52ff6e admin admin] PATH_INFO: `/v3/users/6aa81fbf97d3485d845d5cc04449efb0` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:58.073209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d38ae3-dad0-490a-b9cb-ff406a52ff6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aa81fbf97d3485d845d5cc04449efb0)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:58.080884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d38ae3-dad0-490a-b9cb-ff406a52ff6e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:58.197511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-26d38ae3-dad0-490a-b9cb-ff406a52ff6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aa81fbf97d3485d845d5cc04449efb0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:58.213764 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-26d38ae3-dad0-490a-b9cb-ff406a52ff6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aa81fbf97d3485d845d5cc04449efb0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:58.226329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-26d38ae3-dad0-490a-b9cb-ff406a52ff6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aa81fbf97d3485d845d5cc04449efb0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:58.240568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-26d38ae3-dad0-490a-b9cb-ff406a52ff6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aa81fbf97d3485d845d5cc04449efb0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:58.240870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-26d38ae3-dad0-490a-b9cb-ff406a52ff6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aa81fbf97d3485d845d5cc04449efb0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:58.260410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 935/1867] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:54:57 2022] DELETE /identity/v3/users/6aa81fbf97d3485d845d5cc04449efb0 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:58.529640 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fb9c4-4854-4cdb-9f4e-13e90300c044 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:58.531340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1b7fb9c4-4854-4cdb-9f4e-13e90300c044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:58.559414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fb9c4-4854-4cdb-9f4e-13e90300c044 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:58.647415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:58.649232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:58.649698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:58.650205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] PATH_INFO: `/v3/users/caaed653dc884f61863b07413b22cd76` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:58.662110 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=caaed653dc884f61863b07413b22cd76)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:58.664133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:58.724419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caaed653dc884f61863b07413b22cd76'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:58.725440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caaed653dc884f61863b07413b22cd76'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:58.734280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caaed653dc884f61863b07413b22cd76'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:58.747279 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caaed653dc884f61863b07413b22cd76'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:58.764132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caaed653dc884f61863b07413b22cd76'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:58.774050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 933/1868] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:54:58 2022] DELETE /identity/v3/users/caaed653dc884f61863b07413b22cd76 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:58.778930 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b6b66-0eb1-4070-97cb-b7213c014ba0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:58.778930 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b6b66-0eb1-4070-97cb-b7213c014ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:58.779231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b6b66-0eb1-4070-97cb-b7213c014ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:58.801692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-702b6b66-0eb1-4070-97cb-b7213c014ba0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:58.803215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-702b6b66-0eb1-4070-97cb-b7213c014ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:58.942204 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 936/1869] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:58.988428 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:58.989811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:59.076774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:59.094627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf57f6b-35be-42e7-a251-0ee78335cb4f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:59.101102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e87bc4-79ff-47db-8ef0-80ef336f20c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:59.101963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87bc4-79ff-47db-8ef0-80ef336f20c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:59.102316 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87bc4-79ff-47db-8ef0-80ef336f20c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:59.102955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87bc4-79ff-47db-8ef0-80ef336f20c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:59.114451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e87bc4-79ff-47db-8ef0-80ef336f20c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:59.116873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e87bc4-79ff-47db-8ef0-80ef336f20c9 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:59.124832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b6b66-0eb1-4070-97cb-b7213c014ba0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:59.126260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-702b6b66-0eb1-4070-97cb-b7213c014ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:59.133936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 934/1870] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:59.147730 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b6b66-0eb1-4070-97cb-b7213c014ba0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:59.154828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:59.155771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:59.156366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:59.156774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb admin admin] PATH_INFO: `/v3/projects/6baba882cba943bfb7bad82fa538248b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:59.158032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6baba882cba943bfb7bad82fa538248b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:59.163649 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:59.240240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:59.266315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6baba882cba943bfb7bad82fa538248b', 'request_id': 'req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:59.281841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6baba882cba943bfb7bad82fa538248b', 'request_id': 'req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:59.312209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6baba882cba943bfb7bad82fa538248b', 'request_id': 'req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:59.334136 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb admin admin] The token cache is being invalidate because project 6baba882cba943bfb7bad82fa538248b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:54:59.336477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:59.337191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f4d14c95-9b1a-46e3-96cf-c040ae89b2cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:54:59.341935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 937/1871] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:54:59 2022] DELETE /identity/v3/projects/6baba882cba943bfb7bad82fa538248b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:54:59.343845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ff33d-524a-438a-aab6-84e120cb46f9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:59.344131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ff33d-524a-438a-aab6-84e120cb46f9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:59.344787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ff33d-524a-438a-aab6-84e120cb46f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:59.373926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3a9ff33d-524a-438a-aab6-84e120cb46f9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:59.375329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3a9ff33d-524a-438a-aab6-84e120cb46f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:59.482294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 935/1872] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:59.484539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64feba4-87d2-45e8-9f59-8724a8ae2a6a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:59.484830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64feba4-87d2-45e8-9f59-8724a8ae2a6a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:59.485101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64feba4-87d2-45e8-9f59-8724a8ae2a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:59.512941 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a64feba4-87d2-45e8-9f59-8724a8ae2a6a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:59.514199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a64feba4-87d2-45e8-9f59-8724a8ae2a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:59.540834 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 938/1873] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:59.546283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ff33d-524a-438a-aab6-84e120cb46f9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:59.563407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ff33d-524a-438a-aab6-84e120cb46f9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:59.586644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52798363-b9ac-4940-8f14-46a21593ac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:59.588094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52798363-b9ac-4940-8f14-46a21593ac4b admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:59.588217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52798363-b9ac-4940-8f14-46a21593ac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:59.588508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52798363-b9ac-4940-8f14-46a21593ac4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:59.592695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52798363-b9ac-4940-8f14-46a21593ac4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:54:59.593217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52798363-b9ac-4940-8f14-46a21593ac4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:59.595039 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52798363-b9ac-4940-8f14-46a21593ac4b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:59.628960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 936/1874] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:54:59.630037 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64feba4-87d2-45e8-9f59-8724a8ae2a6a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:59.645368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64feba4-87d2-45e8-9f59-8724a8ae2a6a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:59.665010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26b3d-191d-4d37-a916-b8845f0c91bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:59.665648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26b3d-191d-4d37-a916-b8845f0c91bb admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:59.665952 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26b3d-191d-4d37-a916-b8845f0c91bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:59.666187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26b3d-191d-4d37-a916-b8845f0c91bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:59.669010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f26b3d-191d-4d37-a916-b8845f0c91bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:59.669882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f26b3d-191d-4d37-a916-b8845f0c91bb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:59.709308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 939/1875] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:54:59 2022] POST /identity/v3/projects => generated 411 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:54:59.713933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52798363-b9ac-4940-8f14-46a21593ac4b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:59.733680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52798363-b9ac-4940-8f14-46a21593ac4b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:59.813765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c948a11-16dd-439a-9a2e-1a3542649931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:59.814679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c948a11-16dd-439a-9a2e-1a3542649931 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:59.815134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c948a11-16dd-439a-9a2e-1a3542649931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:59.815551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c948a11-16dd-439a-9a2e-1a3542649931 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:59.816505 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c948a11-16dd-439a-9a2e-1a3542649931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:59.820341 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c948a11-16dd-439a-9a2e-1a3542649931 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:59.872128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 937/1876] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:54:59 2022] POST /identity/v3/users => generated 306 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:54:59.876748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26b3d-191d-4d37-a916-b8845f0c91bb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:59.924522 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26b3d-191d-4d37-a916-b8845f0c91bb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:59.933419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6bc58-8c9f-4727-a12b-e200ef5d3fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:59.938273 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6bc58-8c9f-4727-a12b-e200ef5d3fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:59.940254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6bc58-8c9f-4727-a12b-e200ef5d3fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:59.940744 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6bc58-8c9f-4727-a12b-e200ef5d3fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:59.942211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6bc58-8c9f-4727-a12b-e200ef5d3fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:59.945667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6bc58-8c9f-4727-a12b-e200ef5d3fa5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:59.970969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 940/1877] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:54:59.972245 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c948a11-16dd-439a-9a2e-1a3542649931 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:59.997659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c948a11-16dd-439a-9a2e-1a3542649931 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:00.021617 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecbccd-7f4c-4c50-baec-2923995c211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:00.022216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecbccd-7f4c-4c50-baec-2923995c211a admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:00.022499 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecbccd-7f4c-4c50-baec-2923995c211a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:00.023036 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecbccd-7f4c-4c50-baec-2923995c211a admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:00.024766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecbccd-7f4c-4c50-baec-2923995c211a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:00.066192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6bc58-8c9f-4727-a12b-e200ef5d3fa5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:00.071733 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2cf6bc58-8c9f-4727-a12b-e200ef5d3fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:00.077598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecbccd-7f4c-4c50-baec-2923995c211a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:00.121151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 938/1878] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:00.122262 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6bc58-8c9f-4727-a12b-e200ef5d3fa5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:00.125205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecbccd-7f4c-4c50-baec-2923995c211a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:00.138159 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bff52b-ff67-41d4-996f-c0fae7ebbddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:00.138981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bff52b-ff67-41d4-996f-c0fae7ebbddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:00.139270 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bff52b-ff67-41d4-996f-c0fae7ebbddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:00.143013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bff52b-ff67-41d4-996f-c0fae7ebbddd admin admin] PATH_INFO: `/v3/projects/87db26a292e749968abd80f6ca087409` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:00.144614 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bff52b-ff67-41d4-996f-c0fae7ebbddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=87db26a292e749968abd80f6ca087409)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:00.146714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bff52b-ff67-41d4-996f-c0fae7ebbddd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:00.152266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecbccd-7f4c-4c50-baec-2923995c211a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:00.189737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3262261-cc49-4166-bc78-1e76a252791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:00.190576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3262261-cc49-4166-bc78-1e76a252791e admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:00.190928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3262261-cc49-4166-bc78-1e76a252791e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:00.191204 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3262261-cc49-4166-bc78-1e76a252791e admin admin] PATH_INFO: `/v3/projects/9887c7b917744bb5aafe12df87703690/users/4f4c2577d1144756a08336695aae9190/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:00.215703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3262261-cc49-4166-bc78-1e76a252791e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9887c7b917744bb5aafe12df87703690, user_id=4f4c2577d1144756a08336695aae9190, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:00.219359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3262261-cc49-4166-bc78-1e76a252791e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:00.219925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-40bff52b-ff67-41d4-996f-c0fae7ebbddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87db26a292e749968abd80f6ca087409', 'request_id': 'req-40bff52b-ff67-41d4-996f-c0fae7ebbddd'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:00.233887 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-40bff52b-ff67-41d4-996f-c0fae7ebbddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87db26a292e749968abd80f6ca087409', 'request_id': 'req-40bff52b-ff67-41d4-996f-c0fae7ebbddd'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:00.250747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 939/1879] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:00 2022] PUT /identity/v3/projects/9887c7b917744bb5aafe12df87703690/users/4f4c2577d1144756a08336695aae9190/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:00.254003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55643584-2fcf-4e37-bd48-01e7abf829f9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:00.255676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55643584-2fcf-4e37-bd48-01e7abf829f9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:00.255676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55643584-2fcf-4e37-bd48-01e7abf829f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:00.257451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-40bff52b-ff67-41d4-996f-c0fae7ebbddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87db26a292e749968abd80f6ca087409', 'request_id': 'req-40bff52b-ff67-41d4-996f-c0fae7ebbddd'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:00.288101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-40bff52b-ff67-41d4-996f-c0fae7ebbddd admin admin] The token cache is being invalidate because project 87db26a292e749968abd80f6ca087409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:00.288403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-40bff52b-ff67-41d4-996f-c0fae7ebbddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:00.290350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-40bff52b-ff67-41d4-996f-c0fae7ebbddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:00.293885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 941/1880] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:00 2022] DELETE /identity/v3/projects/87db26a292e749968abd80f6ca087409 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:00.299158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28005eb9-e17e-47ae-97f3-fcc0fa61ef04 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:00.299623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28005eb9-e17e-47ae-97f3-fcc0fa61ef04 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:00.300402 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28005eb9-e17e-47ae-97f3-fcc0fa61ef04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:00.333536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-55643584-2fcf-4e37-bd48-01e7abf829f9 None None] MFA Rules not processed for user `4f4c2577d1144756a08336695aae9190`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:00.336463 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-55643584-2fcf-4e37-bd48-01e7abf829f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:00.347577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-28005eb9-e17e-47ae-97f3-fcc0fa61ef04 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:00.350818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-28005eb9-e17e-47ae-97f3-fcc0fa61ef04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:00.365309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:00.473835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 940/1881] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:00 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:00.479006 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55643584-2fcf-4e37-bd48-01e7abf829f9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:00.482803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-55643584-2fcf-4e37-bd48-01e7abf829f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:00.487226 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 942/1882] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:00.497381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d02302-7751-43c1-b103-0313ba321ffb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:00.497851 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d02302-7751-43c1-b103-0313ba321ffb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:00.498616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d02302-7751-43c1-b103-0313ba321ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:00.521364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:00.521807 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55643584-2fcf-4e37-bd48-01e7abf829f9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:00.536619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eea66-b5a5-42d5-b5ea-bac56e47d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:00.537390 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eea66-b5a5-42d5-b5ea-bac56e47d943 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:00.537920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eea66-b5a5-42d5-b5ea-bac56e47d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:00.539128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eea66-b5a5-42d5-b5ea-bac56e47d943 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:00.539128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254eea66-b5a5-42d5-b5ea-bac56e47d943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:00.542320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254eea66-b5a5-42d5-b5ea-bac56e47d943 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:00.548511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-76d02302-7751-43c1-b103-0313ba321ffb None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:00.549903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-76d02302-7751-43c1-b103-0313ba321ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:00.583147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 943/1883] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:00.584281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d02302-7751-43c1-b103-0313ba321ffb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:00.628560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d02302-7751-43c1-b103-0313ba321ffb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:00.639262 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 941/1884] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:00 2022] POST /identity/v3/projects => generated 409 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:00.644963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eea66-b5a5-42d5-b5ea-bac56e47d943 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:00.645814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a93c9-e9f2-4252-88e5-32d7124eede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:00.646950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a93c9-e9f2-4252-88e5-32d7124eede4 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:00.647705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a93c9-e9f2-4252-88e5-32d7124eede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:00.649034 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a93c9-e9f2-4252-88e5-32d7124eede4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:00.649991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a93c9-e9f2-4252-88e5-32d7124eede4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:55:00.651005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a93c9-e9f2-4252-88e5-32d7124eede4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:00.656428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a93c9-e9f2-4252-88e5-32d7124eede4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:00.689760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 944/1885] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:55:00.693982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a93c9-e9f2-4252-88e5-32d7124eede4 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:00.719718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a93c9-e9f2-4252-88e5-32d7124eede4 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:00.811491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eea66-b5a5-42d5-b5ea-bac56e47d943 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:00.830631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26717d3-5fe0-4820-98ee-2efed2456032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:00.831415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26717d3-5fe0-4820-98ee-2efed2456032 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:00.831821 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26717d3-5fe0-4820-98ee-2efed2456032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:00.832202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26717d3-5fe0-4820-98ee-2efed2456032 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:00.832955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26717d3-5fe0-4820-98ee-2efed2456032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:00.839621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26717d3-5fe0-4820-98ee-2efed2456032 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:00.920835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 942/1886] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:00 2022] POST /identity/v3/users => generated 311 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:00.924415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26717d3-5fe0-4820-98ee-2efed2456032 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:00.927543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339fdfb-17d7-438d-8780-59be2a0f9c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:00.929237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339fdfb-17d7-438d-8780-59be2a0f9c28 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:00.929847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339fdfb-17d7-438d-8780-59be2a0f9c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:00.931130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339fdfb-17d7-438d-8780-59be2a0f9c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:00.933364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339fdfb-17d7-438d-8780-59be2a0f9c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:00.939849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339fdfb-17d7-438d-8780-59be2a0f9c28 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:00.955468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26717d3-5fe0-4820-98ee-2efed2456032 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:00.974310 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59c85b-8325-44df-ba60-299fa8c2aa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:00.975348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59c85b-8325-44df-ba60-299fa8c2aa14 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:00.975850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59c85b-8325-44df-ba60-299fa8c2aa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:00.976335 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59c85b-8325-44df-ba60-299fa8c2aa14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:00.977198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59c85b-8325-44df-ba60-299fa8c2aa14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:00.979225 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59c85b-8325-44df-ba60-299fa8c2aa14 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:01.012806 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 945/1887] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:00 2022] POST /identity/v3/projects => generated 375 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:01.014391 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339fdfb-17d7-438d-8780-59be2a0f9c28 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:01.022425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 943/1888] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:01.025525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59c85b-8325-44df-ba60-299fa8c2aa14 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:01.059415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59c85b-8325-44df-ba60-299fa8c2aa14 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:01.156472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339fdfb-17d7-438d-8780-59be2a0f9c28 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:01.172042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae560e-39f4-4299-89b1-78ec9584092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:01.172982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae560e-39f4-4299-89b1-78ec9584092c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:01.175234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae560e-39f4-4299-89b1-78ec9584092c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:01.175738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae560e-39f4-4299-89b1-78ec9584092c admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:01.180757 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae560e-39f4-4299-89b1-78ec9584092c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:01.184474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae560e-39f4-4299-89b1-78ec9584092c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:01.241455 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeebb05-7758-4854-bc68-f1bcbdb94ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:01.242318 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeebb05-7758-4854-bc68-f1bcbdb94ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:01.243932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeebb05-7758-4854-bc68-f1bcbdb94ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:01.243932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeebb05-7758-4854-bc68-f1bcbdb94ccb admin admin] PATH_INFO: `/v3/projects/c518e4944aef4b7ea61a35d416eb2bb6/users/93a9a44c4b4542519d77492aa63d1cf5/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:01.255295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 946/1889] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:01 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:01.265496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae560e-39f4-4299-89b1-78ec9584092c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:01.285499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae560e-39f4-4299-89b1-78ec9584092c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:01.291656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeebb05-7758-4854-bc68-f1bcbdb94ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c518e4944aef4b7ea61a35d416eb2bb6, user_id=93a9a44c4b4542519d77492aa63d1cf5, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:01.295136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeebb05-7758-4854-bc68-f1bcbdb94ccb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:01.304288 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:01.308008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c28f5d-30f5-4c02-8c1c-505b908e746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:01.308754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c28f5d-30f5-4c02-8c1c-505b908e746d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:01.309100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c28f5d-30f5-4c02-8c1c-505b908e746d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:01.309448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c28f5d-30f5-4c02-8c1c-505b908e746d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:01.310174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c28f5d-30f5-4c02-8c1c-505b908e746d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:01.313847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c28f5d-30f5-4c02-8c1c-505b908e746d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:01.330099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 944/1890] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:01 2022] PUT /identity/v3/projects/c518e4944aef4b7ea61a35d416eb2bb6/users/93a9a44c4b4542519d77492aa63d1cf5/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:01.333689 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeebb05-7758-4854-bc68-f1bcbdb94ccb admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:01.344051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 947/1891] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:01.345785 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c28f5d-30f5-4c02-8c1c-505b908e746d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:01.364625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c28f5d-30f5-4c02-8c1c-505b908e746d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:01.458210 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeebb05-7758-4854-bc68-f1bcbdb94ccb admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:01.462273 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:01.470887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07741b-301d-46b4-b3cd-fd06d9d01db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:01.472875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07741b-301d-46b4-b3cd-fd06d9d01db9 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:01.473280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07741b-301d-46b4-b3cd-fd06d9d01db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:01.474362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07741b-301d-46b4-b3cd-fd06d9d01db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:01.475164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07741b-301d-46b4-b3cd-fd06d9d01db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:01.483806 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07741b-301d-46b4-b3cd-fd06d9d01db9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:01.490939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a9075-3ee7-42e9-982b-754ab98f3262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:01.496730 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a9075-3ee7-42e9-982b-754ab98f3262 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:01.497080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a9075-3ee7-42e9-982b-754ab98f3262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:01.497672 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a9075-3ee7-42e9-982b-754ab98f3262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:01.498389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a9075-3ee7-42e9-982b-754ab98f3262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:01.500252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a9075-3ee7-42e9-982b-754ab98f3262 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:01.517127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 945/1892] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:01.520951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07741b-301d-46b4-b3cd-fd06d9d01db9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:01.539893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07741b-301d-46b4-b3cd-fd06d9d01db9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:01.547674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887b2bb-7c47-41b5-b65b-8117521abb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:01.548400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887b2bb-7c47-41b5-b65b-8117521abb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:01.548812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887b2bb-7c47-41b5-b65b-8117521abb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:01.549097 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887b2bb-7c47-41b5-b65b-8117521abb70 admin admin] PATH_INFO: `/v3/projects/c518e4944aef4b7ea61a35d416eb2bb6/users/93a9a44c4b4542519d77492aa63d1cf5/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:01.553147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 948/1893] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:01.554537 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887b2bb-7c47-41b5-b65b-8117521abb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c518e4944aef4b7ea61a35d416eb2bb6, user_id=93a9a44c4b4542519d77492aa63d1cf5, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:01.557847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a9075-3ee7-42e9-982b-754ab98f3262 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:01.567147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887b2bb-7c47-41b5-b65b-8117521abb70 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:01.575390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a9075-3ee7-42e9-982b-754ab98f3262 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:01.589100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 946/1894] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:01 2022] PUT /identity/v3/projects/c518e4944aef4b7ea61a35d416eb2bb6/users/93a9a44c4b4542519d77492aa63d1cf5/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:55:01.603549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3fce9-f2c3-402b-b3d8-2e1ec3a1e601 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:01.603835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3fce9-f2c3-402b-b3d8-2e1ec3a1e601 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:01.604117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3fce9-f2c3-402b-b3d8-2e1ec3a1e601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:01.667400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-add3fce9-f2c3-402b-b3d8-2e1ec3a1e601 None None] MFA Rules not processed for user `93a9a44c4b4542519d77492aa63d1cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:01.669001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-add3fce9-f2c3-402b-b3d8-2e1ec3a1e601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:01.709929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72a36d-2263-4f3b-bfb8-9dbb582633bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:01.711759 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72a36d-2263-4f3b-bfb8-9dbb582633bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:01.712030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72a36d-2263-4f3b-bfb8-9dbb582633bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:01.712299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72a36d-2263-4f3b-bfb8-9dbb582633bf admin admin] PATH_INFO: `/v3/projects/458b7da953954ef78358e65be5b46647/users/bef599e327d745cf9afc6a2ba04e63ca/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:01.756342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72a36d-2263-4f3b-bfb8-9dbb582633bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=458b7da953954ef78358e65be5b46647, user_id=bef599e327d745cf9afc6a2ba04e63ca, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:01.760133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72a36d-2263-4f3b-bfb8-9dbb582633bf admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:01.803357 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 949/1895] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:01 2022] PUT /identity/v3/projects/458b7da953954ef78358e65be5b46647/users/bef599e327d745cf9afc6a2ba04e63ca/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:01.847581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 947/1896] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:01 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:55:01.868378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72a36d-2263-4f3b-bfb8-9dbb582633bf admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:01.870342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-af72a36d-2263-4f3b-bfb8-9dbb582633bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:01.875718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef48693-dcd2-4d87-ad71-6c2b4135aeca None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:01.876329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef48693-dcd2-4d87-ad71-6c2b4135aeca None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:01.877364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef48693-dcd2-4d87-ad71-6c2b4135aeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:01.921129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7ef48693-dcd2-4d87-ad71-6c2b4135aeca None None] MFA Rules not processed for user `bef599e327d745cf9afc6a2ba04e63ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:01.923056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7ef48693-dcd2-4d87-ad71-6c2b4135aeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:01.972361 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72a36d-2263-4f3b-bfb8-9dbb582633bf admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:01.993374 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573e5f4-4a9f-46ca-9dac-d8d3b7abbc49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:01.994490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573e5f4-4a9f-46ca-9dac-d8d3b7abbc49 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:01.994490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573e5f4-4a9f-46ca-9dac-d8d3b7abbc49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:01.994699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573e5f4-4a9f-46ca-9dac-d8d3b7abbc49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:02.064152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:02.082974 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 948/1897] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:02.084012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573e5f4-4a9f-46ca-9dac-d8d3b7abbc49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:02.086256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573e5f4-4a9f-46ca-9dac-d8d3b7abbc49 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:02.099763 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 950/1898] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:01 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:02.139110 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef48693-dcd2-4d87-ad71-6c2b4135aeca None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:02.154397 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef48693-dcd2-4d87-ad71-6c2b4135aeca None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:02.162264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f788f-e083-49a5-9406-6ff02f35853d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:02.163082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f788f-e083-49a5-9406-6ff02f35853d service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:02.163957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f788f-e083-49a5-9406-6ff02f35853d service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:02.164627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f788f-e083-49a5-9406-6ff02f35853d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:02.206995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f788f-e083-49a5-9406-6ff02f35853d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:02.208751 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f788f-e083-49a5-9406-6ff02f35853d service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:02.226138 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 949/1899] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:02.290991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573e5f4-4a9f-46ca-9dac-d8d3b7abbc49 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:02.326486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:02.380741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573e5f4-4a9f-46ca-9dac-d8d3b7abbc49 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:02.394630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:02.395424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:02.396328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:02.396679 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] PATH_INFO: `/v3/users/bef599e327d745cf9afc6a2ba04e63ca` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:02.398294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef599e327d745cf9afc6a2ba04e63ca)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:02.400389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:02.476916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef599e327d745cf9afc6a2ba04e63ca'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:02.498588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef599e327d745cf9afc6a2ba04e63ca'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:02.511230 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef599e327d745cf9afc6a2ba04e63ca'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:02.525035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef599e327d745cf9afc6a2ba04e63ca'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:02.526023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef599e327d745cf9afc6a2ba04e63ca'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:02.539112 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 951/1900] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:02 2022] DELETE /identity/v3/users/bef599e327d745cf9afc6a2ba04e63ca => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:02.541037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4acf36-f51f-48da-8036-7a3397ed7168 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:02.541256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4acf36-f51f-48da-8036-7a3397ed7168 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:02.541533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4acf36-f51f-48da-8036-7a3397ed7168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:02.585173 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-fb4acf36-f51f-48da-8036-7a3397ed7168 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:02.586573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fb4acf36-f51f-48da-8036-7a3397ed7168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:02.750600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 950/1901] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:02.772850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:02.775626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:02.869034 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54422-fe75-49cb-9d8d-a48f52aa5289 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:02.876321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efca306-85ff-42cc-824a-9382e1f37249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:02.877920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efca306-85ff-42cc-824a-9382e1f37249 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:02.878575 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efca306-85ff-42cc-824a-9382e1f37249 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:02.879148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efca306-85ff-42cc-824a-9382e1f37249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:02.903083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efca306-85ff-42cc-824a-9382e1f37249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:02.905506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efca306-85ff-42cc-824a-9382e1f37249 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:02.923887 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 952/1902] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:03.368209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4acf36-f51f-48da-8036-7a3397ed7168 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:03.370752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fb4acf36-f51f-48da-8036-7a3397ed7168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:03.398582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4acf36-f51f-48da-8036-7a3397ed7168 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:03.412087 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cccee-df57-48a8-9e46-e072a6f0cc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:03.413329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cccee-df57-48a8-9e46-e072a6f0cc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:03.413869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cccee-df57-48a8-9e46-e072a6f0cc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:03.415529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cccee-df57-48a8-9e46-e072a6f0cc14 admin admin] PATH_INFO: `/v3/users/d5559495af904f3ab40abcec18259f63` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:03.417429 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cccee-df57-48a8-9e46-e072a6f0cc14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5559495af904f3ab40abcec18259f63)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:03.439912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cccee-df57-48a8-9e46-e072a6f0cc14 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:03.517233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d77cccee-df57-48a8-9e46-e072a6f0cc14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5559495af904f3ab40abcec18259f63'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:03.518035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d77cccee-df57-48a8-9e46-e072a6f0cc14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5559495af904f3ab40abcec18259f63'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:03.527770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d77cccee-df57-48a8-9e46-e072a6f0cc14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5559495af904f3ab40abcec18259f63'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:03.537978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d77cccee-df57-48a8-9e46-e072a6f0cc14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5559495af904f3ab40abcec18259f63'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:03.557259 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d77cccee-df57-48a8-9e46-e072a6f0cc14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5559495af904f3ab40abcec18259f63'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:03.569017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 951/1903] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:03 2022] DELETE /identity/v3/users/d5559495af904f3ab40abcec18259f63 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:04.276459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efca306-85ff-42cc-824a-9382e1f37249 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:04.279017 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6efca306-85ff-42cc-824a-9382e1f37249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:04.300970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efca306-85ff-42cc-824a-9382e1f37249 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:04.416291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:04.459309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6008607-8019-4e3d-af76-05017ad25974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:04.460059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6008607-8019-4e3d-af76-05017ad25974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:04.460874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6008607-8019-4e3d-af76-05017ad25974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:04.461169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6008607-8019-4e3d-af76-05017ad25974 admin admin] PATH_INFO: `/v3/projects/458b7da953954ef78358e65be5b46647` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:04.462570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6008607-8019-4e3d-af76-05017ad25974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=458b7da953954ef78358e65be5b46647)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:04.465216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6008607-8019-4e3d-af76-05017ad25974 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:04.552000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b6008607-8019-4e3d-af76-05017ad25974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458b7da953954ef78358e65be5b46647', 'request_id': 'req-b6008607-8019-4e3d-af76-05017ad25974'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:04.573271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b6008607-8019-4e3d-af76-05017ad25974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458b7da953954ef78358e65be5b46647', 'request_id': 'req-b6008607-8019-4e3d-af76-05017ad25974'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:04.584564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b6008607-8019-4e3d-af76-05017ad25974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458b7da953954ef78358e65be5b46647', 'request_id': 'req-b6008607-8019-4e3d-af76-05017ad25974'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:04.622917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b6008607-8019-4e3d-af76-05017ad25974 admin admin] The token cache is being invalidate because project 458b7da953954ef78358e65be5b46647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:04.623346 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b6008607-8019-4e3d-af76-05017ad25974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:04.624314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b6008607-8019-4e3d-af76-05017ad25974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:04.628558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 953/1904] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:04 2022] DELETE /identity/v3/projects/458b7da953954ef78358e65be5b46647 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:04.631484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1192e-6a55-4eb9-a121-aceb9e521a68 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:04.632285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1192e-6a55-4eb9-a121-aceb9e521a68 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:04.632727 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1192e-6a55-4eb9-a121-aceb9e521a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:04.666475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8cf1192e-6a55-4eb9-a121-aceb9e521a68 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:04.667740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8cf1192e-6a55-4eb9-a121-aceb9e521a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:04.771358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:04.799534 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 952/1905] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:04.807256 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe1aaf-105b-4fe4-a470-7cd8f5ba3231 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:04.807546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe1aaf-105b-4fe4-a470-7cd8f5ba3231 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:04.807855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe1aaf-105b-4fe4-a470-7cd8f5ba3231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:04.850823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fefe1aaf-105b-4fe4-a470-7cd8f5ba3231 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:04.852063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fefe1aaf-105b-4fe4-a470-7cd8f5ba3231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:04.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 954/1906] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:04.872878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1192e-6a55-4eb9-a121-aceb9e521a68 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:04.888468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1192e-6a55-4eb9-a121-aceb9e521a68 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:04.895160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eaeaf-d5de-4da7-9f6c-295c5ed13d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:04.896025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eaeaf-d5de-4da7-9f6c-295c5ed13d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:04.897283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eaeaf-d5de-4da7-9f6c-295c5ed13d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:04.901061 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eaeaf-d5de-4da7-9f6c-295c5ed13d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:04.901061 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eaeaf-d5de-4da7-9f6c-295c5ed13d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:55:04.901061 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eaeaf-d5de-4da7-9f6c-295c5ed13d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:04.902476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eaeaf-d5de-4da7-9f6c-295c5ed13d4a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:04.918815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 953/1907] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:55:04.922883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe1aaf-105b-4fe4-a470-7cd8f5ba3231 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:04.935462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe1aaf-105b-4fe4-a470-7cd8f5ba3231 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:04.940945 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9d83-14f9-485d-a57f-f416c12a161e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:04.941570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9d83-14f9-485d-a57f-f416c12a161e admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:04.942097 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9d83-14f9-485d-a57f-f416c12a161e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:04.942097 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9d83-14f9-485d-a57f-f416c12a161e admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:04.942963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9d83-14f9-485d-a57f-f416c12a161e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:04.945237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9d83-14f9-485d-a57f-f416c12a161e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:04.988591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 955/1908] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:04 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:04.993326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eaeaf-d5de-4da7-9f6c-295c5ed13d4a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:05.012270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eaeaf-d5de-4da7-9f6c-295c5ed13d4a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:05.096375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690e721-874a-431c-8d29-36229a701936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:05.097132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690e721-874a-431c-8d29-36229a701936 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:05.097613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690e721-874a-431c-8d29-36229a701936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:05.098113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690e721-874a-431c-8d29-36229a701936 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:05.099005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690e721-874a-431c-8d29-36229a701936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:05.102379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690e721-874a-431c-8d29-36229a701936 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:05.139872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 954/1909] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:04 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:05.140714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9d83-14f9-485d-a57f-f416c12a161e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:05.154563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9d83-14f9-485d-a57f-f416c12a161e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:05.163707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94842b-09e9-4871-b49e-aed835fcbeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:05.164809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94842b-09e9-4871-b49e-aed835fcbeae admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:05.165240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94842b-09e9-4871-b49e-aed835fcbeae admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:05.165843 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94842b-09e9-4871-b49e-aed835fcbeae admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:05.166715 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94842b-09e9-4871-b49e-aed835fcbeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:05.168750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94842b-09e9-4871-b49e-aed835fcbeae admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:05.192016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690e721-874a-431c-8d29-36229a701936 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:05.196695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 956/1910] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:05.206351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690e721-874a-431c-8d29-36229a701936 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:05.212047 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959e1ec-a4f9-43fb-bc53-b9dea1a5a73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:05.212934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959e1ec-a4f9-43fb-bc53-b9dea1a5a73f admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:05.213568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959e1ec-a4f9-43fb-bc53-b9dea1a5a73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:05.213680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959e1ec-a4f9-43fb-bc53-b9dea1a5a73f admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:05.214298 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959e1ec-a4f9-43fb-bc53-b9dea1a5a73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:05.217475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959e1ec-a4f9-43fb-bc53-b9dea1a5a73f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:05.249723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 955/1911] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:05.256332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94842b-09e9-4871-b49e-aed835fcbeae admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:05.276659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94842b-09e9-4871-b49e-aed835fcbeae admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:05.282228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386143d-f370-405c-829c-842fc0d2b939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:05.283106 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386143d-f370-405c-829c-842fc0d2b939 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:05.283511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386143d-f370-405c-829c-842fc0d2b939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:05.283880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386143d-f370-405c-829c-842fc0d2b939 admin admin] PATH_INFO: `/v3/projects/121221aeb5584f55af27ff5473e5e44e/users/22e068856a7d4b01bb390bba5507f4d9/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:05.310478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386143d-f370-405c-829c-842fc0d2b939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=121221aeb5584f55af27ff5473e5e44e, user_id=22e068856a7d4b01bb390bba5507f4d9, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:05.314360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386143d-f370-405c-829c-842fc0d2b939 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:05.343796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 957/1912] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:05 2022] PUT /identity/v3/projects/121221aeb5584f55af27ff5473e5e44e/users/22e068856a7d4b01bb390bba5507f4d9/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:55:05.348953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f236f-5c59-4119-853d-df9b64e7f580 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:05.349318 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f236f-5c59-4119-853d-df9b64e7f580 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:05.349650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f236f-5c59-4119-853d-df9b64e7f580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:05.389797 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d87f236f-5c59-4119-853d-df9b64e7f580 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:05.392471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d87f236f-5c59-4119-853d-df9b64e7f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:05.461684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386143d-f370-405c-829c-842fc0d2b939 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:05.464195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c386143d-f370-405c-829c-842fc0d2b939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:05.627756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 956/1913] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:05.649466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386143d-f370-405c-829c-842fc0d2b939 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:05.658655 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6294c-b647-462c-97a7-cbfa603b560e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:05.659719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6294c-b647-462c-97a7-cbfa603b560e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:05.660695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6294c-b647-462c-97a7-cbfa603b560e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:05.661911 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6294c-b647-462c-97a7-cbfa603b560e admin admin] PATH_INFO: `/v3/projects/4b2ad68aa304432cb2693f2b63387110` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:05.666218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f236f-5c59-4119-853d-df9b64e7f580 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:05.668391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d87f236f-5c59-4119-853d-df9b64e7f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:05.671694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6294c-b647-462c-97a7-cbfa603b560e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2ad68aa304432cb2693f2b63387110)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:05.674031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6294c-b647-462c-97a7-cbfa603b560e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:05.692127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:05.793015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2cc6294c-b647-462c-97a7-cbfa603b560e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2ad68aa304432cb2693f2b63387110', 'request_id': 'req-2cc6294c-b647-462c-97a7-cbfa603b560e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:05.811338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2cc6294c-b647-462c-97a7-cbfa603b560e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2ad68aa304432cb2693f2b63387110', 'request_id': 'req-2cc6294c-b647-462c-97a7-cbfa603b560e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:05.819857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2cc6294c-b647-462c-97a7-cbfa603b560e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2ad68aa304432cb2693f2b63387110', 'request_id': 'req-2cc6294c-b647-462c-97a7-cbfa603b560e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:05.833438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f236f-5c59-4119-853d-df9b64e7f580 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:05.852536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2cc6294c-b647-462c-97a7-cbfa603b560e admin admin] The token cache is being invalidate because project 4b2ad68aa304432cb2693f2b63387110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:05.856231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2cc6294c-b647-462c-97a7-cbfa603b560e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:05.857111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2cc6294c-b647-462c-97a7-cbfa603b560e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:05.858407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:05.871602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 958/1914] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:05 2022] DELETE /identity/v3/projects/4b2ad68aa304432cb2693f2b63387110 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:05.877394 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf02f-08a2-472a-bac3-921ba9fe94d5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:05.878542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf02f-08a2-472a-bac3-921ba9fe94d5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:05.878983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf02f-08a2-472a-bac3-921ba9fe94d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:05.920967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bc1bf02f-08a2-472a-bac3-921ba9fe94d5 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:05.922536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bc1bf02f-08a2-472a-bac3-921ba9fe94d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:05.967379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efd4e6-322b-4700-b73d-5f380e96cc13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:05.968330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efd4e6-322b-4700-b73d-5f380e96cc13 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:05.968614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efd4e6-322b-4700-b73d-5f380e96cc13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:05.969627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efd4e6-322b-4700-b73d-5f380e96cc13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:05.971680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-88efd4e6-322b-4700-b73d-5f380e96cc13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:06.083082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 959/1915] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:55:06.091291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8ad92-051b-4ace-b0fb-9b49f20ab140 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:06.091587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8ad92-051b-4ace-b0fb-9b49f20ab140 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:06.091862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8ad92-051b-4ace-b0fb-9b49f20ab140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:06.120674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efd4e6-322b-4700-b73d-5f380e96cc13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:06.122388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efd4e6-322b-4700-b73d-5f380e96cc13 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:06.131275 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-dfc8ad92-051b-4ace-b0fb-9b49f20ab140 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:06.132574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dfc8ad92-051b-4ace-b0fb-9b49f20ab140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:06.135111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 957/1916] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:55:06.154156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 960/1917] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:55:06.156150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efd4e6-322b-4700-b73d-5f380e96cc13 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:06.167070 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efd4e6-322b-4700-b73d-5f380e96cc13 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:06.175727 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3c663-029d-4893-8534-a26c034524cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:06.175727 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3c663-029d-4893-8534-a26c034524cd admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:06.176034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3c663-029d-4893-8534-a26c034524cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:06.176203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3c663-029d-4893-8534-a26c034524cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:06.177544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3c663-029d-4893-8534-a26c034524cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:55:06.177850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3c663-029d-4893-8534-a26c034524cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:06.179600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3c663-029d-4893-8534-a26c034524cd admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:06.198468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 958/1918] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:55:06.200606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8ad92-051b-4ace-b0fb-9b49f20ab140 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:06.216766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8ad92-051b-4ace-b0fb-9b49f20ab140 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:06.226363 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59ae28-2c81-4c70-90ae-047f8202a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:06.227623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59ae28-2c81-4c70-90ae-047f8202a9ff admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:06.227958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59ae28-2c81-4c70-90ae-047f8202a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:06.228232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59ae28-2c81-4c70-90ae-047f8202a9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:06.229812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59ae28-2c81-4c70-90ae-047f8202a9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:06.230881 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59ae28-2c81-4c70-90ae-047f8202a9ff admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:06.281307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 961/1919] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:06 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:06.285374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3c663-029d-4893-8534-a26c034524cd admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:06.296798 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3c663-029d-4893-8534-a26c034524cd admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:06.402553 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cf536-c5e6-4060-a5f1-3a03b893eab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:06.403276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cf536-c5e6-4060-a5f1-3a03b893eab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:06.403556 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cf536-c5e6-4060-a5f1-3a03b893eab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:06.403871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cf536-c5e6-4060-a5f1-3a03b893eab1 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:06.405876 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cf536-c5e6-4060-a5f1-3a03b893eab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:06.408140 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cf536-c5e6-4060-a5f1-3a03b893eab1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:06.441782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 959/1920] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:06 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:06.444750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59ae28-2c81-4c70-90ae-047f8202a9ff admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:06.458694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59ae28-2c81-4c70-90ae-047f8202a9ff admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:06.471876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8468716-704b-442c-8363-d3f914bc1f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:06.472578 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8468716-704b-442c-8363-d3f914bc1f4b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:06.472915 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8468716-704b-442c-8363-d3f914bc1f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:06.473246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8468716-704b-442c-8363-d3f914bc1f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:06.474223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8468716-704b-442c-8363-d3f914bc1f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:06.476028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8468716-704b-442c-8363-d3f914bc1f4b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:06.501547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 962/1921] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:06.505677 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cf536-c5e6-4060-a5f1-3a03b893eab1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:06.520225 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cf536-c5e6-4060-a5f1-3a03b893eab1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:06.528047 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e126d11-6248-4413-be77-61da45c3e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:06.528996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126d11-6248-4413-be77-61da45c3e936 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:06.529896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126d11-6248-4413-be77-61da45c3e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:06.530352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126d11-6248-4413-be77-61da45c3e936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:06.532550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e126d11-6248-4413-be77-61da45c3e936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:06.535084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e126d11-6248-4413-be77-61da45c3e936 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:06.556622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 960/1922] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:06.561462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8468716-704b-442c-8363-d3f914bc1f4b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:06.573624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8468716-704b-442c-8363-d3f914bc1f4b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:06.581207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89757c2f-9e5b-4e8d-9d1b-7c53021a4901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:06.582337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89757c2f-9e5b-4e8d-9d1b-7c53021a4901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:06.582995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89757c2f-9e5b-4e8d-9d1b-7c53021a4901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:06.583528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89757c2f-9e5b-4e8d-9d1b-7c53021a4901 admin admin] PATH_INFO: `/v3/projects/557dcef57af44bd09ba2c7d81efe6acf/users/d60c273b78fb46b4871ca07b65c19ecb/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:06.607217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89757c2f-9e5b-4e8d-9d1b-7c53021a4901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557dcef57af44bd09ba2c7d81efe6acf, user_id=d60c273b78fb46b4871ca07b65c19ecb, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:06.610007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89757c2f-9e5b-4e8d-9d1b-7c53021a4901 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:06.640658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 963/1923] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:06 2022] PUT /identity/v3/projects/557dcef57af44bd09ba2c7d81efe6acf/users/d60c273b78fb46b4871ca07b65c19ecb/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:06.643656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356464c-e4f4-4ac2-bca5-035aff9726cd None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:06.644055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356464c-e4f4-4ac2-bca5-035aff9726cd None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:06.645068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356464c-e4f4-4ac2-bca5-035aff9726cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:06.687214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e356464c-e4f4-4ac2-bca5-035aff9726cd None None] MFA Rules not processed for user `d60c273b78fb46b4871ca07b65c19ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:06.688312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e356464c-e4f4-4ac2-bca5-035aff9726cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:06.724594 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:06.792849 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 961/1924] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:06.797508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89757c2f-9e5b-4e8d-9d1b-7c53021a4901 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:06.836286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:06.876305 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89757c2f-9e5b-4e8d-9d1b-7c53021a4901 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:06.882829 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b23ca-da6d-48bd-9ef7-9f07520617eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:06.883474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b23ca-da6d-48bd-9ef7-9f07520617eb admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:06.883743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b23ca-da6d-48bd-9ef7-9f07520617eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:06.884014 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b23ca-da6d-48bd-9ef7-9f07520617eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:06.884674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b23ca-da6d-48bd-9ef7-9f07520617eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:06.887331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b23ca-da6d-48bd-9ef7-9f07520617eb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:06.920221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 964/1925] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:06 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:06.924248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356464c-e4f4-4ac2-bca5-035aff9726cd None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:06.935912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356464c-e4f4-4ac2-bca5-035aff9726cd None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:07.016818 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532926d-cbfc-4af4-bd31-f711913dbdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:07.017994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532926d-cbfc-4af4-bd31-f711913dbdde admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:07.018694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532926d-cbfc-4af4-bd31-f711913dbdde admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:07.019484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532926d-cbfc-4af4-bd31-f711913dbdde admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:07.020408 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532926d-cbfc-4af4-bd31-f711913dbdde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:07.023259 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532926d-cbfc-4af4-bd31-f711913dbdde admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:07.059784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 962/1926] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:06 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:07.061301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b23ca-da6d-48bd-9ef7-9f07520617eb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:07.075296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b23ca-da6d-48bd-9ef7-9f07520617eb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:07.082458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd21e05-0fa3-4f88-be72-beb667ff8a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:07.083252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd21e05-0fa3-4f88-be72-beb667ff8a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:07.083585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd21e05-0fa3-4f88-be72-beb667ff8a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:07.084039 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd21e05-0fa3-4f88-be72-beb667ff8a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:07.084631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd21e05-0fa3-4f88-be72-beb667ff8a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:07.086818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd21e05-0fa3-4f88-be72-beb667ff8a5d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:07.103669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 965/1927] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:07.104253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532926d-cbfc-4af4-bd31-f711913dbdde admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:07.114606 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532926d-cbfc-4af4-bd31-f711913dbdde admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:07.120510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e24d-6496-4d47-8e8b-c47b6ebdd4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:07.121798 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e24d-6496-4d47-8e8b-c47b6ebdd4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:07.122208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e24d-6496-4d47-8e8b-c47b6ebdd4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:07.122772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e24d-6496-4d47-8e8b-c47b6ebdd4cc admin admin] PATH_INFO: `/v3/projects/1259a26272044d87bdc722210a4e47c0/users/0bada1b1c8d14e7495aae36a513540f2/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:07.144199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54e24d-6496-4d47-8e8b-c47b6ebdd4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1259a26272044d87bdc722210a4e47c0, user_id=0bada1b1c8d14e7495aae36a513540f2, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:07.147643 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54e24d-6496-4d47-8e8b-c47b6ebdd4cc admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:07.167197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 963/1928] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:07 2022] PUT /identity/v3/projects/1259a26272044d87bdc722210a4e47c0/users/0bada1b1c8d14e7495aae36a513540f2/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:55:07.171628 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd21e05-0fa3-4f88-be72-beb667ff8a5d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:07.187717 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd21e05-0fa3-4f88-be72-beb667ff8a5d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:07.272227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321af88-6703-4c7c-92ed-328555b33b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:07.273157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321af88-6703-4c7c-92ed-328555b33b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:07.273626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321af88-6703-4c7c-92ed-328555b33b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:07.274113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321af88-6703-4c7c-92ed-328555b33b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:07.275052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321af88-6703-4c7c-92ed-328555b33b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:07.276911 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321af88-6703-4c7c-92ed-328555b33b74 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:07.294155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e24d-6496-4d47-8e8b-c47b6ebdd4cc admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:07.294990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 966/1929] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:07.309006 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e24d-6496-4d47-8e8b-c47b6ebdd4cc admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:07.317229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707f40b-39e8-4fed-a0e2-b0b937522c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:07.319038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707f40b-39e8-4fed-a0e2-b0b937522c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:07.319829 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707f40b-39e8-4fed-a0e2-b0b937522c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:07.320309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707f40b-39e8-4fed-a0e2-b0b937522c74 admin admin] PATH_INFO: `/v3/projects/1259a26272044d87bdc722210a4e47c0/users/0bada1b1c8d14e7495aae36a513540f2/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:07.323122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707f40b-39e8-4fed-a0e2-b0b937522c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1259a26272044d87bdc722210a4e47c0, user_id=0bada1b1c8d14e7495aae36a513540f2, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:07.326153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707f40b-39e8-4fed-a0e2-b0b937522c74 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:07.353863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a099724-6474-4f51-bffe-f59d7cb0a89a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:07.353863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a099724-6474-4f51-bffe-f59d7cb0a89a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:07.353863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a099724-6474-4f51-bffe-f59d7cb0a89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:07.354800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 964/1930] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:07 2022] PUT /identity/v3/projects/1259a26272044d87bdc722210a4e47c0/users/0bada1b1c8d14e7495aae36a513540f2/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:07.394201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7a099724-6474-4f51-bffe-f59d7cb0a89a None None] MFA Rules not processed for user `0bada1b1c8d14e7495aae36a513540f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:07.395720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7a099724-6474-4f51-bffe-f59d7cb0a89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:07.523988 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 967/1931] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:07.576536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707f40b-39e8-4fed-a0e2-b0b937522c74 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:07.578584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8707f40b-39e8-4fed-a0e2-b0b937522c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:07.614087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a099724-6474-4f51-bffe-f59d7cb0a89a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:07.620175 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7a099724-6474-4f51-bffe-f59d7cb0a89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:07.723023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:07.768862 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707f40b-39e8-4fed-a0e2-b0b937522c74 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:07.772715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7e4a7-c2c5-470e-8b93-436e48aa6661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:07.773405 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7e4a7-c2c5-470e-8b93-436e48aa6661 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:07.773753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7e4a7-c2c5-470e-8b93-436e48aa6661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:07.774098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7e4a7-c2c5-470e-8b93-436e48aa6661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:07.777837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a099724-6474-4f51-bffe-f59d7cb0a89a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:07.790515 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:07.791466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:07.791744 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:07.792016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] PATH_INFO: `/v3/users/4f4c2577d1144756a08336695aae9190` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:07.793212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4c2577d1144756a08336695aae9190)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:07.796125 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:07.810494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:07.859230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7e4a7-c2c5-470e-8b93-436e48aa6661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:07.861584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7e4a7-c2c5-470e-8b93-436e48aa6661 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:07.882948 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 965/1932] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:07.884470 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4c2577d1144756a08336695aae9190'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:07.923216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4c2577d1144756a08336695aae9190'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:07.938275 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4c2577d1144756a08336695aae9190'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:07.953620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4c2577d1144756a08336695aae9190'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:07.954504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4c2577d1144756a08336695aae9190'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:07.971617 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 968/1933] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:07 2022] DELETE /identity/v3/users/4f4c2577d1144756a08336695aae9190 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:07.972141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0440485-c3ed-43d1-b878-873199ee803f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:07.972433 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0440485-c3ed-43d1-b878-873199ee803f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:07.972763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0440485-c3ed-43d1-b878-873199ee803f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:08.008065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f0440485-c3ed-43d1-b878-873199ee803f None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:08.010928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f0440485-c3ed-43d1-b878-873199ee803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:08.102575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 966/1934] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:08.115529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:08.117206 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:08.213601 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798608f-78e8-4e55-a650-6d3225b18a0d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:08.219228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859afd8-9272-49a2-b262-3ba77a593003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:08.220565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859afd8-9272-49a2-b262-3ba77a593003 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:08.220857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859afd8-9272-49a2-b262-3ba77a593003 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:08.221130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859afd8-9272-49a2-b262-3ba77a593003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:08.234621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859afd8-9272-49a2-b262-3ba77a593003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:08.236810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859afd8-9272-49a2-b262-3ba77a593003 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:08.251236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 969/1935] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:08.541581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0440485-c3ed-43d1-b878-873199ee803f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:08.543276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f0440485-c3ed-43d1-b878-873199ee803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:08.564485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0440485-c3ed-43d1-b878-873199ee803f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:08.577202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:08.578152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:08.581736 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:08.582215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] PATH_INFO: `/v3/users/1049a0bbb35f408bae0126fe570bca98` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:08.584122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1049a0bbb35f408bae0126fe570bca98)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:08.587578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:08.682862 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1049a0bbb35f408bae0126fe570bca98'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:08.684338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1049a0bbb35f408bae0126fe570bca98'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:08.693337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1049a0bbb35f408bae0126fe570bca98'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:08.705745 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1049a0bbb35f408bae0126fe570bca98'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:08.742570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1049a0bbb35f408bae0126fe570bca98'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:08.758236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 967/1936] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:08 2022] DELETE /identity/v3/users/1049a0bbb35f408bae0126fe570bca98 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:08.760209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e483bed-07f8-4540-b050-0a0d43ec6da4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:08.760669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e483bed-07f8-4540-b050-0a0d43ec6da4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:08.760785 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e483bed-07f8-4540-b050-0a0d43ec6da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:08.791444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5e483bed-07f8-4540-b050-0a0d43ec6da4 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:08.793447 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5e483bed-07f8-4540-b050-0a0d43ec6da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:08.857779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:08.879861 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 970/1937] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:08.931618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:08.935688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:09.049670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:09.080815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77e6ca-bc5d-44f0-a57b-fc8dea2e85dd admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:09.093520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b68d47-4fde-47bc-ac5b-6e462885a2c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:09.094344 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68d47-4fde-47bc-ac5b-6e462885a2c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:09.094879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68d47-4fde-47bc-ac5b-6e462885a2c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:09.095216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68d47-4fde-47bc-ac5b-6e462885a2c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:09.114832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b68d47-4fde-47bc-ac5b-6e462885a2c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:09.125986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b68d47-4fde-47bc-ac5b-6e462885a2c6 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:09.147553 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 968/1938] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:09.159420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e483bed-07f8-4540-b050-0a0d43ec6da4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:09.160958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5e483bed-07f8-4540-b050-0a0d43ec6da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:09.184351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e483bed-07f8-4540-b050-0a0d43ec6da4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:09.190061 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:09.191161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:09.191440 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:09.191710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] PATH_INFO: `/v3/projects/9887c7b917744bb5aafe12df87703690` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:09.192848 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9887c7b917744bb5aafe12df87703690)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:09.196633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:09.285180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9887c7b917744bb5aafe12df87703690', 'request_id': 'req-af10b4d1-2f26-4fd3-9078-ed043bc4c731'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:09.300776 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9887c7b917744bb5aafe12df87703690', 'request_id': 'req-af10b4d1-2f26-4fd3-9078-ed043bc4c731'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:09.313921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9887c7b917744bb5aafe12df87703690', 'request_id': 'req-af10b4d1-2f26-4fd3-9078-ed043bc4c731'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:09.328999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] The token cache is being invalidate because project 9887c7b917744bb5aafe12df87703690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:09.331868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:09.332444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:09.336888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 971/1939] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:09 2022] DELETE /identity/v3/projects/9887c7b917744bb5aafe12df87703690 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:09.338580 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b68d47-4fde-47bc-ac5b-6e462885a2c6 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:09.349375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b68d47-4fde-47bc-ac5b-6e462885a2c6 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:09.446656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a8bf4-6a24-46c4-8360-01e533390d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:09.448368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a8bf4-6a24-46c4-8360-01e533390d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:09.449507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a8bf4-6a24-46c4-8360-01e533390d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:09.450172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a8bf4-6a24-46c4-8360-01e533390d5e admin admin] PATH_INFO: `/v3/users/93a9a44c4b4542519d77492aa63d1cf5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:09.452236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a8bf4-6a24-46c4-8360-01e533390d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a9a44c4b4542519d77492aa63d1cf5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:09.454583 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a8bf4-6a24-46c4-8360-01e533390d5e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:09.552166 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bf4a8bf4-6a24-46c4-8360-01e533390d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a9a44c4b4542519d77492aa63d1cf5'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:09.556469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bf4a8bf4-6a24-46c4-8360-01e533390d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a9a44c4b4542519d77492aa63d1cf5'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:09.581388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bf4a8bf4-6a24-46c4-8360-01e533390d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a9a44c4b4542519d77492aa63d1cf5'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:09.603559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bf4a8bf4-6a24-46c4-8360-01e533390d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a9a44c4b4542519d77492aa63d1cf5'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:09.619411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:09.621323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:09.668470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bf4a8bf4-6a24-46c4-8360-01e533390d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a9a44c4b4542519d77492aa63d1cf5'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:09.696515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 969/1940] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:09 2022] DELETE /identity/v3/users/93a9a44c4b4542519d77492aa63d1cf5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:09.815352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10b4d1-2f26-4fd3-9078-ed043bc4c731 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:09.849243 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982fdc7-d943-4da3-85fe-b5bf6a0ade0d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:09.849515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982fdc7-d943-4da3-85fe-b5bf6a0ade0d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:09.849792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982fdc7-d943-4da3-85fe-b5bf6a0ade0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:09.905956 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d026d-7d5c-45a7-8c7c-c88406bac398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:09.906981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d026d-7d5c-45a7-8c7c-c88406bac398 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:09.907495 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d026d-7d5c-45a7-8c7c-c88406bac398 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:09.908719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d026d-7d5c-45a7-8c7c-c88406bac398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:09.912383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7982fdc7-d943-4da3-85fe-b5bf6a0ade0d None None] MFA Rules not processed for user `22e068856a7d4b01bb390bba5507f4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:09.913610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7982fdc7-d943-4da3-85fe-b5bf6a0ade0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:09.915532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ca9d026d-7d5c-45a7-8c7c-c88406bac398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:10.009269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:10.034350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:10.074599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 970/1941] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:10.079162 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982fdc7-d943-4da3-85fe-b5bf6a0ade0d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:10.088660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d026d-7d5c-45a7-8c7c-c88406bac398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:10.090217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7982fdc7-d943-4da3-85fe-b5bf6a0ade0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:10.092249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d026d-7d5c-45a7-8c7c-c88406bac398 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:10.105023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 972/1942] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:10.264713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982fdc7-d943-4da3-85fe-b5bf6a0ade0d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:10.271789 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f9906-2399-4ff8-bd2e-fb7a981e23b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:10.272432 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f9906-2399-4ff8-bd2e-fb7a981e23b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:10.272712 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f9906-2399-4ff8-bd2e-fb7a981e23b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:10.272984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f9906-2399-4ff8-bd2e-fb7a981e23b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:10.273636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f9906-2399-4ff8-bd2e-fb7a981e23b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:10.275594 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f9906-2399-4ff8-bd2e-fb7a981e23b5 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:10.341500 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 971/1943] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:10 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:10.345534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d026d-7d5c-45a7-8c7c-c88406bac398 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:10.363557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d026d-7d5c-45a7-8c7c-c88406bac398 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:10.646978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237e907-333e-4062-b38d-ee4821179643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:10.647624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237e907-333e-4062-b38d-ee4821179643 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:10.647904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237e907-333e-4062-b38d-ee4821179643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:10.648172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237e907-333e-4062-b38d-ee4821179643 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:10.648827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237e907-333e-4062-b38d-ee4821179643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:10.668298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237e907-333e-4062-b38d-ee4821179643 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:10.750581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 973/1944] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:10 2022] POST /identity/v3/users => generated 295 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:10.757086 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f9906-2399-4ff8-bd2e-fb7a981e23b5 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:10.758457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237e907-333e-4062-b38d-ee4821179643 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:10.759107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-389f9906-2399-4ff8-bd2e-fb7a981e23b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:10.781879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237e907-333e-4062-b38d-ee4821179643 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:10.794207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dca7e-182d-4ad6-90a4-7ffe6a73656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:10.794849 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f9906-2399-4ff8-bd2e-fb7a981e23b5 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:10.795612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dca7e-182d-4ad6-90a4-7ffe6a73656a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:10.796035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dca7e-182d-4ad6-90a4-7ffe6a73656a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:10.796475 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dca7e-182d-4ad6-90a4-7ffe6a73656a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:10.797319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dca7e-182d-4ad6-90a4-7ffe6a73656a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:10.799268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dca7e-182d-4ad6-90a4-7ffe6a73656a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:10.804508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:10.805226 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:10.805750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:10.816668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc admin admin] PATH_INFO: `/v3/projects/c518e4944aef4b7ea61a35d416eb2bb6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:10.818396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c518e4944aef4b7ea61a35d416eb2bb6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:10.820839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:10.824946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 974/1945] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:10.828803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dca7e-182d-4ad6-90a4-7ffe6a73656a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:10.849800 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dca7e-182d-4ad6-90a4-7ffe6a73656a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:10.873908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555966d7-7e43-4c25-b6fc-cb1ea43142ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:10.874609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555966d7-7e43-4c25-b6fc-cb1ea43142ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:10.874920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555966d7-7e43-4c25-b6fc-cb1ea43142ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:10.875191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555966d7-7e43-4c25-b6fc-cb1ea43142ef admin admin] PATH_INFO: `/v3/projects/42295d884f8e4b9387d759b401417358/users/98437e2bb9f445b4bfe6e95b9e5ae155/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:10.915900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c518e4944aef4b7ea61a35d416eb2bb6', 'request_id': 'req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:10.930294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c518e4944aef4b7ea61a35d416eb2bb6', 'request_id': 'req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:10.953668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555966d7-7e43-4c25-b6fc-cb1ea43142ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=42295d884f8e4b9387d759b401417358, user_id=98437e2bb9f445b4bfe6e95b9e5ae155, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:10.966944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555966d7-7e43-4c25-b6fc-cb1ea43142ef admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:10.973171 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c518e4944aef4b7ea61a35d416eb2bb6', 'request_id': 'req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:10.994104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 975/1946] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:10 2022] PUT /identity/v3/projects/42295d884f8e4b9387d759b401417358/users/98437e2bb9f445b4bfe6e95b9e5ae155/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:10.996393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555966d7-7e43-4c25-b6fc-cb1ea43142ef admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:11.006485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc admin admin] The token cache is being invalidate because project c518e4944aef4b7ea61a35d416eb2bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:11.007645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:11.014413 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc791d05-9ee1-4cd9-a2ef-a82552a56edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:11.017295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 972/1947] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:10 2022] DELETE /identity/v3/projects/c518e4944aef4b7ea61a35d416eb2bb6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:11.021984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187c0e3-05d8-47f1-b392-2a697114fa3c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.022427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187c0e3-05d8-47f1-b392-2a697114fa3c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.022835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187c0e3-05d8-47f1-b392-2a697114fa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.063673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7187c0e3-05d8-47f1-b392-2a697114fa3c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:11.070233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7187c0e3-05d8-47f1-b392-2a697114fa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:11.147315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555966d7-7e43-4c25-b6fc-cb1ea43142ef admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:11.163201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c94aec-b689-465e-9a5d-5ab2f9b4578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:11.164295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c94aec-b689-465e-9a5d-5ab2f9b4578a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.164586 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c94aec-b689-465e-9a5d-5ab2f9b4578a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.166182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c94aec-b689-465e-9a5d-5ab2f9b4578a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.166942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c94aec-b689-465e-9a5d-5ab2f9b4578a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:11.172548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c94aec-b689-465e-9a5d-5ab2f9b4578a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:11.202803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 976/1948] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:11.204534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c94aec-b689-465e-9a5d-5ab2f9b4578a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:11.212030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-73c94aec-b689-465e-9a5d-5ab2f9b4578a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:11.213992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:11.240383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 973/1949] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:11.242390 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187c0e3-05d8-47f1-b392-2a697114fa3c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:11.246635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c94aec-b689-465e-9a5d-5ab2f9b4578a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:11.249269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7187c0e3-05d8-47f1-b392-2a697114fa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:11.252210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:11.252872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.253150 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.253425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7 admin admin] PATH_INFO: `/v3/projects/66c4ecf936d54070a2e80ad610312fe8` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.254658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c4ecf936d54070a2e80ad610312fe8)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:11.256721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:11.278646 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187c0e3-05d8-47f1-b392-2a697114fa3c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:11.285294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d181d-3af5-4e45-a6ef-0e4b1908c22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:11.285993 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d181d-3af5-4e45-a6ef-0e4b1908c22e admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.286276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d181d-3af5-4e45-a6ef-0e4b1908c22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.286869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d181d-3af5-4e45-a6ef-0e4b1908c22e admin admin] PATH_INFO: `/v3/projects/42295d884f8e4b9387d759b401417358/users/98437e2bb9f445b4bfe6e95b9e5ae155/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.289161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d181d-3af5-4e45-a6ef-0e4b1908c22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42295d884f8e4b9387d759b401417358, user_id=98437e2bb9f445b4bfe6e95b9e5ae155, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:11.293161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d181d-3af5-4e45-a6ef-0e4b1908c22e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:11.307827 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 974/1950] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:11 2022] PUT /identity/v3/projects/42295d884f8e4b9387d759b401417358/users/98437e2bb9f445b4bfe6e95b9e5ae155/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:11.310690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577f7c9-5ad5-43c5-b891-2bb8360f6d3f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.311066 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577f7c9-5ad5-43c5-b891-2bb8360f6d3f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.311435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577f7c9-5ad5-43c5-b891-2bb8360f6d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.320503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:11.349092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8577f7c9-5ad5-43c5-b891-2bb8360f6d3f None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:11.350752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8577f7c9-5ad5-43c5-b891-2bb8360f6d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:11.357828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c4ecf936d54070a2e80ad610312fe8', 'request_id': 'req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:11.388772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c4ecf936d54070a2e80ad610312fe8', 'request_id': 'req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:11.411459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c4ecf936d54070a2e80ad610312fe8', 'request_id': 'req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:11.444725 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7 admin admin] The token cache is being invalidate because project 66c4ecf936d54070a2e80ad610312fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:11.445022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:11.446414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 975/1951] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:11.447622 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f2558b06-d734-4a8b-9f8d-b7a67ccc81f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:11.453655 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577f7c9-5ad5-43c5-b891-2bb8360f6d3f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:11.454754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 977/1952] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:11 2022] DELETE /identity/v3/projects/66c4ecf936d54070a2e80ad610312fe8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:11.456234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02398b-4ab9-4fc0-ac41-de0c2c113cbb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.456511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02398b-4ab9-4fc0-ac41-de0c2c113cbb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.456775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02398b-4ab9-4fc0-ac41-de0c2c113cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.468111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577f7c9-5ad5-43c5-b891-2bb8360f6d3f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:11.473581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742a3cd-e014-48f3-9470-744f86492eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:11.474552 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742a3cd-e014-48f3-9470-744f86492eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.474934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742a3cd-e014-48f3-9470-744f86492eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.475280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742a3cd-e014-48f3-9470-744f86492eb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.476058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742a3cd-e014-48f3-9470-744f86492eb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:55:11.476565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742a3cd-e014-48f3-9470-744f86492eb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:11.478572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742a3cd-e014-48f3-9470-744f86492eb9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:11.511623 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 976/1953] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:55:11.519819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742a3cd-e014-48f3-9470-744f86492eb9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:11.521828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1e02398b-4ab9-4fc0-ac41-de0c2c113cbb None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:11.522561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9742a3cd-e014-48f3-9470-744f86492eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:11.523071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1e02398b-4ab9-4fc0-ac41-de0c2c113cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:11.546132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 978/1954] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:11.548698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742a3cd-e014-48f3-9470-744f86492eb9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:11.555387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8da58-3778-45b8-a851-c4493f2ead09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:11.556565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8da58-3778-45b8-a851-c4493f2ead09 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.557111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8da58-3778-45b8-a851-c4493f2ead09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.557489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8da58-3778-45b8-a851-c4493f2ead09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.558884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8da58-3778-45b8-a851-c4493f2ead09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:11.560955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15196cdc-b188-4d56-973f-c72d45540cf9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.561243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15196cdc-b188-4d56-973f-c72d45540cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.561517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15196cdc-b188-4d56-973f-c72d45540cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8da58-3778-45b8-a851-c4493f2ead09 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:11.605701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-15196cdc-b188-4d56-973f-c72d45540cf9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:11.606536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-15196cdc-b188-4d56-973f-c72d45540cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:11.630792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 977/1955] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:11 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:11.630792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8da58-3778-45b8-a851-c4493f2ead09 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:11.631941 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 979/1956] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:11.633057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15196cdc-b188-4d56-973f-c72d45540cf9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:11.647191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15196cdc-b188-4d56-973f-c72d45540cf9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:11.750162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2afc3-8cb8-4eff-83bb-81bbe7bbc3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:11.752318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2afc3-8cb8-4eff-83bb-81bbe7bbc3ff admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.752880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2afc3-8cb8-4eff-83bb-81bbe7bbc3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.753745 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2afc3-8cb8-4eff-83bb-81bbe7bbc3ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.758713 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2afc3-8cb8-4eff-83bb-81bbe7bbc3ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:55:11.761340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2afc3-8cb8-4eff-83bb-81bbe7bbc3ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:11.764310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2afc3-8cb8-4eff-83bb-81bbe7bbc3ff admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:11.792147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 980/1957] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:55:11.801095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8da58-3778-45b8-a851-c4493f2ead09 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:11.802376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2afc3-8cb8-4eff-83bb-81bbe7bbc3ff admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:11.815719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e89a8-0720-45b5-ab8e-29bc61aadd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:11.816844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e89a8-0720-45b5-ab8e-29bc61aadd6e admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.817128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e89a8-0720-45b5-ab8e-29bc61aadd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.817456 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e89a8-0720-45b5-ab8e-29bc61aadd6e admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.819106 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e89a8-0720-45b5-ab8e-29bc61aadd6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:11.824713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e89a8-0720-45b5-ab8e-29bc61aadd6e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:11.827355 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2afc3-8cb8-4eff-83bb-81bbe7bbc3ff admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:11.833561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e2d74-7c3b-49f0-841b-d2b4ccda2151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:11.834419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2d74-7c3b-49f0-841b-d2b4ccda2151 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.834695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2d74-7c3b-49f0-841b-d2b4ccda2151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.835025 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2d74-7c3b-49f0-841b-d2b4ccda2151 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.837359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e2d74-7c3b-49f0-841b-d2b4ccda2151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:11.844607 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e2d74-7c3b-49f0-841b-d2b4ccda2151 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:11.883840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 978/1958] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:11 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:11.897272 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e89a8-0720-45b5-ab8e-29bc61aadd6e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:11.918028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 981/1959] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:11 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:55:11.924049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e2d74-7c3b-49f0-841b-d2b4ccda2151 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:11.927343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e89a8-0720-45b5-ab8e-29bc61aadd6e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:12.015468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:12.041953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e01e7-1813-4191-b6b2-e51029b62369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:12.043155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e01e7-1813-4191-b6b2-e51029b62369 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.043434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e01e7-1813-4191-b6b2-e51029b62369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.043706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e01e7-1813-4191-b6b2-e51029b62369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:12.044354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e01e7-1813-4191-b6b2-e51029b62369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:12.046456 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e01e7-1813-4191-b6b2-e51029b62369 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:12.053241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e2d74-7c3b-49f0-841b-d2b4ccda2151 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:12.060433 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 979/1960] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:12.062793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e01e7-1813-4191-b6b2-e51029b62369 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:12.066102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef73cbe-da1a-485e-9ea7-4767db8ca7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:12.067021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef73cbe-da1a-485e-9ea7-4767db8ca7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.067506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef73cbe-da1a-485e-9ea7-4767db8ca7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.067999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef73cbe-da1a-485e-9ea7-4767db8ca7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:12.068880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef73cbe-da1a-485e-9ea7-4767db8ca7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:12.071691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef73cbe-da1a-485e-9ea7-4767db8ca7f7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:12.081450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e01e7-1813-4191-b6b2-e51029b62369 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:12.096885 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fc997-bf56-4da6-8bc7-f1f358ff0dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:12.098899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fc997-bf56-4da6-8bc7-f1f358ff0dea admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.099557 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fc997-bf56-4da6-8bc7-f1f358ff0dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.100630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fc997-bf56-4da6-8bc7-f1f358ff0dea admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:12.103866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fc997-bf56-4da6-8bc7-f1f358ff0dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:12.108629 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fc997-bf56-4da6-8bc7-f1f358ff0dea admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:12.112972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 982/1961] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:11 2022] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:55:12.117235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef73cbe-da1a-485e-9ea7-4767db8ca7f7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:12.131013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:12.144295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 980/1962] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:12.145941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fc997-bf56-4da6-8bc7-f1f358ff0dea admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:12.147652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef73cbe-da1a-485e-9ea7-4767db8ca7f7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:12.154362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d1a50-f1dd-4ca1-babb-1186b66572dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:12.155311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d1a50-f1dd-4ca1-babb-1186b66572dc admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.155700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d1a50-f1dd-4ca1-babb-1186b66572dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.156045 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d1a50-f1dd-4ca1-babb-1186b66572dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:12.157041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d1a50-f1dd-4ca1-babb-1186b66572dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:12.159258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d1a50-f1dd-4ca1-babb-1186b66572dc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:12.170644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fc997-bf56-4da6-8bc7-f1f358ff0dea admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:12.174889 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 983/1963] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:12.182041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fca740-ada3-4d4a-b090-32259e9ce4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:12.183644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fca740-ada3-4d4a-b090-32259e9ce4bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.183644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fca740-ada3-4d4a-b090-32259e9ce4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.183929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fca740-ada3-4d4a-b090-32259e9ce4bb admin admin] PATH_INFO: `/v3/projects/3f90c3762e5b4b90b9f09b6584db20fe/users/2e56a0d24c8249ae86243b25d0faa59e/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:12.186971 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d1a50-f1dd-4ca1-babb-1186b66572dc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:12.203484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d1a50-f1dd-4ca1-babb-1186b66572dc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:12.204025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fca740-ada3-4d4a-b090-32259e9ce4bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f90c3762e5b4b90b9f09b6584db20fe, user_id=2e56a0d24c8249ae86243b25d0faa59e, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:12.206884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fca740-ada3-4d4a-b090-32259e9ce4bb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:12.213743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228b02d-f9fb-40b4-a3f3-7a2e897a7e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:12.214625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228b02d-f9fb-40b4-a3f3-7a2e897a7e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.215425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228b02d-f9fb-40b4-a3f3-7a2e897a7e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.215708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228b02d-f9fb-40b4-a3f3-7a2e897a7e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:12.216366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228b02d-f9fb-40b4-a3f3-7a2e897a7e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:12.219871 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228b02d-f9fb-40b4-a3f3-7a2e897a7e1a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:12.225234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 981/1964] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:12 2022] PUT /identity/v3/projects/3f90c3762e5b4b90b9f09b6584db20fe/users/2e56a0d24c8249ae86243b25d0faa59e/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:12.236450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc94081-2cbc-4df9-a508-f42913ddad2b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.236779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc94081-2cbc-4df9-a508-f42913ddad2b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.237052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc94081-2cbc-4df9-a508-f42913ddad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:12.245270 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 984/1965] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:12.251239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228b02d-f9fb-40b4-a3f3-7a2e897a7e1a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:12.275783 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228b02d-f9fb-40b4-a3f3-7a2e897a7e1a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:12.292628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ccc94081-2cbc-4df9-a508-f42913ddad2b None None] MFA Rules not processed for user `2e56a0d24c8249ae86243b25d0faa59e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:12.294009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ccc94081-2cbc-4df9-a508-f42913ddad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:12.384450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a1a94-dcda-4874-ab64-0f5811f9793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:12.385368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a1a94-dcda-4874-ab64-0f5811f9793a admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.385818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a1a94-dcda-4874-ab64-0f5811f9793a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.386265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a1a94-dcda-4874-ab64-0f5811f9793a admin admin] PATH_INFO: `/v3/projects/4e83ff0f5b4b49d7a05b32ef0d2a7aa6/users/f7bf5330c5f64d1986ba68f21ee4f05a/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:12.410352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a1a94-dcda-4874-ab64-0f5811f9793a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e83ff0f5b4b49d7a05b32ef0d2a7aa6, user_id=f7bf5330c5f64d1986ba68f21ee4f05a, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:12.413339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a1a94-dcda-4874-ab64-0f5811f9793a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:12.436566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 985/1966] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:12 2022] PUT /identity/v3/projects/4e83ff0f5b4b49d7a05b32ef0d2a7aa6/users/f7bf5330c5f64d1986ba68f21ee4f05a/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:12.438352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 982/1967] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:12.443512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a1a94-dcda-4874-ab64-0f5811f9793a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:12.448725 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e464150-9d53-490b-a00e-1ce3e1723181 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.449325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e464150-9d53-490b-a00e-1ce3e1723181 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.449761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e464150-9d53-490b-a00e-1ce3e1723181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:12.521275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9e464150-9d53-490b-a00e-1ce3e1723181 None None] MFA Rules not processed for user `f7bf5330c5f64d1986ba68f21ee4f05a`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:12.522964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9e464150-9d53-490b-a00e-1ce3e1723181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:12.562417 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a1a94-dcda-4874-ab64-0f5811f9793a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:12.569546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5339c77-a2fc-4926-b475-7b14194da844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:12.570484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5339c77-a2fc-4926-b475-7b14194da844 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.570708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5339c77-a2fc-4926-b475-7b14194da844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.571101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5339c77-a2fc-4926-b475-7b14194da844 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:12.572028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5339c77-a2fc-4926-b475-7b14194da844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:12.574292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5339c77-a2fc-4926-b475-7b14194da844 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:12.620260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 986/1968] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:12 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:12.628286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5339c77-a2fc-4926-b475-7b14194da844 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:12.704074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 983/1969] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:12.750190 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:12.774387 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5339c77-a2fc-4926-b475-7b14194da844 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:12.775497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e464150-9d53-490b-a00e-1ce3e1723181 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:12.778850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9e464150-9d53-490b-a00e-1ce3e1723181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:12.783236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584b27c-ae1a-4cd7-aaf2-1562831291b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:12.785358 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584b27c-ae1a-4cd7-aaf2-1562831291b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.785801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584b27c-ae1a-4cd7-aaf2-1562831291b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.786213 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584b27c-ae1a-4cd7-aaf2-1562831291b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:12.787953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584b27c-ae1a-4cd7-aaf2-1562831291b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:12.790522 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584b27c-ae1a-4cd7-aaf2-1562831291b7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:12.828760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 987/1970] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:12 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:12.832917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584b27c-ae1a-4cd7-aaf2-1562831291b7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:12.849770 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584b27c-ae1a-4cd7-aaf2-1562831291b7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:12.850313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:12.858233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00692d4-c8fc-482d-9688-49c8c5b23b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:12.859204 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00692d4-c8fc-482d-9688-49c8c5b23b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.859849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00692d4-c8fc-482d-9688-49c8c5b23b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.860366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00692d4-c8fc-482d-9688-49c8c5b23b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:12.861143 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00692d4-c8fc-482d-9688-49c8c5b23b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:12.863575 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00692d4-c8fc-482d-9688-49c8c5b23b82 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:12.883981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 988/1971] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:12.888710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00692d4-c8fc-482d-9688-49c8c5b23b82 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:12.905991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00692d4-c8fc-482d-9688-49c8c5b23b82 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:12.912242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf6a35-ed80-46c2-a9d3-1913a75a9dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:12.913293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf6a35-ed80-46c2-a9d3-1913a75a9dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.914373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf6a35-ed80-46c2-a9d3-1913a75a9dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.914820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf6a35-ed80-46c2-a9d3-1913a75a9dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:12.915580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf6a35-ed80-46c2-a9d3-1913a75a9dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:12.917903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf6a35-ed80-46c2-a9d3-1913a75a9dc5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:12.921779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e464150-9d53-490b-a00e-1ce3e1723181 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:12.931683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 989/1972] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:12.936010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf6a35-ed80-46c2-a9d3-1913a75a9dc5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:12.956652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf6a35-ed80-46c2-a9d3-1913a75a9dc5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:12.964664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d153b-4e62-4c29-a07e-232fc258f2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:12.965529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d153b-4e62-4c29-a07e-232fc258f2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:12.965915 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d153b-4e62-4c29-a07e-232fc258f2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:12.966623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d153b-4e62-4c29-a07e-232fc258f2ed admin admin] PATH_INFO: `/v3/projects/f73d51442303432598683dcf40ca9823/users/7bb3980978904e18909318804c3b3a21/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:13.003936 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d153b-4e62-4c29-a07e-232fc258f2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73d51442303432598683dcf40ca9823, user_id=7bb3980978904e18909318804c3b3a21, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:13.010951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d153b-4e62-4c29-a07e-232fc258f2ed admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:13.046270 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 990/1973] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:12 2022] PUT /identity/v3/projects/f73d51442303432598683dcf40ca9823/users/7bb3980978904e18909318804c3b3a21/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:13.053122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9337cb4-76c4-41ef-89b0-7cf0bbe97d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:13.053999 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9337cb4-76c4-41ef-89b0-7cf0bbe97d66 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:13.054327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9337cb4-76c4-41ef-89b0-7cf0bbe97d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:13.054799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9337cb4-76c4-41ef-89b0-7cf0bbe97d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:13.058456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a985-9124-44f4-9f5f-8ceb70b83f52 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:13.059116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a985-9124-44f4-9f5f-8ceb70b83f52 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:13.059828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a985-9124-44f4-9f5f-8ceb70b83f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:13.179799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-90e9a985-9124-44f4-9f5f-8ceb70b83f52 None None] MFA Rules not processed for user `7bb3980978904e18909318804c3b3a21`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:13.182032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-90e9a985-9124-44f4-9f5f-8ceb70b83f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:13.275129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9337cb4-76c4-41ef-89b0-7cf0bbe97d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:13.278242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9337cb4-76c4-41ef-89b0-7cf0bbe97d66 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:13.293822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 984/1974] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:13.303934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 991/1975] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:55:13.308470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9337cb4-76c4-41ef-89b0-7cf0bbe97d66 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:13.330352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9337cb4-76c4-41ef-89b0-7cf0bbe97d66 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:13.461973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38321b-9866-4670-b261-fa705b271128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:13.462604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38321b-9866-4670-b261-fa705b271128 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:13.463760 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38321b-9866-4670-b261-fa705b271128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:13.464136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38321b-9866-4670-b261-fa705b271128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:13.465477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38321b-9866-4670-b261-fa705b271128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:13.468535 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38321b-9866-4670-b261-fa705b271128 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:13.512046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 985/1976] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:13 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:13.516084 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9a985-9124-44f4-9f5f-8ceb70b83f52 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:13.536089 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9a985-9124-44f4-9f5f-8ceb70b83f52 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:13.640384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe90e15-c792-4d2f-9e2f-ba98511a09fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:13.642912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe90e15-c792-4d2f-9e2f-ba98511a09fc admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:13.643477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe90e15-c792-4d2f-9e2f-ba98511a09fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:13.644119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe90e15-c792-4d2f-9e2f-ba98511a09fc admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:13.645190 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe90e15-c792-4d2f-9e2f-ba98511a09fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:13.647719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe90e15-c792-4d2f-9e2f-ba98511a09fc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:13.702749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 992/1977] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:13 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:13.706328 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38321b-9866-4670-b261-fa705b271128 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:13.720920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38321b-9866-4670-b261-fa705b271128 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:13.729536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd6cc7-01f8-4dd7-80c5-a3704905c3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:13.730630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd6cc7-01f8-4dd7-80c5-a3704905c3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:13.731771 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd6cc7-01f8-4dd7-80c5-a3704905c3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:13.732240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd6cc7-01f8-4dd7-80c5-a3704905c3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:13.733998 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd6cc7-01f8-4dd7-80c5-a3704905c3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:13.737885 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd6cc7-01f8-4dd7-80c5-a3704905c3e3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:13.762541 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 986/1978] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:13.764013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe90e15-c792-4d2f-9e2f-ba98511a09fc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:13.781657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe90e15-c792-4d2f-9e2f-ba98511a09fc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:13.788063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab47b7c-f226-48fb-9143-14f222601b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:13.788729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab47b7c-f226-48fb-9143-14f222601b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:13.789438 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab47b7c-f226-48fb-9143-14f222601b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:13.789825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab47b7c-f226-48fb-9143-14f222601b54 admin admin] PATH_INFO: `/v3/projects/e27e63d5705c496bbf8ac133fa3f8b5b/users/8d3b3ed3525e49869d9b779f503dc07c/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:13.805772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:13.837869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab47b7c-f226-48fb-9143-14f222601b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27e63d5705c496bbf8ac133fa3f8b5b, user_id=8d3b3ed3525e49869d9b779f503dc07c, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:13.844290 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab47b7c-f226-48fb-9143-14f222601b54 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:13.870960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 993/1979] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:13 2022] PUT /identity/v3/projects/e27e63d5705c496bbf8ac133fa3f8b5b/users/8d3b3ed3525e49869d9b779f503dc07c/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:13.872171 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd6cc7-01f8-4dd7-80c5-a3704905c3e3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:13.882165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd6cc7-01f8-4dd7-80c5-a3704905c3e3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:13.886091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:13.958380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712eb91-ec5c-46b9-8771-aa128df64824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:13.959516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712eb91-ec5c-46b9-8771-aa128df64824 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:13.960235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712eb91-ec5c-46b9-8771-aa128df64824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:13.960743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712eb91-ec5c-46b9-8771-aa128df64824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:13.961753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712eb91-ec5c-46b9-8771-aa128df64824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:13.964512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712eb91-ec5c-46b9-8771-aa128df64824 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:13.979055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 987/1980] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:13.983805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab47b7c-f226-48fb-9143-14f222601b54 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:14.001329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab47b7c-f226-48fb-9143-14f222601b54 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:14.006585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14de21b-4cb1-4391-8ea4-60c57801c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:14.007476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14de21b-4cb1-4391-8ea4-60c57801c916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:14.007933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14de21b-4cb1-4391-8ea4-60c57801c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:14.008209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14de21b-4cb1-4391-8ea4-60c57801c916 admin admin] PATH_INFO: `/v3/projects/e27e63d5705c496bbf8ac133fa3f8b5b/users/8d3b3ed3525e49869d9b779f503dc07c/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:14.010319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14de21b-4cb1-4391-8ea4-60c57801c916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27e63d5705c496bbf8ac133fa3f8b5b, user_id=8d3b3ed3525e49869d9b779f503dc07c, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:14.013354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14de21b-4cb1-4391-8ea4-60c57801c916 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:14.026306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 994/1981] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:13 2022] PUT /identity/v3/projects/e27e63d5705c496bbf8ac133fa3f8b5b/users/8d3b3ed3525e49869d9b779f503dc07c/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:14.037261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651866a-5c04-4601-889d-90a9db39bff2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:14.038166 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651866a-5c04-4601-889d-90a9db39bff2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:14.038917 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651866a-5c04-4601-889d-90a9db39bff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:14.095000 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6651866a-5c04-4601-889d-90a9db39bff2 None None] MFA Rules not processed for user `8d3b3ed3525e49869d9b779f503dc07c`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:14.096518 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6651866a-5c04-4601-889d-90a9db39bff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:14.186323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276295d-40eb-45fc-8b84-67f71554d92f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:14.187035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276295d-40eb-45fc-8b84-67f71554d92f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:14.188451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276295d-40eb-45fc-8b84-67f71554d92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:14.204821 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 988/1982] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:14.215865 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651866a-5c04-4601-889d-90a9db39bff2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:14.219544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6651866a-5c04-4601-889d-90a9db39bff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:14.231685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5276295d-40eb-45fc-8b84-67f71554d92f None None] MFA Rules not processed for user `98437e2bb9f445b4bfe6e95b9e5ae155`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:14.234600 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5276295d-40eb-45fc-8b84-67f71554d92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:14.303607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651866a-5c04-4601-889d-90a9db39bff2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:14.308530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eaf77-e092-4105-9622-913455577f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:14.309314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eaf77-e092-4105-9622-913455577f93 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:14.309739 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eaf77-e092-4105-9622-913455577f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:14.310158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eaf77-e092-4105-9622-913455577f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:14.363651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:14.374186 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 995/1983] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:55:14.380885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02230a8e-498e-4309-a430-0799396bcfd4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:14.381401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02230a8e-498e-4309-a430-0799396bcfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:14.381830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02230a8e-498e-4309-a430-0799396bcfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:14.409492 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54eaf77-e092-4105-9622-913455577f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:14.411691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54eaf77-e092-4105-9622-913455577f93 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:14.412299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-02230a8e-498e-4309-a430-0799396bcfd4 None None] MFA Rules not processed for user `22e068856a7d4b01bb390bba5507f4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:14.413685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-02230a8e-498e-4309-a430-0799396bcfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:14.438458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 989/1984] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:14.508645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 996/1985] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:14.519578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eaf77-e092-4105-9622-913455577f93 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:14.526086 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a54eaf77-e092-4105-9622-913455577f93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:14.651230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eaf77-e092-4105-9622-913455577f93 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:14.660716 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1ad59-b55a-4488-9bd1-6a8864c7d865 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:14.661562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1ad59-b55a-4488-9bd1-6a8864c7d865 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:14.661952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1ad59-b55a-4488-9bd1-6a8864c7d865 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:14.662567 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1ad59-b55a-4488-9bd1-6a8864c7d865 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:14.665271 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fce1ad59-b55a-4488-9bd1-6a8864c7d865 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:14.679328 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1ad59-b55a-4488-9bd1-6a8864c7d865 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:14.681704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1ad59-b55a-4488-9bd1-6a8864c7d865 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:14.703465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 990/1986] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:24.488974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=69,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:24.693313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=42 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:33.357825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02230a8e-498e-4309-a430-0799396bcfd4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:33.359375 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-02230a8e-498e-4309-a430-0799396bcfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:33.510559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02230a8e-498e-4309-a430-0799396bcfd4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:33.516707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:33.518132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:33.518589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:33.518899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] PATH_INFO: `/v3/users/3439217535e24f87940c16cfb71243db` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:33.520645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3439217535e24f87940c16cfb71243db)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:33.524074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:33.598483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3439217535e24f87940c16cfb71243db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:33.613590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3439217535e24f87940c16cfb71243db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:33.622449 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3439217535e24f87940c16cfb71243db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:33.634094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3439217535e24f87940c16cfb71243db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:33.637580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3439217535e24f87940c16cfb71243db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:33.649913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 997/1987] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:33 2022] DELETE /identity/v3/users/3439217535e24f87940c16cfb71243db => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:33.651926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959525b-53c8-4135-b032-a5714ff82b6e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:33.652388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959525b-53c8-4135-b032-a5714ff82b6e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:33.652469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959525b-53c8-4135-b032-a5714ff82b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:33.673819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-1959525b-53c8-4135-b032-a5714ff82b6e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:33.675097 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1959525b-53c8-4135-b032-a5714ff82b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:33.748728 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 991/1988] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:33.842322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:33.844458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:33.935875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615dda5-1c62-421a-a8ce-78a7a92a42fc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:33.939932 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf1355-6aed-42bb-8c56-e0977de756e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:33.940552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1355-6aed-42bb-8c56-e0977de756e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:33.940834 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1355-6aed-42bb-8c56-e0977de756e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:33.941108 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1355-6aed-42bb-8c56-e0977de756e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:33.951354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf1355-6aed-42bb-8c56-e0977de756e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:33.952746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf1355-6aed-42bb-8c56-e0977de756e3 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:33.964534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 998/1989] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:34.932518 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959525b-53c8-4135-b032-a5714ff82b6e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:34.934088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1959525b-53c8-4135-b032-a5714ff82b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:34.956531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959525b-53c8-4135-b032-a5714ff82b6e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:34.970386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:34.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:34.972249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:34.972603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] PATH_INFO: `/v3/users/d60c273b78fb46b4871ca07b65c19ecb` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:34.975706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60c273b78fb46b4871ca07b65c19ecb)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:34.978918 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:35.066239 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60c273b78fb46b4871ca07b65c19ecb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:35.067896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60c273b78fb46b4871ca07b65c19ecb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:35.079746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60c273b78fb46b4871ca07b65c19ecb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:35.090619 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60c273b78fb46b4871ca07b65c19ecb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:35.112992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60c273b78fb46b4871ca07b65c19ecb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:35.123329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 992/1990] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:34 2022] DELETE /identity/v3/users/d60c273b78fb46b4871ca07b65c19ecb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:35.127825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00ec75-d3d1-4aa4-b03b-32f7e6b06cde None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:35.128245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00ec75-d3d1-4aa4-b03b-32f7e6b06cde None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:35.128245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00ec75-d3d1-4aa4-b03b-32f7e6b06cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:35.165483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4a00ec75-d3d1-4aa4-b03b-32f7e6b06cde None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:35.167236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4a00ec75-d3d1-4aa4-b03b-32f7e6b06cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:35.186685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:35.255018 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 999/1991] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:35.294030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:35.295670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:35.394092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a577373-4d79-4d51-84b1-2365eaaf457f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:35.398037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930655f-c0a7-4cdb-934b-0493a6b2ef8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:35.398655 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930655f-c0a7-4cdb-934b-0493a6b2ef8f service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:35.399001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930655f-c0a7-4cdb-934b-0493a6b2ef8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:35.400497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930655f-c0a7-4cdb-934b-0493a6b2ef8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:35.410464 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930655f-c0a7-4cdb-934b-0493a6b2ef8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:35.411965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930655f-c0a7-4cdb-934b-0493a6b2ef8f service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:35.453414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 993/1992] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:36.232219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00ec75-d3d1-4aa4-b03b-32f7e6b06cde None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:36.234020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4a00ec75-d3d1-4aa4-b03b-32f7e6b06cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:36.247613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00ec75-d3d1-4aa4-b03b-32f7e6b06cde None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:36.259753 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:36.260503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:36.260856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:36.261201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] PATH_INFO: `/v3/projects/47660191b9d7481c8e0632e918f34f41` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:36.262437 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47660191b9d7481c8e0632e918f34f41)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:36.265727 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:36.313555 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930655f-c0a7-4cdb-934b-0493a6b2ef8f service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:36.316294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3930655f-c0a7-4cdb-934b-0493a6b2ef8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:36.336294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930655f-c0a7-4cdb-934b-0493a6b2ef8f service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:36.353065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:36.362247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47660191b9d7481c8e0632e918f34f41', 'request_id': 'req-7bf11888-5c6a-41d3-96a2-0cf070e90496'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.376966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47660191b9d7481c8e0632e918f34f41', 'request_id': 'req-7bf11888-5c6a-41d3-96a2-0cf070e90496'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.387398 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47660191b9d7481c8e0632e918f34f41', 'request_id': 'req-7bf11888-5c6a-41d3-96a2-0cf070e90496'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.409528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] The token cache is being invalidate because project 47660191b9d7481c8e0632e918f34f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:36.409823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.411008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.416099 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1000/1993] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:36 2022] DELETE /identity/v3/projects/47660191b9d7481c8e0632e918f34f41 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:36.419705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:36.421801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:36.431742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:36.432468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:36.432833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:36.433171 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] PATH_INFO: `/v3/projects/557dcef57af44bd09ba2c7d81efe6acf` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:36.434761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=557dcef57af44bd09ba2c7d81efe6acf)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:36.438012 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:36.508384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557dcef57af44bd09ba2c7d81efe6acf', 'request_id': 'req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.509608 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11888-5c6a-41d3-96a2-0cf070e90496 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:36.519557 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557dcef57af44bd09ba2c7d81efe6acf', 'request_id': 'req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.529608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557dcef57af44bd09ba2c7d81efe6acf', 'request_id': 'req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.559368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] The token cache is being invalidate because project 557dcef57af44bd09ba2c7d81efe6acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:36.561104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.563342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.573010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 994/1994] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:36 2022] DELETE /identity/v3/projects/557dcef57af44bd09ba2c7d81efe6acf => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:36.576469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:36.578578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:36.595545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:36.612696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:36.613714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:36.614054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:36.614408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] PATH_INFO: `/v3/users/b57e267f00e8464688721b2d2bfbca47` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:36.615668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57e267f00e8464688721b2d2bfbca47)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:36.618335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:36.674902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce24a2e-9e4b-4b7c-9c5b-89c36e336a06 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:36.691047 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:36.692164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:36.692688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:36.693514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] PATH_INFO: `/v3/users/0bada1b1c8d14e7495aae36a513540f2` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:36.695670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bada1b1c8d14e7495aae36a513540f2)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:36.699609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:36.717342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57e267f00e8464688721b2d2bfbca47'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.740166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57e267f00e8464688721b2d2bfbca47'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.771392 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57e267f00e8464688721b2d2bfbca47'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.789918 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57e267f00e8464688721b2d2bfbca47'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.791052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57e267f00e8464688721b2d2bfbca47'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.806594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1001/1995] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:36 2022] DELETE /identity/v3/users/b57e267f00e8464688721b2d2bfbca47 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:36.813149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bada1b1c8d14e7495aae36a513540f2'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.813940 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bada1b1c8d14e7495aae36a513540f2'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.816262 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:36.827124 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bada1b1c8d14e7495aae36a513540f2'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.839863 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bada1b1c8d14e7495aae36a513540f2'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.859087 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bada1b1c8d14e7495aae36a513540f2'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:36.871853 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 995/1996] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:36 2022] DELETE /identity/v3/users/0bada1b1c8d14e7495aae36a513540f2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:55:37.159664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:37.161702 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:37.255216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9045409-9fe8-486e-92fa-f1c08f0f13bb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:37.326100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:37.328943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:37.357231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdd76f-21d7-42c4-a8e5-01a77fab6fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:37.357585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdd76f-21d7-42c4-a8e5-01a77fab6fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:37.357856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdd76f-21d7-42c4-a8e5-01a77fab6fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:37.358123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdd76f-21d7-42c4-a8e5-01a77fab6fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:37.362604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a5fdd76f-21d7-42c4-a8e5-01a77fab6fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:37.413266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65ff20-f910-45f1-b171-266d2eb9fad1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:37.423320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:37.423986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:37.424272 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:37.424549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] PATH_INFO: `/v3/projects/1259a26272044d87bdc722210a4e47c0` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:37.425752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1259a26272044d87bdc722210a4e47c0)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:37.428251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:37.428474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:37.467028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdd76f-21d7-42c4-a8e5-01a77fab6fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:37.469456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdd76f-21d7-42c4-a8e5-01a77fab6fc1 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:37.487262 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1002/1997] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:37.508896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1259a26272044d87bdc722210a4e47c0', 'request_id': 'req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:37.525277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1259a26272044d87bdc722210a4e47c0', 'request_id': 'req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:37.536525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1259a26272044d87bdc722210a4e47c0', 'request_id': 'req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:37.557431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] The token cache is being invalidate because project 1259a26272044d87bdc722210a4e47c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:37.557787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:37.558363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:37.559916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 996/1998] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:37 2022] DELETE /identity/v3/projects/1259a26272044d87bdc722210a4e47c0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:37.565227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e7cc-1dad-4db1-bc33-716be6f67341 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:37.565586 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e7cc-1dad-4db1-bc33-716be6f67341 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:37.565920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e7cc-1dad-4db1-bc33-716be6f67341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:37.592099 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5111e7cc-1dad-4db1-bc33-716be6f67341 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:37.593392 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5111e7cc-1dad-4db1-bc33-716be6f67341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:37.622088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:37.625156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:37.703740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1003/1999] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:37.711061 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d1f48-a814-4ba4-a585-3ff664b4c168 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:37.711472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d1f48-a814-4ba4-a585-3ff664b4c168 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:37.711828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d1f48-a814-4ba4-a585-3ff664b4c168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:37.742876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-881d1f48-a814-4ba4-a585-3ff664b4c168 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:37.744634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-881d1f48-a814-4ba4-a585-3ff664b4c168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:37.745635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:37.752584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf63f5-8cae-401a-acdf-a55c7d2906f9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:37.756782 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1004/2000] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:55:37.761160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d1f48-a814-4ba4-a585-3ff664b4c168 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:37.762866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4629be-06ea-4432-95c3-5e97c1d350d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:37.763889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4629be-06ea-4432-95c3-5e97c1d350d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:37.764008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4629be-06ea-4432-95c3-5e97c1d350d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:37.764282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4629be-06ea-4432-95c3-5e97c1d350d9 admin admin] PATH_INFO: `/v3/projects/b27466fa761d4b6f828b191c1acc6217` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:37.765703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4629be-06ea-4432-95c3-5e97c1d350d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27466fa761d4b6f828b191c1acc6217)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:37.770152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4629be-06ea-4432-95c3-5e97c1d350d9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:37.774313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d1f48-a814-4ba4-a585-3ff664b4c168 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:37.780257 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b03f-2df8-49a0-95df-4751b43ff84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:37.781022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b03f-2df8-49a0-95df-4751b43ff84c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:37.781362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b03f-2df8-49a0-95df-4751b43ff84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:37.781701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b03f-2df8-49a0-95df-4751b43ff84c admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:37.782472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b03f-2df8-49a0-95df-4751b43ff84c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:55:37.783503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b03f-2df8-49a0-95df-4751b43ff84c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:37.785415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b03f-2df8-49a0-95df-4751b43ff84c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:37.813535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1005/2001] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:55:37.818898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b03f-2df8-49a0-95df-4751b43ff84c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:37.834016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b03f-2df8-49a0-95df-4751b43ff84c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:37.841845 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64127b6d-9e02-4705-b6c3-19ab3eab2207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:37.842663 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64127b6d-9e02-4705-b6c3-19ab3eab2207 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:37.843278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64127b6d-9e02-4705-b6c3-19ab3eab2207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:37.843976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64127b6d-9e02-4705-b6c3-19ab3eab2207 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:37.846277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64127b6d-9e02-4705-b6c3-19ab3eab2207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:37.849574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64127b6d-9e02-4705-b6c3-19ab3eab2207 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:37.856595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc4629be-06ea-4432-95c3-5e97c1d350d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27466fa761d4b6f828b191c1acc6217', 'request_id': 'req-dc4629be-06ea-4432-95c3-5e97c1d350d9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:37.866190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc4629be-06ea-4432-95c3-5e97c1d350d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27466fa761d4b6f828b191c1acc6217', 'request_id': 'req-dc4629be-06ea-4432-95c3-5e97c1d350d9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:37.877898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc4629be-06ea-4432-95c3-5e97c1d350d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27466fa761d4b6f828b191c1acc6217', 'request_id': 'req-dc4629be-06ea-4432-95c3-5e97c1d350d9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:37.903671 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc4629be-06ea-4432-95c3-5e97c1d350d9 admin admin] The token cache is being invalidate because project b27466fa761d4b6f828b191c1acc6217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:37.903671 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc4629be-06ea-4432-95c3-5e97c1d350d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:37.904450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc4629be-06ea-4432-95c3-5e97c1d350d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:37.905600 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1006/2002] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:37 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:37.906457 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 997/2003] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:37 2022] DELETE /identity/v3/projects/b27466fa761d4b6f828b191c1acc6217 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:37.907027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64127b6d-9e02-4705-b6c3-19ab3eab2207 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:37.909612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-64127b6d-9e02-4705-b6c3-19ab3eab2207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:37.912030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35381c-ca9d-4577-a993-b7f55ca51230 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:37.912425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35381c-ca9d-4577-a993-b7f55ca51230 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:37.913329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35381c-ca9d-4577-a993-b7f55ca51230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:37.946223 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2e35381c-ca9d-4577-a993-b7f55ca51230 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:37.951703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2e35381c-ca9d-4577-a993-b7f55ca51230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:38.029165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 998/2004] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:38.036845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045db819-77a4-4e41-99d2-58a7e46a5ed9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.037413 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045db819-77a4-4e41-99d2-58a7e46a5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.038007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045db819-77a4-4e41-99d2-58a7e46a5ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.063172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-045db819-77a4-4e41-99d2-58a7e46a5ed9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:38.064530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-045db819-77a4-4e41-99d2-58a7e46a5ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:38.079050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 999/2005] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:55:38.082658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045db819-77a4-4e41-99d2-58a7e46a5ed9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:38.100932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045db819-77a4-4e41-99d2-58a7e46a5ed9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:38.117564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08f12e-1978-4c6e-b619-bc1e2313ee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:38.118185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08f12e-1978-4c6e-b619-bc1e2313ee79 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.118496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08f12e-1978-4c6e-b619-bc1e2313ee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.118944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08f12e-1978-4c6e-b619-bc1e2313ee79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.119596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08f12e-1978-4c6e-b619-bc1e2313ee79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:55:38.119896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08f12e-1978-4c6e-b619-bc1e2313ee79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:38.125530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64127b6d-9e02-4705-b6c3-19ab3eab2207 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:38.127332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08f12e-1978-4c6e-b619-bc1e2313ee79 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:38.130374 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b6878-17b6-41f9-9b34-6d00c73125fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:38.131773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b6878-17b6-41f9-9b34-6d00c73125fc admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.132048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b6878-17b6-41f9-9b34-6d00c73125fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.132817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b6878-17b6-41f9-9b34-6d00c73125fc admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.132984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b6878-17b6-41f9-9b34-6d00c73125fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:38.135923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b6878-17b6-41f9-9b34-6d00c73125fc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:38.156292 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1000/2006] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:55:38.157589 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08f12e-1978-4c6e-b619-bc1e2313ee79 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:38.177612 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08f12e-1978-4c6e-b619-bc1e2313ee79 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:38.195877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7706b9d-4f48-4341-8370-98d258fbfe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:38.195877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7706b9d-4f48-4341-8370-98d258fbfe63 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.195877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7706b9d-4f48-4341-8370-98d258fbfe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.195877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7706b9d-4f48-4341-8370-98d258fbfe63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.196817 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7706b9d-4f48-4341-8370-98d258fbfe63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:38.197791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1007/2007] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:37 2022] POST /identity/v3/users => generated 286 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:38.200916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7706b9d-4f48-4341-8370-98d258fbfe63 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:38.202021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b6878-17b6-41f9-9b34-6d00c73125fc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:38.234344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b6878-17b6-41f9-9b34-6d00c73125fc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:38.248577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1001/2008] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:38 2022] POST /identity/v3/projects => generated 391 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:38.249669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7706b9d-4f48-4341-8370-98d258fbfe63 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:38.250248 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84ff2b-5bd7-417a-9059-dfcee222db70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:38.250899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84ff2b-5bd7-417a-9059-dfcee222db70 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.251180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84ff2b-5bd7-417a-9059-dfcee222db70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.251451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84ff2b-5bd7-417a-9059-dfcee222db70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.252099 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84ff2b-5bd7-417a-9059-dfcee222db70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:38.253732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84ff2b-5bd7-417a-9059-dfcee222db70 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:38.281769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1008/2009] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:38.283828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84ff2b-5bd7-417a-9059-dfcee222db70 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:38.312687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84ff2b-5bd7-417a-9059-dfcee222db70 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:38.342027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:38.358283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:38.390455 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7706b9d-4f48-4341-8370-98d258fbfe63 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:38.395666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef209c-2254-4e8d-9604-662107cb2330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:38.397370 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef209c-2254-4e8d-9604-662107cb2330 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.397653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef209c-2254-4e8d-9604-662107cb2330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.397925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef209c-2254-4e8d-9604-662107cb2330 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.398572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef209c-2254-4e8d-9604-662107cb2330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:38.400779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef209c-2254-4e8d-9604-662107cb2330 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:38.427462 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1002/2010] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:38 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:38.432342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef209c-2254-4e8d-9604-662107cb2330 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:38.446389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef209c-2254-4e8d-9604-662107cb2330 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:38.447829 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e10bd-192f-404a-858b-eb37d6d6c369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:38.448581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e10bd-192f-404a-858b-eb37d6d6c369 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.448960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e10bd-192f-404a-858b-eb37d6d6c369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.449689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e10bd-192f-404a-858b-eb37d6d6c369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.450066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e10bd-192f-404a-858b-eb37d6d6c369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:38.451848 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e10bd-192f-404a-858b-eb37d6d6c369 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:38.455652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed286d-db3d-4a5d-9bfb-4712bb03f289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:38.456452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed286d-db3d-4a5d-9bfb-4712bb03f289 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.456822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed286d-db3d-4a5d-9bfb-4712bb03f289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.457241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed286d-db3d-4a5d-9bfb-4712bb03f289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.458830 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed286d-db3d-4a5d-9bfb-4712bb03f289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:38.460509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed286d-db3d-4a5d-9bfb-4712bb03f289 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:38.463527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1009/2011] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:38.468220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e10bd-192f-404a-858b-eb37d6d6c369 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:38.475714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1003/2012] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:38.482244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed286d-db3d-4a5d-9bfb-4712bb03f289 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:38.488871 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e10bd-192f-404a-858b-eb37d6d6c369 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:38.498651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed286d-db3d-4a5d-9bfb-4712bb03f289 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:38.502153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493437c-7ca7-48e5-989f-19a8f74ef83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:38.503266 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493437c-7ca7-48e5-989f-19a8f74ef83a admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.503645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493437c-7ca7-48e5-989f-19a8f74ef83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.504006 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ba971-c50f-4349-97d0-91b137b7df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:38.504135 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493437c-7ca7-48e5-989f-19a8f74ef83a admin admin] PATH_INFO: `/v3/projects/64ab795115ba430fb79d14721f110ffd/users/e280f149c1f4424ca9202bd9447d8989/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.504610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba971-c50f-4349-97d0-91b137b7df26 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.504889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba971-c50f-4349-97d0-91b137b7df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.505159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba971-c50f-4349-97d0-91b137b7df26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.505801 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ba971-c50f-4349-97d0-91b137b7df26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:38.507426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ba971-c50f-4349-97d0-91b137b7df26 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:38.523281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1004/2013] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:38.525289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ba971-c50f-4349-97d0-91b137b7df26 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:38.529593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493437c-7ca7-48e5-989f-19a8f74ef83a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ab795115ba430fb79d14721f110ffd, user_id=e280f149c1f4424ca9202bd9447d8989, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:38.533096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493437c-7ca7-48e5-989f-19a8f74ef83a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:38.537865 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ba971-c50f-4349-97d0-91b137b7df26 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:38.543838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6e03c-5900-4b4b-a1db-17cfee9dee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:38.545029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6e03c-5900-4b4b-a1db-17cfee9dee7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.547112 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6e03c-5900-4b4b-a1db-17cfee9dee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.547546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6e03c-5900-4b4b-a1db-17cfee9dee7e admin admin] PATH_INFO: `/v3/projects/37047a927a794820a0d5fa5949c7cb6b/users/4661062f4be140fe8f183d4608df3589/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.557749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1010/2014] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:38 2022] PUT /identity/v3/projects/64ab795115ba430fb79d14721f110ffd/users/e280f149c1f4424ca9202bd9447d8989/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:55:38.570807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5620d-06a0-4105-a723-63f323c6d3b1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.572708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5620d-06a0-4105-a723-63f323c6d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.573308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5620d-06a0-4105-a723-63f323c6d3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.584532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6e03c-5900-4b4b-a1db-17cfee9dee7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37047a927a794820a0d5fa5949c7cb6b, user_id=4661062f4be140fe8f183d4608df3589, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:38.589545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6e03c-5900-4b4b-a1db-17cfee9dee7e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:38.611729 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1005/2015] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:38 2022] PUT /identity/v3/projects/37047a927a794820a0d5fa5949c7cb6b/users/4661062f4be140fe8f183d4608df3589/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:38.623117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f8355-3af8-48b9-b3ce-929dce1b5a49 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.623672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f8355-3af8-48b9-b3ce-929dce1b5a49 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.624540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f8355-3af8-48b9-b3ce-929dce1b5a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.626054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-dbb5620d-06a0-4105-a723-63f323c6d3b1 None None] MFA Rules not processed for user `e280f149c1f4424ca9202bd9447d8989`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:38.628059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dbb5620d-06a0-4105-a723-63f323c6d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:38.698174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-684f8355-3af8-48b9-b3ce-929dce1b5a49 None None] MFA Rules not processed for user `4661062f4be140fe8f183d4608df3589`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:38.701237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-684f8355-3af8-48b9-b3ce-929dce1b5a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:38.737345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1011/2016] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:38.741410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5620d-06a0-4105-a723-63f323c6d3b1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:38.847977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1006/2017] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:55:38.851958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f8355-3af8-48b9-b3ce-929dce1b5a49 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:38.928330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5620d-06a0-4105-a723-63f323c6d3b1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:38.940043 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a580cb-bf38-427a-848b-ff311ea5d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:38.941830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a580cb-bf38-427a-848b-ff311ea5d9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.941830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a580cb-bf38-427a-848b-ff311ea5d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.941830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a580cb-bf38-427a-848b-ff311ea5d9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.942282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a580cb-bf38-427a-848b-ff311ea5d9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:38.944767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a580cb-bf38-427a-848b-ff311ea5d9b5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:38.964779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f8355-3af8-48b9-b3ce-929dce1b5a49 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:38.972931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c2b81-1e15-4649-b86c-79a2178fd51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:38.973937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c2b81-1e15-4649-b86c-79a2178fd51c admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.974261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c2b81-1e15-4649-b86c-79a2178fd51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.974964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c2b81-1e15-4649-b86c-79a2178fd51c admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.975930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c2b81-1e15-4649-b86c-79a2178fd51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:38.979912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c2b81-1e15-4649-b86c-79a2178fd51c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:39.010553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1012/2018] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:38 2022] POST /identity/v3/projects => generated 371 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:39.013596 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a580cb-bf38-427a-848b-ff311ea5d9b5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:39.034218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1007/2019] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:38 2022] POST /identity/v3/projects => generated 391 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:39.035595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c2b81-1e15-4649-b86c-79a2178fd51c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:39.041892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:39.042592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:39.150889 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a580cb-bf38-427a-848b-ff311ea5d9b5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:39.234924 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c2b81-1e15-4649-b86c-79a2178fd51c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:39.241572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc30f2b-374c-4dc8-b4c4-d4ea989675b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:39.242585 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc30f2b-374c-4dc8-b4c4-d4ea989675b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.243083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc30f2b-374c-4dc8-b4c4-d4ea989675b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.244122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc30f2b-374c-4dc8-b4c4-d4ea989675b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.244945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc30f2b-374c-4dc8-b4c4-d4ea989675b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:39.247322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc30f2b-374c-4dc8-b4c4-d4ea989675b8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:39.253139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13743037-d12b-4afb-8b92-dcb57f9a4a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:39.253971 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743037-d12b-4afb-8b92-dcb57f9a4a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.254357 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743037-d12b-4afb-8b92-dcb57f9a4a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.254752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743037-d12b-4afb-8b92-dcb57f9a4a8c admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.257601 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13743037-d12b-4afb-8b92-dcb57f9a4a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:39.262188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13743037-d12b-4afb-8b92-dcb57f9a4a8c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:39.299116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1008/2020] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:39 2022] POST /identity/v3/users => generated 302 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:39.303631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc30f2b-374c-4dc8-b4c4-d4ea989675b8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:39.313846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1013/2021] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:39 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:39.317341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13743037-d12b-4afb-8b92-dcb57f9a4a8c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:39.323043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc30f2b-374c-4dc8-b4c4-d4ea989675b8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:39.328816 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490d990-b6d1-4cf6-9449-269e9d8c2bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:39.329799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490d990-b6d1-4cf6-9449-269e9d8c2bec admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.330222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490d990-b6d1-4cf6-9449-269e9d8c2bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.331024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490d990-b6d1-4cf6-9449-269e9d8c2bec admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.331956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490d990-b6d1-4cf6-9449-269e9d8c2bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:39.333905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490d990-b6d1-4cf6-9449-269e9d8c2bec admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:39.340837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13743037-d12b-4afb-8b92-dcb57f9a4a8c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:39.355156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1009/2022] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:39.356497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490d990-b6d1-4cf6-9449-269e9d8c2bec admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:39.357151 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae2eec-d083-4678-8bbb-ff44d348c058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:39.357817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae2eec-d083-4678-8bbb-ff44d348c058 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.358054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae2eec-d083-4678-8bbb-ff44d348c058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.358327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae2eec-d083-4678-8bbb-ff44d348c058 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.359009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae2eec-d083-4678-8bbb-ff44d348c058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:39.360623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae2eec-d083-4678-8bbb-ff44d348c058 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:39.376992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490d990-b6d1-4cf6-9449-269e9d8c2bec admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:39.384144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1014/2023] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:39.385368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae2eec-d083-4678-8bbb-ff44d348c058 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:39.390078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f5378-23fd-48e9-9400-ff7033d94c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:39.390819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f5378-23fd-48e9-9400-ff7033d94c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.391358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f5378-23fd-48e9-9400-ff7033d94c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.391520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f5378-23fd-48e9-9400-ff7033d94c41 admin admin] PATH_INFO: `/v3/projects/d813fb929b8f41d198cfc8729d3f28f7/users/61ebf58338504ccf8c05226a569e140a/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.405483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae2eec-d083-4678-8bbb-ff44d348c058 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:39.413403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88f8cb-372a-4a5c-a5e6-c8f16aee55e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:39.414530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f8cb-372a-4a5c-a5e6-c8f16aee55e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.415169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f8cb-372a-4a5c-a5e6-c8f16aee55e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.416237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f8cb-372a-4a5c-a5e6-c8f16aee55e9 admin admin] PATH_INFO: `/v3/projects/b0e2e2a3ddb2464fbcb3bf3800c6fb25/users/cc2142db60694e9da84b1f585839e352/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.437324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f5378-23fd-48e9-9400-ff7033d94c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d813fb929b8f41d198cfc8729d3f28f7, user_id=61ebf58338504ccf8c05226a569e140a, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:39.439350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88f8cb-372a-4a5c-a5e6-c8f16aee55e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e2e2a3ddb2464fbcb3bf3800c6fb25, user_id=cc2142db60694e9da84b1f585839e352, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:39.440121 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f5378-23fd-48e9-9400-ff7033d94c41 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:39.443673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88f8cb-372a-4a5c-a5e6-c8f16aee55e9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:39.468914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1010/2024] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:39 2022] PUT /identity/v3/projects/d813fb929b8f41d198cfc8729d3f28f7/users/61ebf58338504ccf8c05226a569e140a/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:39.470721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f5378-23fd-48e9-9400-ff7033d94c41 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:39.476817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1015/2025] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:39 2022] PUT /identity/v3/projects/b0e2e2a3ddb2464fbcb3bf3800c6fb25/users/cc2142db60694e9da84b1f585839e352/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:55:39.482079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88f8cb-372a-4a5c-a5e6-c8f16aee55e9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:39.566971 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88f8cb-372a-4a5c-a5e6-c8f16aee55e9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:39.575156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0b4d6-43fe-4317-bcf5-4224709e2ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:39.576473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0b4d6-43fe-4317-bcf5-4224709e2ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.576851 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0b4d6-43fe-4317-bcf5-4224709e2ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.577220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0b4d6-43fe-4317-bcf5-4224709e2ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.577977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0b4d6-43fe-4317-bcf5-4224709e2ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:39.580330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0b4d6-43fe-4317-bcf5-4224709e2ab3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:39.589599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:39.601162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1016/2026] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:39.602212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0b4d6-43fe-4317-bcf5-4224709e2ab3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:39.616344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0b4d6-43fe-4317-bcf5-4224709e2ab3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:39.622465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664798a3-e7f9-4cb8-8723-a01232e83f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:39.623480 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664798a3-e7f9-4cb8-8723-a01232e83f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.623868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664798a3-e7f9-4cb8-8723-a01232e83f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.624370 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664798a3-e7f9-4cb8-8723-a01232e83f70 admin admin] PATH_INFO: `/v3/projects/b0e2e2a3ddb2464fbcb3bf3800c6fb25/users/cc2142db60694e9da84b1f585839e352/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.627251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f5378-23fd-48e9-9400-ff7033d94c41 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:39.627631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664798a3-e7f9-4cb8-8723-a01232e83f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e2e2a3ddb2464fbcb3bf3800c6fb25, user_id=cc2142db60694e9da84b1f585839e352, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:39.630418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664798a3-e7f9-4cb8-8723-a01232e83f70 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:39.647906 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b60c9-aa1d-437b-bc81-711efc59a49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:39.648608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b60c9-aa1d-437b-bc81-711efc59a49b admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.648899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b60c9-aa1d-437b-bc81-711efc59a49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.649177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b60c9-aa1d-437b-bc81-711efc59a49b admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.650761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b60c9-aa1d-437b-bc81-711efc59a49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:39.652394 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b60c9-aa1d-437b-bc81-711efc59a49b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:39.655873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1017/2027] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:39 2022] PUT /identity/v3/projects/b0e2e2a3ddb2464fbcb3bf3800c6fb25/users/cc2142db60694e9da84b1f585839e352/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:39.657508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a74e75-6a3a-4fdd-b7d6-62a1049b5264 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.657907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a74e75-6a3a-4fdd-b7d6-62a1049b5264 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.658274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a74e75-6a3a-4fdd-b7d6-62a1049b5264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.680267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1011/2028] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:39.686641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b60c9-aa1d-437b-bc81-711efc59a49b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:39.701207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-09a74e75-6a3a-4fdd-b7d6-62a1049b5264 None None] MFA Rules not processed for user `cc2142db60694e9da84b1f585839e352`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:39.702524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-09a74e75-6a3a-4fdd-b7d6-62a1049b5264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:39.708098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b60c9-aa1d-437b-bc81-711efc59a49b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:39.824268 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:39.835105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1018/2029] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:39.839946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a74e75-6a3a-4fdd-b7d6-62a1049b5264 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:39.851160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a74e75-6a3a-4fdd-b7d6-62a1049b5264 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:39.856678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38431c4b-e505-4377-90e0-576f758694b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:39.857514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38431c4b-e505-4377-90e0-576f758694b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.857805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38431c4b-e505-4377-90e0-576f758694b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.858077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38431c4b-e505-4377-90e0-576f758694b4 admin admin] PATH_INFO: `/v3/projects/d813fb929b8f41d198cfc8729d3f28f7/users/61ebf58338504ccf8c05226a569e140a/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ba358-4234-4d44-b9c7-5174eac1ff50 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2142db60694e9da84b1f585839e352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0e2e2a3ddb2464fbcb3bf3800c6fb25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:39.859877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba358-4234-4d44-b9c7-5174eac1ff50 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.860262 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba358-4234-4d44-b9c7-5174eac1ff50 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.860637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba358-4234-4d44-b9c7-5174eac1ff50 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.861401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ba358-4234-4d44-b9c7-5174eac1ff50 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:55:39.861810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ba358-4234-4d44-b9c7-5174eac1ff50 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:39.862510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38431c4b-e505-4377-90e0-576f758694b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d813fb929b8f41d198cfc8729d3f28f7, user_id=61ebf58338504ccf8c05226a569e140a, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:39.865039 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ba358-4234-4d44-b9c7-5174eac1ff50 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:39.865747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38431c4b-e505-4377-90e0-576f758694b4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:39.881754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1019/2030] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:55:39.883402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1012/2031] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:39 2022] PUT /identity/v3/projects/d813fb929b8f41d198cfc8729d3f28f7/users/61ebf58338504ccf8c05226a569e140a/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:39.897588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85845eb4-d45c-4498-9522-07de35842fc1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.897879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85845eb4-d45c-4498-9522-07de35842fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.899059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38431c4b-e505-4377-90e0-576f758694b4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:39.899786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85845eb4-d45c-4498-9522-07de35842fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.974242 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-85845eb4-d45c-4498-9522-07de35842fc1 None None] MFA Rules not processed for user `61ebf58338504ccf8c05226a569e140a`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:39.981990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-85845eb4-d45c-4498-9522-07de35842fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:40.034628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38431c4b-e505-4377-90e0-576f758694b4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:40.045778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d5d36-0121-49aa-ad9a-f32d85704edc tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2142db60694e9da84b1f585839e352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0e2e2a3ddb2464fbcb3bf3800c6fb25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:40.046121 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5d36-0121-49aa-ad9a-f32d85704edc tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:40.049635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5d36-0121-49aa-ad9a-f32d85704edc tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:40.049949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5d36-0121-49aa-ad9a-f32d85704edc tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:40.050626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d5d36-0121-49aa-ad9a-f32d85704edc tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:40.052685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d5d36-0121-49aa-ad9a-f32d85704edc tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:40.100622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1013/2032] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:39 2022] POST /identity/v3/projects => generated 350 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:40.102219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d5d36-0121-49aa-ad9a-f32d85704edc tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:40.133383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1020/2033] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:39 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:40.197454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d5d36-0121-49aa-ad9a-f32d85704edc tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:40.204398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcaea6-ce4e-4d3f-80ba-cf23ca8e00ef tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2142db60694e9da84b1f585839e352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0e2e2a3ddb2464fbcb3bf3800c6fb25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:40.205201 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcaea6-ce4e-4d3f-80ba-cf23ca8e00ef tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:40.205576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcaea6-ce4e-4d3f-80ba-cf23ca8e00ef tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:40.205951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcaea6-ce4e-4d3f-80ba-cf23ca8e00ef tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:40.206713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcaea6-ce4e-4d3f-80ba-cf23ca8e00ef tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:55:40.207151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcaea6-ce4e-4d3f-80ba-cf23ca8e00ef tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:40.210019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcaea6-ce4e-4d3f-80ba-cf23ca8e00ef tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:40.245455 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1014/2034] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:55:40.258638 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85845eb4-d45c-4498-9522-07de35842fc1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:40.260683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-85845eb4-d45c-4498-9522-07de35842fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:40.288434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcaea6-ce4e-4d3f-80ba-cf23ca8e00ef tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:40.296510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2cbcaea6-ce4e-4d3f-80ba-cf23ca8e00ef tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:40.373650 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:40.402507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85845eb4-d45c-4498-9522-07de35842fc1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:40.409569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72051b-ead5-4090-978f-ac97f801268b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:40.410348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72051b-ead5-4090-978f-ac97f801268b service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:40.410843 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72051b-ead5-4090-978f-ac97f801268b service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:40.412209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72051b-ead5-4090-978f-ac97f801268b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:40.418889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcaea6-ce4e-4d3f-80ba-cf23ca8e00ef tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:40.432180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84152485-fe74-4574-b704-ab191179e6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:40.432987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84152485-fe74-4574-b704-ab191179e6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:40.433705 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84152485-fe74-4574-b704-ab191179e6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:40.434148 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84152485-fe74-4574-b704-ab191179e6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:40.450117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84152485-fe74-4574-b704-ab191179e6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:40.451634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84152485-fe74-4574-b704-ab191179e6f9 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:40.463741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1015/2035] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:55:40.539945 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72051b-ead5-4090-978f-ac97f801268b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:40.542957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72051b-ead5-4090-978f-ac97f801268b service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:40.562235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1021/2036] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:45.987966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84152485-fe74-4574-b704-ab191179e6f9 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:45.999056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84152485-fe74-4574-b704-ab191179e6f9 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:46.009382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2142db60694e9da84b1f585839e352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0e2e2a3ddb2464fbcb3bf3800c6fb25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:46.010471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:46.010903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:46.011281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] PATH_INFO: `/v3/projects/5f5a4454663d4db9bc58745c6029bd2f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:46.012867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5f5a4454663d4db9bc58745c6029bd2f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:46.015143 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:46.021191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:46.125635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5a4454663d4db9bc58745c6029bd2f', 'request_id': 'req-0842a3c8-502c-49f5-935f-da8f67f93788'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.135469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5a4454663d4db9bc58745c6029bd2f', 'request_id': 'req-0842a3c8-502c-49f5-935f-da8f67f93788'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.143860 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5a4454663d4db9bc58745c6029bd2f', 'request_id': 'req-0842a3c8-502c-49f5-935f-da8f67f93788'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.155590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72051b-ead5-4090-978f-ac97f801268b service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:46.174872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] The token cache is being invalidate because project 5f5a4454663d4db9bc58745c6029bd2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:46.175545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.177232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.179722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1016/2037] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:45 2022] DELETE /identity/v3/projects/5f5a4454663d4db9bc58745c6029bd2f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:46.184841 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:46.186642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:46.267819 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72051b-ead5-4090-978f-ac97f801268b service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:46.342666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842a3c8-502c-49f5-935f-da8f67f93788 tempest-QuotasNegativeTest-443789878 tempest-QuotasNegativeTest-443789878-project-admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:46.349864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9044d72-8edf-4c58-a068-1ba9e921d993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:46.350539 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9044d72-8edf-4c58-a068-1ba9e921d993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:46.350854 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9044d72-8edf-4c58-a068-1ba9e921d993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:46.351185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9044d72-8edf-4c58-a068-1ba9e921d993 admin admin] PATH_INFO: `/v3/users/e280f149c1f4424ca9202bd9447d8989` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:46.354275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9044d72-8edf-4c58-a068-1ba9e921d993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e280f149c1f4424ca9202bd9447d8989)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:46.356884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9044d72-8edf-4c58-a068-1ba9e921d993 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:46.366009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89377e04-9fe0-4f7a-8d75-8faabbbf4f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:46.370056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89377e04-9fe0-4f7a-8d75-8faabbbf4f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:46.370538 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89377e04-9fe0-4f7a-8d75-8faabbbf4f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:46.371000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89377e04-9fe0-4f7a-8d75-8faabbbf4f27 admin admin] PATH_INFO: `/v3/users/4661062f4be140fe8f183d4608df3589` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:46.372567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89377e04-9fe0-4f7a-8d75-8faabbbf4f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4661062f4be140fe8f183d4608df3589)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:46.375446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89377e04-9fe0-4f7a-8d75-8faabbbf4f27 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:46.449630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e9044d72-8edf-4c58-a068-1ba9e921d993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e280f149c1f4424ca9202bd9447d8989'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.450277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:46.450397 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e9044d72-8edf-4c58-a068-1ba9e921d993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e280f149c1f4424ca9202bd9447d8989'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.454964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-89377e04-9fe0-4f7a-8d75-8faabbbf4f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4661062f4be140fe8f183d4608df3589'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.459700 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e9044d72-8edf-4c58-a068-1ba9e921d993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e280f149c1f4424ca9202bd9447d8989'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.475099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e9044d72-8edf-4c58-a068-1ba9e921d993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e280f149c1f4424ca9202bd9447d8989'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.476812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-89377e04-9fe0-4f7a-8d75-8faabbbf4f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4661062f4be140fe8f183d4608df3589'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.490010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-89377e04-9fe0-4f7a-8d75-8faabbbf4f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4661062f4be140fe8f183d4608df3589'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.492331 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e9044d72-8edf-4c58-a068-1ba9e921d993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e280f149c1f4424ca9202bd9447d8989'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.502826 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-89377e04-9fe0-4f7a-8d75-8faabbbf4f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4661062f4be140fe8f183d4608df3589'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.503410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1017/2038] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:46 2022] DELETE /identity/v3/users/e280f149c1f4424ca9202bd9447d8989 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:46.503856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-89377e04-9fe0-4f7a-8d75-8faabbbf4f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4661062f4be140fe8f183d4608df3589'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:46.507743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1b65d-f30a-4cc9-8f40-7fb4a89524b4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:46.507955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1b65d-f30a-4cc9-8f40-7fb4a89524b4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:46.509082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1b65d-f30a-4cc9-8f40-7fb4a89524b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:46.516599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1022/2039] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:46 2022] DELETE /identity/v3/users/4661062f4be140fe8f183d4608df3589 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:46.521329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1454e-4027-4cb1-bf7a-3095b1b72686 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:46.521738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1454e-4027-4cb1-bf7a-3095b1b72686 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:46.522022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1454e-4027-4cb1-bf7a-3095b1b72686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:46.532624 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-51d1b65d-f30a-4cc9-8f40-7fb4a89524b4 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:46.534014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-51d1b65d-f30a-4cc9-8f40-7fb4a89524b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:46.542811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:46.543215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-90d1454e-4027-4cb1-bf7a-3095b1b72686 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:46.544717 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-90d1454e-4027-4cb1-bf7a-3095b1b72686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:46.613029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1018/2040] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:46.626214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1b65d-f30a-4cc9-8f40-7fb4a89524b4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:46.628129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-51d1b65d-f30a-4cc9-8f40-7fb4a89524b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:46.639005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1023/2041] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:46.652274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1454e-4027-4cb1-bf7a-3095b1b72686 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:46.653700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-90d1454e-4027-4cb1-bf7a-3095b1b72686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:46.711304 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1b65d-f30a-4cc9-8f40-7fb4a89524b4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:46.717973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0b34d-1a7e-4ee4-bb10-ab038cce222e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:46.721594 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0b34d-1a7e-4ee4-bb10-ab038cce222e service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:46.722237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0b34d-1a7e-4ee4-bb10-ab038cce222e service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:46.724460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0b34d-1a7e-4ee4-bb10-ab038cce222e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:46.736350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0b34d-1a7e-4ee4-bb10-ab038cce222e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:46.738107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0b34d-1a7e-4ee4-bb10-ab038cce222e service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:46.751631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1019/2042] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:46.758360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1454e-4027-4cb1-bf7a-3095b1b72686 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:46.762030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cab90a-cbd9-4cf0-bc89-946c5aec799e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:46.762647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cab90a-cbd9-4cf0-bc89-946c5aec799e service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:46.762951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cab90a-cbd9-4cf0-bc89-946c5aec799e service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:46.763220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cab90a-cbd9-4cf0-bc89-946c5aec799e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:46.773982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cab90a-cbd9-4cf0-bc89-946c5aec799e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:46.776587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cab90a-cbd9-4cf0-bc89-946c5aec799e service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:46.788012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1024/2043] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:47.921536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0b34d-1a7e-4ee4-bb10-ab038cce222e service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:47.923246 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b0c0b34d-1a7e-4ee4-bb10-ab038cce222e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:47.938909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0b34d-1a7e-4ee4-bb10-ab038cce222e service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:47.950156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:47.950484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.950798 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.951073 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] PATH_INFO: `/v3/projects/64ab795115ba430fb79d14721f110ffd` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.952301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ab795115ba430fb79d14721f110ffd)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:47.954275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:48.024623 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ab795115ba430fb79d14721f110ffd', 'request_id': 'req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.037848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ab795115ba430fb79d14721f110ffd', 'request_id': 'req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.063494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ab795115ba430fb79d14721f110ffd', 'request_id': 'req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.089635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] The token cache is being invalidate because project 64ab795115ba430fb79d14721f110ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:48.089928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.090689 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.096084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1020/2044] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:47 2022] DELETE /identity/v3/projects/64ab795115ba430fb79d14721f110ffd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:48.101096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cab90a-cbd9-4cf0-bc89-946c5aec799e service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:48.114586 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cab90a-cbd9-4cf0-bc89-946c5aec799e service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:48.154063 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:48.155791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:48.209759 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:48.210754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:48.211279 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:48.212422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] PATH_INFO: `/v3/users/cc2142db60694e9da84b1f585839e352` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:48.214198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2142db60694e9da84b1f585839e352)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:48.217325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:48.223478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:48.236716 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:48.273897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9ce6-7519-4a42-b74f-54c62a548b8e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:48.279893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:48.280773 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:48.281220 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:48.281605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] PATH_INFO: `/v3/projects/37047a927a794820a0d5fa5949c7cb6b` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:48.283006 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37047a927a794820a0d5fa5949c7cb6b)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:48.285084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:48.308004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2142db60694e9da84b1f585839e352'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.325840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2142db60694e9da84b1f585839e352'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.355826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37047a927a794820a0d5fa5949c7cb6b', 'request_id': 'req-bade77de-8a80-409e-9bcb-bdcbd879bb96'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.362422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2142db60694e9da84b1f585839e352'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.364968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37047a927a794820a0d5fa5949c7cb6b', 'request_id': 'req-bade77de-8a80-409e-9bcb-bdcbd879bb96'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.376155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37047a927a794820a0d5fa5949c7cb6b', 'request_id': 'req-bade77de-8a80-409e-9bcb-bdcbd879bb96'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.378354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2142db60694e9da84b1f585839e352'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.380519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2142db60694e9da84b1f585839e352'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.399895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1025/2045] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:48 2022] DELETE /identity/v3/users/cc2142db60694e9da84b1f585839e352 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:48.400486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] The token cache is being invalidate because project 37047a927a794820a0d5fa5949c7cb6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:48.400931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.402865 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.405750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1021/2046] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:48 2022] DELETE /identity/v3/projects/37047a927a794820a0d5fa5949c7cb6b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:48.409667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:48.411571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:48.510983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccb527-064b-4c61-b39a-52730d734dc2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:48.516447 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:48.517696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:48.518192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:48.518610 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] PATH_INFO: `/v3/users/61ebf58338504ccf8c05226a569e140a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:48.519873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ebf58338504ccf8c05226a569e140a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:48.522063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:48.603249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ebf58338504ccf8c05226a569e140a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.630331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ebf58338504ccf8c05226a569e140a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.647195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ebf58338504ccf8c05226a569e140a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.671510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ebf58338504ccf8c05226a569e140a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.672650 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ebf58338504ccf8c05226a569e140a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:48.682842 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1026/2047] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:48 2022] DELETE /identity/v3/users/61ebf58338504ccf8c05226a569e140a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:49.562523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:49.564542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:49.714174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade77de-8a80-409e-9bcb-bdcbd879bb96 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:49.826911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c104c6-8168-4e51-88df-5d75dd4ba543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:49.827700 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c104c6-8168-4e51-88df-5d75dd4ba543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:49.828408 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c104c6-8168-4e51-88df-5d75dd4ba543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:49.830452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c104c6-8168-4e51-88df-5d75dd4ba543 admin admin] PATH_INFO: `/v3/projects/d813fb929b8f41d198cfc8729d3f28f7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:49.831765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c104c6-8168-4e51-88df-5d75dd4ba543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d813fb929b8f41d198cfc8729d3f28f7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:49.834971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c104c6-8168-4e51-88df-5d75dd4ba543 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:49.864034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:49.896874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:49.898571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:49.915300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:49.927917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca25c1f-6245-4d39-9758-0489145ce2dd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:49.935004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e7c104c6-8168-4e51-88df-5d75dd4ba543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd813fb929b8f41d198cfc8729d3f28f7', 'request_id': 'req-e7c104c6-8168-4e51-88df-5d75dd4ba543'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:49.952383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e7c104c6-8168-4e51-88df-5d75dd4ba543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd813fb929b8f41d198cfc8729d3f28f7', 'request_id': 'req-e7c104c6-8168-4e51-88df-5d75dd4ba543'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:49.968127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e7c104c6-8168-4e51-88df-5d75dd4ba543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd813fb929b8f41d198cfc8729d3f28f7', 'request_id': 'req-e7c104c6-8168-4e51-88df-5d75dd4ba543'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:49.984199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e7c104c6-8168-4e51-88df-5d75dd4ba543 admin admin] The token cache is being invalidate because project d813fb929b8f41d198cfc8729d3f28f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:49.984448 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e7c104c6-8168-4e51-88df-5d75dd4ba543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:49.986479 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e7c104c6-8168-4e51-88df-5d75dd4ba543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:49.989331 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1022/2048] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:49 2022] DELETE /identity/v3/projects/d813fb929b8f41d198cfc8729d3f28f7 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:49.995631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaa97e-4b75-4831-b2fc-9f67dacd3916 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:49.996131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaa97e-4b75-4831-b2fc-9f67dacd3916 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:49.996725 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaa97e-4b75-4831-b2fc-9f67dacd3916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:50.077169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c2eaa97e-4b75-4831-b2fc-9f67dacd3916 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:50.082051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c2eaa97e-4b75-4831-b2fc-9f67dacd3916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:50.095788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:50.097701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:50.098766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:50.099057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78 admin admin] PATH_INFO: `/v3/projects/b0e2e2a3ddb2464fbcb3bf3800c6fb25` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:50.105058 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e2e2a3ddb2464fbcb3bf3800c6fb25)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:50.111673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:50.112265 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1023/2049] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:55:50.113214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaa97e-4b75-4831-b2fc-9f67dacd3916 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:50.115549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c2eaa97e-4b75-4831-b2fc-9f67dacd3916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:50.261004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e2e2a3ddb2464fbcb3bf3800c6fb25', 'request_id': 'req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:50.280933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e2e2a3ddb2464fbcb3bf3800c6fb25', 'request_id': 'req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:50.289381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e2e2a3ddb2464fbcb3bf3800c6fb25', 'request_id': 'req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:50.309031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaa97e-4b75-4831-b2fc-9f67dacd3916 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:50.320450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78 admin admin] The token cache is being invalidate because project b0e2e2a3ddb2464fbcb3bf3800c6fb25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:55:50.320450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:50.321247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b5f1ed6c-1533-4328-8bd7-9f491a49ee78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:55:50.323330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1027/2050] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:55:49 2022] DELETE /identity/v3/projects/b0e2e2a3ddb2464fbcb3bf3800c6fb25 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:50.326480 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d3213-69a7-4583-8a3a-dde8baf8ab13 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:50.326832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d3213-69a7-4583-8a3a-dde8baf8ab13 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:50.327111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d3213-69a7-4583-8a3a-dde8baf8ab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:50.372912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f604c3-2425-41c4-84f6-352bd3c3f84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:50.374004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f604c3-2425-41c4-84f6-352bd3c3f84c service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:50.374515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f604c3-2425-41c4-84f6-352bd3c3f84c service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:50.375041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f604c3-2425-41c4-84f6-352bd3c3f84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:50.376120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-544d3213-69a7-4583-8a3a-dde8baf8ab13 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:50.377251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e6f604c3-2425-41c4-84f6-352bd3c3f84c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:50.378720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-544d3213-69a7-4583-8a3a-dde8baf8ab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:50.456604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f604c3-2425-41c4-84f6-352bd3c3f84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:50.458413 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f604c3-2425-41c4-84f6-352bd3c3f84c service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:50.470517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1024/2051] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:50.472375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeaf8f-a7d2-4593-9d77-a8c62e9941e9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:50.472966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeaf8f-a7d2-4593-9d77-a8c62e9941e9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:50.473491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeaf8f-a7d2-4593-9d77-a8c62e9941e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:50.512439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-42eeaf8f-a7d2-4593-9d77-a8c62e9941e9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:50.514989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-42eeaf8f-a7d2-4593-9d77-a8c62e9941e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:50.525158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:50.541038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1028/2052] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:50.546341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d3213-69a7-4583-8a3a-dde8baf8ab13 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:50.563795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d3213-69a7-4583-8a3a-dde8baf8ab13 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:50.580162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26d1a6-a515-4673-9b73-8b99f7f888bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:50.580162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26d1a6-a515-4673-9b73-8b99f7f888bb admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:50.580162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26d1a6-a515-4673-9b73-8b99f7f888bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:50.580162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26d1a6-a515-4673-9b73-8b99f7f888bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:50.581030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26d1a6-a515-4673-9b73-8b99f7f888bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:55:50.581030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26d1a6-a515-4673-9b73-8b99f7f888bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:50.585100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26d1a6-a515-4673-9b73-8b99f7f888bb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:50.617974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1029/2053] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:55:50.619194 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26d1a6-a515-4673-9b73-8b99f7f888bb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:50.639830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26d1a6-a515-4673-9b73-8b99f7f888bb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:50.651847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1025/2054] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:50.652411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8578e8-18ed-45a0-8f2b-8550d26872e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:50.652411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8578e8-18ed-45a0-8f2b-8550d26872e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:50.652411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8578e8-18ed-45a0-8f2b-8550d26872e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:50.652411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8578e8-18ed-45a0-8f2b-8550d26872e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:50.652728 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8578e8-18ed-45a0-8f2b-8550d26872e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:50.653479 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4805a1-5421-431f-b8e3-53f4ce45a971 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:50.653761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4805a1-5421-431f-b8e3-53f4ce45a971 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:50.654082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4805a1-5421-431f-b8e3-53f4ce45a971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:50.661168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8578e8-18ed-45a0-8f2b-8550d26872e3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:50.694831 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ae4805a1-5421-431f-b8e3-53f4ce45a971 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:50.703967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ae4805a1-5421-431f-b8e3-53f4ce45a971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:50.714954 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1026/2055] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:50.718130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4805a1-5421-431f-b8e3-53f4ce45a971 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:50.722630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:50.736044 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1030/2056] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:50 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:50.737212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8578e8-18ed-45a0-8f2b-8550d26872e3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:50.747193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4805a1-5421-431f-b8e3-53f4ce45a971 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:50.886503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c056a1-7f52-428c-ac58-39eaeb31217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:50.887216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c056a1-7f52-428c-ac58-39eaeb31217b admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:50.888105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c056a1-7f52-428c-ac58-39eaeb31217b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:50.888599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c056a1-7f52-428c-ac58-39eaeb31217b admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:50.889574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c056a1-7f52-428c-ac58-39eaeb31217b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:55:50.890030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c056a1-7f52-428c-ac58-39eaeb31217b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:50.895091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c056a1-7f52-428c-ac58-39eaeb31217b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:50.922846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8578e8-18ed-45a0-8f2b-8550d26872e3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:50.929133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1027/2057] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:55:50.930136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c056a1-7f52-428c-ac58-39eaeb31217b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:50.958398 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617a942-ed28-4719-9bb1-a63f806ca0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:50.960366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617a942-ed28-4719-9bb1-a63f806ca0ad admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:50.960673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617a942-ed28-4719-9bb1-a63f806ca0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:50.960947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617a942-ed28-4719-9bb1-a63f806ca0ad admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:50.961647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617a942-ed28-4719-9bb1-a63f806ca0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:50.963666 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617a942-ed28-4719-9bb1-a63f806ca0ad admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:50.998283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c056a1-7f52-428c-ac58-39eaeb31217b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:51.044038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4073b33-82d4-4f7b-beb7-d259bba94825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:51.044832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4073b33-82d4-4f7b-beb7-d259bba94825 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:51.045086 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4073b33-82d4-4f7b-beb7-d259bba94825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:51.045500 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4073b33-82d4-4f7b-beb7-d259bba94825 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:51.046170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4073b33-82d4-4f7b-beb7-d259bba94825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:51.048448 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4073b33-82d4-4f7b-beb7-d259bba94825 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:51.064742 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1031/2058] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:50 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:55:51.066021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617a942-ed28-4719-9bb1-a63f806ca0ad admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:51.092414 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617a942-ed28-4719-9bb1-a63f806ca0ad admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:51.099683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8ff00-a3c0-4062-98ea-db0538f67c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:51.100648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8ff00-a3c0-4062-98ea-db0538f67c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:51.101393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8ff00-a3c0-4062-98ea-db0538f67c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:51.102721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8ff00-a3c0-4062-98ea-db0538f67c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:51.103913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8ff00-a3c0-4062-98ea-db0538f67c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:51.106070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8ff00-a3c0-4062-98ea-db0538f67c04 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:51.115656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1028/2059] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:50 2022] POST /identity/v3/projects => generated 407 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:51.119607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4073b33-82d4-4f7b-beb7-d259bba94825 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:51.129553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1032/2060] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:51.134074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8ff00-a3c0-4062-98ea-db0538f67c04 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:51.154379 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8ff00-a3c0-4062-98ea-db0538f67c04 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:51.273500 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4073b33-82d4-4f7b-beb7-d259bba94825 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:51.293341 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f8523-048b-4cfd-a0e5-bee9e52b2bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:51.295377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f8523-048b-4cfd-a0e5-bee9e52b2bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:51.297196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f8523-048b-4cfd-a0e5-bee9e52b2bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:51.297641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f8523-048b-4cfd-a0e5-bee9e52b2bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:51.299307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f8523-048b-4cfd-a0e5-bee9e52b2bb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:51.300765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c9ca6-246c-4e08-9f1e-0edc03533a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:51.301384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c9ca6-246c-4e08-9f1e-0edc03533a4b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:51.301664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c9ca6-246c-4e08-9f1e-0edc03533a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:51.301940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c9ca6-246c-4e08-9f1e-0edc03533a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:51.302677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c9ca6-246c-4e08-9f1e-0edc03533a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:51.304254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c9ca6-246c-4e08-9f1e-0edc03533a4b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:51.304485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f8523-048b-4cfd-a0e5-bee9e52b2bb9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:51.332960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1033/2061] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:51.334208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c9ca6-246c-4e08-9f1e-0edc03533a4b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:51.340685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1029/2062] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:51 2022] POST /identity/v3/users => generated 304 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:55:51.345019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f8523-048b-4cfd-a0e5-bee9e52b2bb9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:51.355077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:51.357444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c9ca6-246c-4e08-9f1e-0edc03533a4b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:51.360133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f8523-048b-4cfd-a0e5-bee9e52b2bb9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:51.367018 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0953f1-275b-4f9d-bbf7-b84795b311a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:51.368231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0953f1-275b-4f9d-bbf7-b84795b311a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:51.368513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0953f1-275b-4f9d-bbf7-b84795b311a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:51.368784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0953f1-275b-4f9d-bbf7-b84795b311a9 admin admin] PATH_INFO: `/v3/projects/6d373e283e374ef3b6d853a6a396bc9a/users/007bf017653143e893c5ab4413556729/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:51.370018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286a160-3f14-47a7-9478-8d26119d6055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:51.370949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a160-3f14-47a7-9478-8d26119d6055 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:51.371496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a160-3f14-47a7-9478-8d26119d6055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:51.371953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a160-3f14-47a7-9478-8d26119d6055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:51.373822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286a160-3f14-47a7-9478-8d26119d6055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:51.376926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286a160-3f14-47a7-9478-8d26119d6055 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:51.395763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1030/2063] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:51.397480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286a160-3f14-47a7-9478-8d26119d6055 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:51.404850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0953f1-275b-4f9d-bbf7-b84795b311a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d373e283e374ef3b6d853a6a396bc9a, user_id=007bf017653143e893c5ab4413556729, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:51.410807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0953f1-275b-4f9d-bbf7-b84795b311a9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:51.413391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286a160-3f14-47a7-9478-8d26119d6055 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:51.439125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6b05-e973-4a62-b5b1-561b18854305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:51.439746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6b05-e973-4a62-b5b1-561b18854305 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:51.440025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6b05-e973-4a62-b5b1-561b18854305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:51.440294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6b05-e973-4a62-b5b1-561b18854305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:51.440940 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb6b05-e973-4a62-b5b1-561b18854305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:51.442532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb6b05-e973-4a62-b5b1-561b18854305 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:51.445555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1034/2064] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:51 2022] PUT /identity/v3/projects/6d373e283e374ef3b6d853a6a396bc9a/users/007bf017653143e893c5ab4413556729/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:51.457655 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb29cca-83dd-4ab2-8301-cc62982cc551 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:51.458694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb29cca-83dd-4ab2-8301-cc62982cc551 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:51.458694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb29cca-83dd-4ab2-8301-cc62982cc551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:51.468678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1031/2065] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:51.472906 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6b05-e973-4a62-b5b1-561b18854305 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:51.486856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6b05-e973-4a62-b5b1-561b18854305 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:51.512444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2cb29cca-83dd-4ab2-8301-cc62982cc551 None None] MFA Rules not processed for user `007bf017653143e893c5ab4413556729`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:51.514291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2cb29cca-83dd-4ab2-8301-cc62982cc551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:51.568071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c3731-e032-478d-a012-9de459ee5bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:51.569039 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c3731-e032-478d-a012-9de459ee5bca admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:51.569389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c3731-e032-478d-a012-9de459ee5bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:51.572101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c3731-e032-478d-a012-9de459ee5bca admin admin] PATH_INFO: `/v3/projects/7490e50383e94cb8892a199f41150cb7/users/a964da23c173496f97d31a563f31a4a0/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:51.587867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:51.595961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c3731-e032-478d-a012-9de459ee5bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7490e50383e94cb8892a199f41150cb7, user_id=a964da23c173496f97d31a563f31a4a0, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:51.599403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c3731-e032-478d-a012-9de459ee5bca admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:51.637611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1032/2066] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:51 2022] PUT /identity/v3/projects/7490e50383e94cb8892a199f41150cb7/users/a964da23c173496f97d31a563f31a4a0/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:51.637819 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1035/2067] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:51.641942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb29cca-83dd-4ab2-8301-cc62982cc551 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:51.642617 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3167c12-b218-4a8e-af4e-6a48deb26988 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:51.642983 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3167c12-b218-4a8e-af4e-6a48deb26988 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:51.643283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3167c12-b218-4a8e-af4e-6a48deb26988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:51.664363 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb29cca-83dd-4ab2-8301-cc62982cc551 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:51.702914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f3167c12-b218-4a8e-af4e-6a48deb26988 None None] MFA Rules not processed for user `a964da23c173496f97d31a563f31a4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:51.705216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f3167c12-b218-4a8e-af4e-6a48deb26988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:51.830818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945e23f-7ac6-4ba2-87e5-61d70ecc484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:51.831664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945e23f-7ac6-4ba2-87e5-61d70ecc484d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:51.831946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945e23f-7ac6-4ba2-87e5-61d70ecc484d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:51.832216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945e23f-7ac6-4ba2-87e5-61d70ecc484d admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:51.833092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945e23f-7ac6-4ba2-87e5-61d70ecc484d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:51.835436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945e23f-7ac6-4ba2-87e5-61d70ecc484d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:51.843371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1033/2068] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:51 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:51.844686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3167c12-b218-4a8e-af4e-6a48deb26988 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:51.859836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3167c12-b218-4a8e-af4e-6a48deb26988 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:51.866991 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f12e0-f0e6-40c6-9538-bb6930ce5ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:51.868769 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f12e0-f0e6-40c6-9538-bb6930ce5ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:51.869052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f12e0-f0e6-40c6-9538-bb6930ce5ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:51.869553 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f12e0-f0e6-40c6-9538-bb6930ce5ef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:51.870561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f12e0-f0e6-40c6-9538-bb6930ce5ef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:51.872676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f12e0-f0e6-40c6-9538-bb6930ce5ef9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:51.899052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1036/2069] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:51 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:51.903523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945e23f-7ac6-4ba2-87e5-61d70ecc484d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:51.946893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1034/2070] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:51 2022] POST /identity/v3/projects => generated 407 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:51.950058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f12e0-f0e6-40c6-9538-bb6930ce5ef9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:52.021966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945e23f-7ac6-4ba2-87e5-61d70ecc484d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:52.041069 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:52.099277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f12e0-f0e6-40c6-9538-bb6930ce5ef9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:52.119837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b498aa0-5897-45cd-a20f-3776f8e9e770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:52.121042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cce323-9157-4f71-b82a-00b1cabf6ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:52.122406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cce323-9157-4f71-b82a-00b1cabf6ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:52.122406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cce323-9157-4f71-b82a-00b1cabf6ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:52.122406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cce323-9157-4f71-b82a-00b1cabf6ffa admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:52.122891 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cce323-9157-4f71-b82a-00b1cabf6ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:52.123386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b498aa0-5897-45cd-a20f-3776f8e9e770 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:52.123679 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b498aa0-5897-45cd-a20f-3776f8e9e770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:52.123951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b498aa0-5897-45cd-a20f-3776f8e9e770 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:52.124599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b498aa0-5897-45cd-a20f-3776f8e9e770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:52.124845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cce323-9157-4f71-b82a-00b1cabf6ffa admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:52.126909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b498aa0-5897-45cd-a20f-3776f8e9e770 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:52.161846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:52.174982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1035/2071] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:51 2022] POST /identity/v3/users => generated 310 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:52.174982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cce323-9157-4f71-b82a-00b1cabf6ffa admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:52.183331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1037/2072] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:51 2022] POST /identity/v3/users => generated 298 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:52.187187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b498aa0-5897-45cd-a20f-3776f8e9e770 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:52.200576 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b498aa0-5897-45cd-a20f-3776f8e9e770 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:52.207597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cce323-9157-4f71-b82a-00b1cabf6ffa admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:52.208425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaf643-3696-488b-b6c1-77efdf362c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:52.210164 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaf643-3696-488b-b6c1-77efdf362c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:52.212536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaf643-3696-488b-b6c1-77efdf362c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:52.212939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaf643-3696-488b-b6c1-77efdf362c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:52.213871 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeaf643-3696-488b-b6c1-77efdf362c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:52.216108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a955ded-768c-4986-b6c8-838c94b3aa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:52.216898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a955ded-768c-4986-b6c8-838c94b3aa07 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:52.217430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a955ded-768c-4986-b6c8-838c94b3aa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:52.217937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a955ded-768c-4986-b6c8-838c94b3aa07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:52.218854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeaf643-3696-488b-b6c1-77efdf362c84 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:52.219751 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a955ded-768c-4986-b6c8-838c94b3aa07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:52.233168 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a955ded-768c-4986-b6c8-838c94b3aa07 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:52.238579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1038/2073] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:52.249172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaf643-3696-488b-b6c1-77efdf362c84 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:52.260152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1036/2074] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:52.266116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaf643-3696-488b-b6c1-77efdf362c84 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:52.266946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a955ded-768c-4986-b6c8-838c94b3aa07 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:52.278149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935bf1d-008b-41e7-b868-a3454af2af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:52.278849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935bf1d-008b-41e7-b868-a3454af2af9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:52.279124 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935bf1d-008b-41e7-b868-a3454af2af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:52.279397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935bf1d-008b-41e7-b868-a3454af2af9b admin admin] PATH_INFO: `/v3/projects/8f4e099c4e80426596b41a98d91e470f/users/0dd328bb4b7c4d5fa3c26aa2b94c6c11/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:52.285880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a955ded-768c-4986-b6c8-838c94b3aa07 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:52.301531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aca40-b1ab-4cad-8473-44668f8b0332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:52.302279 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aca40-b1ab-4cad-8473-44668f8b0332 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:52.302560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aca40-b1ab-4cad-8473-44668f8b0332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:52.302892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aca40-b1ab-4cad-8473-44668f8b0332 admin admin] PATH_INFO: `/v3/projects/1bca8f209394499099dcb18d5bbe1eec/users/1a5db9f52bb8491e889dbd418bdd611c/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:52.320564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935bf1d-008b-41e7-b868-a3454af2af9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4e099c4e80426596b41a98d91e470f, user_id=0dd328bb4b7c4d5fa3c26aa2b94c6c11, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:52.329304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935bf1d-008b-41e7-b868-a3454af2af9b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:52.345919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aca40-b1ab-4cad-8473-44668f8b0332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bca8f209394499099dcb18d5bbe1eec, user_id=1a5db9f52bb8491e889dbd418bdd611c, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:52.350481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aca40-b1ab-4cad-8473-44668f8b0332 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:52.352722 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1039/2075] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:52 2022] PUT /identity/v3/projects/8f4e099c4e80426596b41a98d91e470f/users/0dd328bb4b7c4d5fa3c26aa2b94c6c11/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:52.368687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935bf1d-008b-41e7-b868-a3454af2af9b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:52.378951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1037/2076] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:52 2022] PUT /identity/v3/projects/1bca8f209394499099dcb18d5bbe1eec/users/1a5db9f52bb8491e889dbd418bdd611c/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:52.379718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aca40-b1ab-4cad-8473-44668f8b0332 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:52.463377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935bf1d-008b-41e7-b868-a3454af2af9b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:52.521733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aca40-b1ab-4cad-8473-44668f8b0332 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:52.537349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264126f-0abb-4b19-b177-e130302038dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:52.537982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264126f-0abb-4b19-b177-e130302038dc admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:52.538264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264126f-0abb-4b19-b177-e130302038dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:52.538542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264126f-0abb-4b19-b177-e130302038dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:52.540502 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264126f-0abb-4b19-b177-e130302038dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:52.541839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264126f-0abb-4b19-b177-e130302038dc admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:52.555635 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1038/2077] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:52.561122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264126f-0abb-4b19-b177-e130302038dc admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:52.576710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264126f-0abb-4b19-b177-e130302038dc admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:52.583015 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d00582-fc31-4844-819b-daac7f487827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:52.584009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d00582-fc31-4844-819b-daac7f487827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:52.584301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d00582-fc31-4844-819b-daac7f487827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:52.584578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d00582-fc31-4844-819b-daac7f487827 admin admin] PATH_INFO: `/v3/projects/1bca8f209394499099dcb18d5bbe1eec/users/1a5db9f52bb8491e889dbd418bdd611c/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:52.589101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d00582-fc31-4844-819b-daac7f487827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bca8f209394499099dcb18d5bbe1eec, user_id=1a5db9f52bb8491e889dbd418bdd611c, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:52.592255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d00582-fc31-4844-819b-daac7f487827 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:52.602859 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57bb92-356b-4980-9865-14f465b7c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:52.603660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57bb92-356b-4980-9865-14f465b7c22b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:52.604122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57bb92-356b-4980-9865-14f465b7c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:52.604549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57bb92-356b-4980-9865-14f465b7c22b admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:52.605355 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57bb92-356b-4980-9865-14f465b7c22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:52.616411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1039/2078] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:52 2022] PUT /identity/v3/projects/1bca8f209394499099dcb18d5bbe1eec/users/1a5db9f52bb8491e889dbd418bdd611c/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:52.617319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57bb92-356b-4980-9865-14f465b7c22b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:52.621986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525bf03-66ff-4eb7-a389-a50e163226a2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:52.622359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525bf03-66ff-4eb7-a389-a50e163226a2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:52.622984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525bf03-66ff-4eb7-a389-a50e163226a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:52.633018 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1040/2079] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:52.639158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57bb92-356b-4980-9865-14f465b7c22b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:52.663552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57bb92-356b-4980-9865-14f465b7c22b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:52.690135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-1525bf03-66ff-4eb7-a389-a50e163226a2 None None] MFA Rules not processed for user `1a5db9f52bb8491e889dbd418bdd611c`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:52.692506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1525bf03-66ff-4eb7-a389-a50e163226a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:52.792333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:52.810383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1040/2080] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:52 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:52.814529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152f454-5e45-47b2-947a-1456212297c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:52.815563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152f454-5e45-47b2-947a-1456212297c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:52.815941 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152f454-5e45-47b2-947a-1456212297c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:52.816686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152f454-5e45-47b2-947a-1456212297c9 admin admin] PATH_INFO: `/v3/projects/8f4e099c4e80426596b41a98d91e470f/users/0dd328bb4b7c4d5fa3c26aa2b94c6c11/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:52.819521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152f454-5e45-47b2-947a-1456212297c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4e099c4e80426596b41a98d91e470f, user_id=0dd328bb4b7c4d5fa3c26aa2b94c6c11, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:52.823513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152f454-5e45-47b2-947a-1456212297c9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:52.836383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1041/2081] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:52 2022] PUT /identity/v3/projects/8f4e099c4e80426596b41a98d91e470f/users/0dd328bb4b7c4d5fa3c26aa2b94c6c11/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:52.848463 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa221b06-6e2d-4abf-84d9-adc2a7376823 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:52.849428 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa221b06-6e2d-4abf-84d9-adc2a7376823 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:52.849428 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa221b06-6e2d-4abf-84d9-adc2a7376823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:52.896057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152f454-5e45-47b2-947a-1456212297c9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:52.898035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6152f454-5e45-47b2-947a-1456212297c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:52.907231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:52.914104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-aa221b06-6e2d-4abf-84d9-adc2a7376823 None None] MFA Rules not processed for user `0dd328bb4b7c4d5fa3c26aa2b94c6c11`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:52.917535 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-aa221b06-6e2d-4abf-84d9-adc2a7376823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:53.059959 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152f454-5e45-47b2-947a-1456212297c9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:53.064369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d327bcb-6d9a-42d8-8fa4-2558fed51daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:53.065059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d327bcb-6d9a-42d8-8fa4-2558fed51daa service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:53.066225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d327bcb-6d9a-42d8-8fa4-2558fed51daa service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:53.066225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d327bcb-6d9a-42d8-8fa4-2558fed51daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:53.069449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1041/2082] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:55:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:53.185663 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d327bcb-6d9a-42d8-8fa4-2558fed51daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:53.191534 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa221b06-6e2d-4abf-84d9-adc2a7376823 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:53.205545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d327bcb-6d9a-42d8-8fa4-2558fed51daa service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:53.209919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa221b06-6e2d-4abf-84d9-adc2a7376823 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:53.218309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d6f3c-40f3-4d2c-9ff1-02909ca70121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:53.218966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d6f3c-40f3-4d2c-9ff1-02909ca70121 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:53.219242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d6f3c-40f3-4d2c-9ff1-02909ca70121 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:53.219514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d6f3c-40f3-4d2c-9ff1-02909ca70121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:53.224395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1042/2083] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:52 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:53.233275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d6f3c-40f3-4d2c-9ff1-02909ca70121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:53.234803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d6f3c-40f3-4d2c-9ff1-02909ca70121 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:53.246664 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1042/2084] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:55:54.954477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d327bcb-6d9a-42d8-8fa4-2558fed51daa service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:54.956486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9d327bcb-6d9a-42d8-8fa4-2558fed51daa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:55.127908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d327bcb-6d9a-42d8-8fa4-2558fed51daa service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:55.141871 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e7294-42bd-4827-81a6-0653eb7b5c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:55.143027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e7294-42bd-4827-81a6-0653eb7b5c07 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:55.143179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e7294-42bd-4827-81a6-0653eb7b5c07 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:55.143592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e7294-42bd-4827-81a6-0653eb7b5c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:55.243873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:55.266537 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e7294-42bd-4827-81a6-0653eb7b5c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:55.268626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e7294-42bd-4827-81a6-0653eb7b5c07 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:55.282576 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1043/2085] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:54 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:59.946242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d6f3c-40f3-4d2c-9ff1-02909ca70121 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:59.948312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-982d6f3c-40f3-4d2c-9ff1-02909ca70121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:00.068947 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d6f3c-40f3-4d2c-9ff1-02909ca70121 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:00.080171 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:00.080171 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:00.080171 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:00.080171 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] PATH_INFO: `/v3/users/22e068856a7d4b01bb390bba5507f4d9` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:00.081565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e068856a7d4b01bb390bba5507f4d9)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:00.085105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:00.187326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e068856a7d4b01bb390bba5507f4d9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.187945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e068856a7d4b01bb390bba5507f4d9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.198650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e068856a7d4b01bb390bba5507f4d9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.210284 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e068856a7d4b01bb390bba5507f4d9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.224999 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:00.256400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e068856a7d4b01bb390bba5507f4d9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.268382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1043/2086] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:55:59 2022] DELETE /identity/v3/users/22e068856a7d4b01bb390bba5507f4d9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:00.562666 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e7294-42bd-4827-81a6-0653eb7b5c07 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:00.584243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e7294-42bd-4827-81a6-0653eb7b5c07 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:00.696929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:00.697874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:00.698296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:00.698708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] PATH_INFO: `/v3/projects/121221aeb5584f55af27ff5473e5e44e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:00.700124 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=121221aeb5584f55af27ff5473e5e44e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:00.703127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:00.764838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '121221aeb5584f55af27ff5473e5e44e', 'request_id': 'req-93f4625d-b14e-486d-a9d1-166c99ad93ac'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.774710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '121221aeb5584f55af27ff5473e5e44e', 'request_id': 'req-93f4625d-b14e-486d-a9d1-166c99ad93ac'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.784082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '121221aeb5584f55af27ff5473e5e44e', 'request_id': 'req-93f4625d-b14e-486d-a9d1-166c99ad93ac'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.798560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] The token cache is being invalidate because project 121221aeb5584f55af27ff5473e5e44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:00.798877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.799535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.801305 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1044/2087] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:00 2022] DELETE /identity/v3/projects/121221aeb5584f55af27ff5473e5e44e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:00.805612 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:00.807073 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:00.821313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d6060-1a19-4ea0-9bdf-0cd0ebfc0418 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:00.902063 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:00.903122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:00.903719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:00.904166 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] PATH_INFO: `/v3/users/98437e2bb9f445b4bfe6e95b9e5ae155` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:00.905478 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98437e2bb9f445b4bfe6e95b9e5ae155)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:00.907691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:00.960148 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98437e2bb9f445b4bfe6e95b9e5ae155'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.961549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98437e2bb9f445b4bfe6e95b9e5ae155'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.970053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98437e2bb9f445b4bfe6e95b9e5ae155'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.978660 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98437e2bb9f445b4bfe6e95b9e5ae155'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.992935 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98437e2bb9f445b4bfe6e95b9e5ae155'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:00.999441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1044/2088] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:56:00 2022] DELETE /identity/v3/users/98437e2bb9f445b4bfe6e95b9e5ae155 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:01.181020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:01.182786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:01.197787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4625d-b14e-486d-a9d1-166c99ad93ac admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:01.259863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42724880-0223-41e4-85ff-57b49232ac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:01.260517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42724880-0223-41e4-85ff-57b49232ac38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:01.260791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42724880-0223-41e4-85ff-57b49232ac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:01.261055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42724880-0223-41e4-85ff-57b49232ac38 admin admin] PATH_INFO: `/v3/projects/42295d884f8e4b9387d759b401417358` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:01.262486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42724880-0223-41e4-85ff-57b49232ac38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42295d884f8e4b9387d759b401417358)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:01.266758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42724880-0223-41e4-85ff-57b49232ac38 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:01.292988 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:01.318639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-42724880-0223-41e4-85ff-57b49232ac38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42295d884f8e4b9387d759b401417358', 'request_id': 'req-42724880-0223-41e4-85ff-57b49232ac38'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:01.326360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-42724880-0223-41e4-85ff-57b49232ac38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42295d884f8e4b9387d759b401417358', 'request_id': 'req-42724880-0223-41e4-85ff-57b49232ac38'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:01.332958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-42724880-0223-41e4-85ff-57b49232ac38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42295d884f8e4b9387d759b401417358', 'request_id': 'req-42724880-0223-41e4-85ff-57b49232ac38'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:01.344258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-42724880-0223-41e4-85ff-57b49232ac38 admin admin] The token cache is being invalidate because project 42295d884f8e4b9387d759b401417358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:01.344550 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-42724880-0223-41e4-85ff-57b49232ac38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:01.345560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-42724880-0223-41e4-85ff-57b49232ac38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:01.347122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1045/2089] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:01 2022] DELETE /identity/v3/projects/42295d884f8e4b9387d759b401417358 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:01.515892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:01.517777 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:01.531919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68653c5f-7248-42b0-afda-630edeacd9b4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:01.589983 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:01.590620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:01.590955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:01.591232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] PATH_INFO: `/v3/users/007bf017653143e893c5ab4413556729` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:01.592398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] RBAC: Authorizing `identity:delete_user(user_id=007bf017653143e893c5ab4413556729)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:01.594332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:01.600490 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:01.642389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007bf017653143e893c5ab4413556729'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:01.643060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007bf017653143e893c5ab4413556729'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:01.650508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007bf017653143e893c5ab4413556729'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:01.657994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007bf017653143e893c5ab4413556729'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:01.671075 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007bf017653143e893c5ab4413556729'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:01.677378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1045/2090] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:56:01 2022] DELETE /identity/v3/users/007bf017653143e893c5ab4413556729 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:01.681880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b59c2-b6bb-435a-ba41-6e3b5317b975 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:01.682365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b59c2-b6bb-435a-ba41-6e3b5317b975 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:01.682463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b59c2-b6bb-435a-ba41-6e3b5317b975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:01.703359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b88b59c2-b6bb-435a-ba41-6e3b5317b975 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:01.704561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b88b59c2-b6bb-435a-ba41-6e3b5317b975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:01.763904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1046/2091] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:01.773783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:01.775295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:01.835340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd075e-62a4-4938-93e7-77e4ac14548c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:01.843197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d4801-cb6b-4aff-8dd2-268c31360ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:01.844417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d4801-cb6b-4aff-8dd2-268c31360ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:01.844931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d4801-cb6b-4aff-8dd2-268c31360ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:01.845245 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d4801-cb6b-4aff-8dd2-268c31360ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:01.856722 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d4801-cb6b-4aff-8dd2-268c31360ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:01.858715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d4801-cb6b-4aff-8dd2-268c31360ad0 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:01.870222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1046/2092] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:02.203198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b59c2-b6bb-435a-ba41-6e3b5317b975 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:02.203198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b88b59c2-b6bb-435a-ba41-6e3b5317b975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:02.222794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b59c2-b6bb-435a-ba41-6e3b5317b975 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:02.229332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:02.230090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:02.230535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:02.231165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] PATH_INFO: `/v3/projects/6d373e283e374ef3b6d853a6a396bc9a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:02.232462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d373e283e374ef3b6d853a6a396bc9a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:02.234548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:02.325366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d373e283e374ef3b6d853a6a396bc9a', 'request_id': 'req-ff78718e-a7e6-4214-a128-6655d834ea40'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:02.337502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d373e283e374ef3b6d853a6a396bc9a', 'request_id': 'req-ff78718e-a7e6-4214-a128-6655d834ea40'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:02.346063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d373e283e374ef3b6d853a6a396bc9a', 'request_id': 'req-ff78718e-a7e6-4214-a128-6655d834ea40'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:02.359683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] The token cache is being invalidate because project 6d373e283e374ef3b6d853a6a396bc9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:02.359980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:02.361112 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:02.365896 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1047/2093] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:02 2022] DELETE /identity/v3/projects/6d373e283e374ef3b6d853a6a396bc9a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:02.367814 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d4801-cb6b-4aff-8dd2-268c31360ad0 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:02.378785 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d4801-cb6b-4aff-8dd2-268c31360ad0 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:02.468002 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03f4bd-1f2c-4800-a3a8-c01cb5064d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:02.468854 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03f4bd-1f2c-4800-a3a8-c01cb5064d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:02.469210 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03f4bd-1f2c-4800-a3a8-c01cb5064d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:02.469492 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03f4bd-1f2c-4800-a3a8-c01cb5064d1c admin admin] PATH_INFO: `/v3/users/0dd328bb4b7c4d5fa3c26aa2b94c6c11` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:02.471231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03f4bd-1f2c-4800-a3a8-c01cb5064d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd328bb4b7c4d5fa3c26aa2b94c6c11)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:02.473203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03f4bd-1f2c-4800-a3a8-c01cb5064d1c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:02.523389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:02.544614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ad03f4bd-1f2c-4800-a3a8-c01cb5064d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd328bb4b7c4d5fa3c26aa2b94c6c11'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:02.545374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ad03f4bd-1f2c-4800-a3a8-c01cb5064d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd328bb4b7c4d5fa3c26aa2b94c6c11'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:02.556961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ad03f4bd-1f2c-4800-a3a8-c01cb5064d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd328bb4b7c4d5fa3c26aa2b94c6c11'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:02.569401 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ad03f4bd-1f2c-4800-a3a8-c01cb5064d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd328bb4b7c4d5fa3c26aa2b94c6c11'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:02.585198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ad03f4bd-1f2c-4800-a3a8-c01cb5064d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd328bb4b7c4d5fa3c26aa2b94c6c11'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:02.593175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1047/2094] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:56:02 2022] DELETE /identity/v3/users/0dd328bb4b7c4d5fa3c26aa2b94c6c11 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:56:02.791056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:02.792499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:02.805448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78718e-a7e6-4214-a128-6655d834ea40 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:02.861471 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:02.890182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c49f3-0d37-4caa-b847-1672c31eadf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:02.891119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c49f3-0d37-4caa-b847-1672c31eadf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:02.892175 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c49f3-0d37-4caa-b847-1672c31eadf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:02.892675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c49f3-0d37-4caa-b847-1672c31eadf6 admin admin] PATH_INFO: `/v3/projects/8f4e099c4e80426596b41a98d91e470f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:02.893919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c49f3-0d37-4caa-b847-1672c31eadf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4e099c4e80426596b41a98d91e470f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:02.895878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c49f3-0d37-4caa-b847-1672c31eadf6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:02.962059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-818c49f3-0d37-4caa-b847-1672c31eadf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4e099c4e80426596b41a98d91e470f', 'request_id': 'req-818c49f3-0d37-4caa-b847-1672c31eadf6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:02.972915 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-818c49f3-0d37-4caa-b847-1672c31eadf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4e099c4e80426596b41a98d91e470f', 'request_id': 'req-818c49f3-0d37-4caa-b847-1672c31eadf6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:02.980611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-818c49f3-0d37-4caa-b847-1672c31eadf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4e099c4e80426596b41a98d91e470f', 'request_id': 'req-818c49f3-0d37-4caa-b847-1672c31eadf6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:03.000127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-818c49f3-0d37-4caa-b847-1672c31eadf6 admin admin] The token cache is being invalidate because project 8f4e099c4e80426596b41a98d91e470f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:03.000420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-818c49f3-0d37-4caa-b847-1672c31eadf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:03.002125 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-818c49f3-0d37-4caa-b847-1672c31eadf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:03.004415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1048/2095] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:02 2022] DELETE /identity/v3/projects/8f4e099c4e80426596b41a98d91e470f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:03.011201 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad86ad-54f9-4af6-94c3-36ecaefbc675 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:03.011514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad86ad-54f9-4af6-94c3-36ecaefbc675 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:03.012231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad86ad-54f9-4af6-94c3-36ecaefbc675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:03.039999 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e5ad86ad-54f9-4af6-94c3-36ecaefbc675 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:03.041390 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e5ad86ad-54f9-4af6-94c3-36ecaefbc675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:03.127193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1048/2096] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:03.136430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ffa1a-36c4-4d1c-b02e-e16148ee12e6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:03.137315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ffa1a-36c4-4d1c-b02e-e16148ee12e6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:03.139218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ffa1a-36c4-4d1c-b02e-e16148ee12e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:03.181196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b35ffa1a-36c4-4d1c-b02e-e16148ee12e6 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:03.182149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b35ffa1a-36c4-4d1c-b02e-e16148ee12e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:03.197483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1049/2097] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:03.208858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad86ad-54f9-4af6-94c3-36ecaefbc675 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:03.232388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad86ad-54f9-4af6-94c3-36ecaefbc675 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:03.237198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c3f34-3bd9-4999-a556-c4208d85a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:03.237859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c3f34-3bd9-4999-a556-c4208d85a58b admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:03.238136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c3f34-3bd9-4999-a556-c4208d85a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:03.238465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c3f34-3bd9-4999-a556-c4208d85a58b admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:03.239150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c3f34-3bd9-4999-a556-c4208d85a58b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:56:03.239470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c3f34-3bd9-4999-a556-c4208d85a58b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:03.241454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c3f34-3bd9-4999-a556-c4208d85a58b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:03.274137 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ffa1a-36c4-4d1c-b02e-e16148ee12e6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:03.281838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1049/2098] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:56:03.287820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ffa1a-36c4-4d1c-b02e-e16148ee12e6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:03.293787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194b9dd-ae5c-442f-9dd0-e7659af41500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:03.293951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194b9dd-ae5c-442f-9dd0-e7659af41500 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:03.294192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194b9dd-ae5c-442f-9dd0-e7659af41500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:03.294465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194b9dd-ae5c-442f-9dd0-e7659af41500 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:03.295421 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194b9dd-ae5c-442f-9dd0-e7659af41500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:03.297382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194b9dd-ae5c-442f-9dd0-e7659af41500 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:03.349463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1050/2099] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:56:03 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:56:03.351075 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c3f34-3bd9-4999-a556-c4208d85a58b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:03.375103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c3f34-3bd9-4999-a556-c4208d85a58b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:03.487584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73b3b6-d88e-49bf-8601-d33ad6a57471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:03.488889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73b3b6-d88e-49bf-8601-d33ad6a57471 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:03.489242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73b3b6-d88e-49bf-8601-d33ad6a57471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:03.489579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73b3b6-d88e-49bf-8601-d33ad6a57471 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:03.490362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73b3b6-d88e-49bf-8601-d33ad6a57471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:03.493947 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73b3b6-d88e-49bf-8601-d33ad6a57471 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:03.532728 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1050/2100] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:56:03 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:56:03.534056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194b9dd-ae5c-442f-9dd0-e7659af41500 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:03.547743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194b9dd-ae5c-442f-9dd0-e7659af41500 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:03.553636 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551ad35-73eb-495a-aedd-684c4da7fd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:03.555195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551ad35-73eb-495a-aedd-684c4da7fd94 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:03.555195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551ad35-73eb-495a-aedd-684c4da7fd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:03.555484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551ad35-73eb-495a-aedd-684c4da7fd94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:03.557077 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551ad35-73eb-495a-aedd-684c4da7fd94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:03.563651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551ad35-73eb-495a-aedd-684c4da7fd94 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:03.595808 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1051/2101] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:03.597038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73b3b6-d88e-49bf-8601-d33ad6a57471 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:03.625790 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73b3b6-d88e-49bf-8601-d33ad6a57471 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:03.644938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90206457-4c82-4593-9a71-1cec18b2914b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:03.645579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90206457-4c82-4593-9a71-1cec18b2914b admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:03.646227 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90206457-4c82-4593-9a71-1cec18b2914b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:03.646340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90206457-4c82-4593-9a71-1cec18b2914b admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:03.646979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90206457-4c82-4593-9a71-1cec18b2914b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:03.648884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90206457-4c82-4593-9a71-1cec18b2914b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:03.678122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1051/2102] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:03.682240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551ad35-73eb-495a-aedd-684c4da7fd94 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:03.704459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551ad35-73eb-495a-aedd-684c4da7fd94 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:03.717604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e9914-82f6-4a10-821e-391e13e9a6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:03.719444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e9914-82f6-4a10-821e-391e13e9a6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:03.720359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e9914-82f6-4a10-821e-391e13e9a6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:03.720697 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e9914-82f6-4a10-821e-391e13e9a6f0 admin admin] PATH_INFO: `/v3/projects/0cd60fb3d574460ea27d84693bcd9ce5/users/10b19250bb474346956b9bae502fa3c3/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:03.748887 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e9914-82f6-4a10-821e-391e13e9a6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd60fb3d574460ea27d84693bcd9ce5, user_id=10b19250bb474346956b9bae502fa3c3, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:03.752118 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e9914-82f6-4a10-821e-391e13e9a6f0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:03.783088 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1052/2103] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:56:03 2022] PUT /identity/v3/projects/0cd60fb3d574460ea27d84693bcd9ce5/users/10b19250bb474346956b9bae502fa3c3/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:03.785313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bc62c-187b-4fca-8bfe-7d9fe65b5bf3 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:03.785578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bc62c-187b-4fca-8bfe-7d9fe65b5bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:03.785853 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bc62c-187b-4fca-8bfe-7d9fe65b5bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:03.839097 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:03.846369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-877bc62c-187b-4fca-8bfe-7d9fe65b5bf3 None None] MFA Rules not processed for user `10b19250bb474346956b9bae502fa3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:03.849708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-877bc62c-187b-4fca-8bfe-7d9fe65b5bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:03.989093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1052/2104] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:03.998978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e9914-82f6-4a10-821e-391e13e9a6f0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:04.002471 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e63e9914-82f6-4a10-821e-391e13e9a6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:04.137103 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e9914-82f6-4a10-821e-391e13e9a6f0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:04.144027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d3a2a-e7dc-4a18-ac07-53628c204bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:04.145173 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d3a2a-e7dc-4a18-ac07-53628c204bee service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:04.155531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d3a2a-e7dc-4a18-ac07-53628c204bee service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:04.157854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d3a2a-e7dc-4a18-ac07-53628c204bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:04.175765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d3a2a-e7dc-4a18-ac07-53628c204bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:04.177693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d3a2a-e7dc-4a18-ac07-53628c204bee service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:04.192476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1053/2105] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:13.990440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=26 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:14.184122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:15.739681 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bc62c-187b-4fca-8bfe-7d9fe65b5bf3 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:15.741780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-877bc62c-187b-4fca-8bfe-7d9fe65b5bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:15.930774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bc62c-187b-4fca-8bfe-7d9fe65b5bf3 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:15.939199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:15.940624 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:15.940916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:15.941187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] PATH_INFO: `/v3/users/a964da23c173496f97d31a563f31a4a0` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:15.942624 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a964da23c173496f97d31a563f31a4a0)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:15.944961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:16.015941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a964da23c173496f97d31a563f31a4a0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:16.016907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a964da23c173496f97d31a563f31a4a0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:16.033440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a964da23c173496f97d31a563f31a4a0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:16.046420 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a964da23c173496f97d31a563f31a4a0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:16.065002 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a964da23c173496f97d31a563f31a4a0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:16.074718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1053/2106] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:56:15 2022] DELETE /identity/v3/users/a964da23c173496f97d31a563f31a4a0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:16.079026 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26aee9-4653-475b-a1bc-4ab45d490429 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:16.079523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26aee9-4653-475b-a1bc-4ab45d490429 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:16.079842 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26aee9-4653-475b-a1bc-4ab45d490429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:16.104808 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2d26aee9-4653-475b-a1bc-4ab45d490429 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:16.106331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2d26aee9-4653-475b-a1bc-4ab45d490429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:16.185766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1054/2107] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:16.211880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:16.213526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:16.292282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96956e-912d-4789-a811-b80ee46f382f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:16.297447 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a43576-54fc-4f0b-a651-01fd53483ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:16.298302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a43576-54fc-4f0b-a651-01fd53483ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:16.298767 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a43576-54fc-4f0b-a651-01fd53483ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:16.299209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a43576-54fc-4f0b-a651-01fd53483ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:16.326577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a43576-54fc-4f0b-a651-01fd53483ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:16.329117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a43576-54fc-4f0b-a651-01fd53483ed7 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:16.355603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1054/2108] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:16.853872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26aee9-4653-475b-a1bc-4ab45d490429 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:16.856711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2d26aee9-4653-475b-a1bc-4ab45d490429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:16.875435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26aee9-4653-475b-a1bc-4ab45d490429 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:16.893376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:16.894998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:16.895484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:16.896891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] PATH_INFO: `/v3/projects/7490e50383e94cb8892a199f41150cb7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:16.900738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7490e50383e94cb8892a199f41150cb7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:16.903390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:17.051087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7490e50383e94cb8892a199f41150cb7', 'request_id': 'req-918038ff-a867-4a90-b947-b1fba6a584c7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.066477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7490e50383e94cb8892a199f41150cb7', 'request_id': 'req-918038ff-a867-4a90-b947-b1fba6a584c7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.076042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7490e50383e94cb8892a199f41150cb7', 'request_id': 'req-918038ff-a867-4a90-b947-b1fba6a584c7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.077513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a43576-54fc-4f0b-a651-01fd53483ed7 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:17.079026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f5a43576-54fc-4f0b-a651-01fd53483ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:17.089246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] The token cache is being invalidate because project 7490e50383e94cb8892a199f41150cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:17.089779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.090352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.092907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1055/2109] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:16 2022] DELETE /identity/v3/projects/7490e50383e94cb8892a199f41150cb7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:17.097426 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:17.100704 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:17.104800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a43576-54fc-4f0b-a651-01fd53483ed7 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:17.164352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:17.227615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918038ff-a867-4a90-b947-b1fba6a584c7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:17.234437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:17.235460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:17.236188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:17.236716 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] PATH_INFO: `/v3/users/2e56a0d24c8249ae86243b25d0faa59e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:17.238444 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e56a0d24c8249ae86243b25d0faa59e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:17.240847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:17.241127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1206503-4a56-4493-8b58-139fc6beefd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:17.241748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1206503-4a56-4493-8b58-139fc6beefd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:17.242020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1206503-4a56-4493-8b58-139fc6beefd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:17.242284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1206503-4a56-4493-8b58-139fc6beefd2 admin admin] PATH_INFO: `/v3/users/1a5db9f52bb8491e889dbd418bdd611c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:17.245673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1206503-4a56-4493-8b58-139fc6beefd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5db9f52bb8491e889dbd418bdd611c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:17.247634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1206503-4a56-4493-8b58-139fc6beefd2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:17.305736 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:17.342467 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b1206503-4a56-4493-8b58-139fc6beefd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5db9f52bb8491e889dbd418bdd611c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.347191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e56a0d24c8249ae86243b25d0faa59e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.348372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e56a0d24c8249ae86243b25d0faa59e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.369165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b1206503-4a56-4493-8b58-139fc6beefd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5db9f52bb8491e889dbd418bdd611c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.370131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e56a0d24c8249ae86243b25d0faa59e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.380895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b1206503-4a56-4493-8b58-139fc6beefd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5db9f52bb8491e889dbd418bdd611c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.389071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e56a0d24c8249ae86243b25d0faa59e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.397652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b1206503-4a56-4493-8b58-139fc6beefd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5db9f52bb8491e889dbd418bdd611c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.398500 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b1206503-4a56-4493-8b58-139fc6beefd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5db9f52bb8491e889dbd418bdd611c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.405277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1056/2110] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:56:17 2022] DELETE /identity/v3/users/1a5db9f52bb8491e889dbd418bdd611c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:17.425446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e56a0d24c8249ae86243b25d0faa59e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:17.443056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1055/2111] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:56:17 2022] DELETE /identity/v3/users/2e56a0d24c8249ae86243b25d0faa59e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:17.448829 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f88c4-7d72-4f63-b8f4-e15f70c6eebe None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:17.449203 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f88c4-7d72-4f63-b8f4-e15f70c6eebe None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:17.449599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f88c4-7d72-4f63-b8f4-e15f70c6eebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:17.495544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fb7f88c4-7d72-4f63-b8f4-e15f70c6eebe None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:17.497464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fb7f88c4-7d72-4f63-b8f4-e15f70c6eebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:17.618525 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1057/2112] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:56:17.639109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:17.641303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:17.789394 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861b6e4-715a-4c1f-9a30-cb158b4a232e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:17.794895 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6be4f-068e-468d-b184-0cc29339f4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:17.795721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6be4f-068e-468d-b184-0cc29339f4fa service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:17.796130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6be4f-068e-468d-b184-0cc29339f4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:17.796565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6be4f-068e-468d-b184-0cc29339f4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:17.813631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6be4f-068e-468d-b184-0cc29339f4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:17.820569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6be4f-068e-468d-b184-0cc29339f4fa service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:17.836481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1056/2113] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:18.266767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f88c4-7d72-4f63-b8f4-e15f70c6eebe None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:18.268478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fb7f88c4-7d72-4f63-b8f4-e15f70c6eebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:18.281318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f88c4-7d72-4f63-b8f4-e15f70c6eebe None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:18.287011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a31e6-78a8-4be5-990d-8b9eeac24486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:18.287776 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a31e6-78a8-4be5-990d-8b9eeac24486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:18.288155 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a31e6-78a8-4be5-990d-8b9eeac24486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:18.288435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a31e6-78a8-4be5-990d-8b9eeac24486 admin admin] PATH_INFO: `/v3/projects/1bca8f209394499099dcb18d5bbe1eec` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:18.289609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a31e6-78a8-4be5-990d-8b9eeac24486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bca8f209394499099dcb18d5bbe1eec)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:18.292271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a31e6-78a8-4be5-990d-8b9eeac24486 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:18.372314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-349a31e6-78a8-4be5-990d-8b9eeac24486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bca8f209394499099dcb18d5bbe1eec', 'request_id': 'req-349a31e6-78a8-4be5-990d-8b9eeac24486'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:18.388393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-349a31e6-78a8-4be5-990d-8b9eeac24486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bca8f209394499099dcb18d5bbe1eec', 'request_id': 'req-349a31e6-78a8-4be5-990d-8b9eeac24486'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:18.396113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-349a31e6-78a8-4be5-990d-8b9eeac24486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bca8f209394499099dcb18d5bbe1eec', 'request_id': 'req-349a31e6-78a8-4be5-990d-8b9eeac24486'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:18.412154 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-349a31e6-78a8-4be5-990d-8b9eeac24486 admin admin] The token cache is being invalidate because project 1bca8f209394499099dcb18d5bbe1eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:18.412517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-349a31e6-78a8-4be5-990d-8b9eeac24486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:18.413814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-349a31e6-78a8-4be5-990d-8b9eeac24486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:18.419290 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1058/2114] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:18 2022] DELETE /identity/v3/projects/1bca8f209394499099dcb18d5bbe1eec => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:18.421328 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fce713-02d6-4b8a-83fd-1e1c74e99fcb None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:18.421788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fce713-02d6-4b8a-83fd-1e1c74e99fcb None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:18.421866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fce713-02d6-4b8a-83fd-1e1c74e99fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:18.458387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-78fce713-02d6-4b8a-83fd-1e1c74e99fcb None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:18.460992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-78fce713-02d6-4b8a-83fd-1e1c74e99fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:18.514064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:18.539713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1057/2115] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:18.547409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d23784-5154-4b38-a138-ee49a2b3fc2c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:18.547702 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d23784-5154-4b38-a138-ee49a2b3fc2c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:18.547974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d23784-5154-4b38-a138-ee49a2b3fc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:18.574789 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-53d23784-5154-4b38-a138-ee49a2b3fc2c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:18.576245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-53d23784-5154-4b38-a138-ee49a2b3fc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:18.588965 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1059/2116] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:18.593203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fce713-02d6-4b8a-83fd-1e1c74e99fcb None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:18.605342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fce713-02d6-4b8a-83fd-1e1c74e99fcb None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:18.616921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b1445-a94e-490a-bfe6-4dda1d412046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:18.617743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b1445-a94e-490a-bfe6-4dda1d412046 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:18.618338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b1445-a94e-490a-bfe6-4dda1d412046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:18.619014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b1445-a94e-490a-bfe6-4dda1d412046 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:18.619384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b1445-a94e-490a-bfe6-4dda1d412046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:56:18.619947 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b1445-a94e-490a-bfe6-4dda1d412046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:18.622361 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b1445-a94e-490a-bfe6-4dda1d412046 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:18.649949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1058/2117] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:56:18.654382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d23784-5154-4b38-a138-ee49a2b3fc2c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:18.671368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d23784-5154-4b38-a138-ee49a2b3fc2c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:18.677083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca50eb-2c8e-4fbf-8d77-3e9ff1d7b323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:18.677779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca50eb-2c8e-4fbf-8d77-3e9ff1d7b323 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:18.678121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca50eb-2c8e-4fbf-8d77-3e9ff1d7b323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:18.678478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca50eb-2c8e-4fbf-8d77-3e9ff1d7b323 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:18.679204 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca50eb-2c8e-4fbf-8d77-3e9ff1d7b323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:18.681185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca50eb-2c8e-4fbf-8d77-3e9ff1d7b323 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:18.733095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:18.745684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1060/2118] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:56:18 2022] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:56:18.749711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b1445-a94e-490a-bfe6-4dda1d412046 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:18.796414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b1445-a94e-490a-bfe6-4dda1d412046 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:18.883690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca50eb-2c8e-4fbf-8d77-3e9ff1d7b323 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:18.886205 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9eca50eb-2c8e-4fbf-8d77-3e9ff1d7b323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:18.951096 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049032d-042d-4d77-84dc-f16accca140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:18.951755 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049032d-042d-4d77-84dc-f16accca140d admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:18.952153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049032d-042d-4d77-84dc-f16accca140d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:18.952483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049032d-042d-4d77-84dc-f16accca140d admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:18.953185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049032d-042d-4d77-84dc-f16accca140d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:18.958247 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049032d-042d-4d77-84dc-f16accca140d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:19.032100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1059/2119] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:56:18 2022] POST /identity/v3/users => generated 296 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:56:19.049859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049032d-042d-4d77-84dc-f16accca140d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:19.079197 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049032d-042d-4d77-84dc-f16accca140d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:19.096749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca50eb-2c8e-4fbf-8d77-3e9ff1d7b323 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:19.096907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616358b-7842-4138-ab22-13d8c8daecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:19.097404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616358b-7842-4138-ab22-13d8c8daecdd admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:19.097770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616358b-7842-4138-ab22-13d8c8daecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:19.098134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616358b-7842-4138-ab22-13d8c8daecdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:19.101119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616358b-7842-4138-ab22-13d8c8daecdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:19.103769 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616358b-7842-4138-ab22-13d8c8daecdd admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:19.122425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:19.123955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:19.125272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:19.126320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] PATH_INFO: `/v3/projects/3f90c3762e5b4b90b9f09b6584db20fe` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:19.134036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f90c3762e5b4b90b9f09b6584db20fe)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:19.136517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:19.152284 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1060/2120] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:19.156442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616358b-7842-4138-ab22-13d8c8daecdd admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:19.171990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616358b-7842-4138-ab22-13d8c8daecdd admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:19.180872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff6ccc-a6ee-4edd-8fe8-86bbec018d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:19.181924 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff6ccc-a6ee-4edd-8fe8-86bbec018d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:19.182409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff6ccc-a6ee-4edd-8fe8-86bbec018d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:19.182935 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff6ccc-a6ee-4edd-8fe8-86bbec018d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:19.184021 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff6ccc-a6ee-4edd-8fe8-86bbec018d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:19.190172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff6ccc-a6ee-4edd-8fe8-86bbec018d4a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:19.210714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1061/2121] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:19.215260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff6ccc-a6ee-4edd-8fe8-86bbec018d4a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:19.233068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff6ccc-a6ee-4edd-8fe8-86bbec018d4a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:19.263851 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f90c3762e5b4b90b9f09b6584db20fe', 'request_id': 'req-644239e3-91ad-4df3-8de7-9ba89fca2612'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:19.279015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f90c3762e5b4b90b9f09b6584db20fe', 'request_id': 'req-644239e3-91ad-4df3-8de7-9ba89fca2612'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:19.295984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f90c3762e5b4b90b9f09b6584db20fe', 'request_id': 'req-644239e3-91ad-4df3-8de7-9ba89fca2612'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:19.308678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] The token cache is being invalidate because project 3f90c3762e5b4b90b9f09b6584db20fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:19.308966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:19.309639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:19.314235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1061/2122] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:18 2022] DELETE /identity/v3/projects/3f90c3762e5b4b90b9f09b6584db20fe => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:56:19.315879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:19.317814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:19.374428 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8faf-ffbb-451b-8d95-1f7a780e48a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:19.378300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8faf-ffbb-451b-8d95-1f7a780e48a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:19.378579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8faf-ffbb-451b-8d95-1f7a780e48a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:19.378884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8faf-ffbb-451b-8d95-1f7a780e48a6 admin admin] PATH_INFO: `/v3/projects/cb0faceb9a524889936700d16fa3b6cb/users/252d7659eedc4247bc71e9369a3f9b58/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:19.454528 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd8faf-ffbb-451b-8d95-1f7a780e48a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0faceb9a524889936700d16fa3b6cb, user_id=252d7659eedc4247bc71e9369a3f9b58, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:19.457297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd8faf-ffbb-451b-8d95-1f7a780e48a6 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:19.493916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1062/2123] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:56:19 2022] PUT /identity/v3/projects/cb0faceb9a524889936700d16fa3b6cb/users/252d7659eedc4247bc71e9369a3f9b58/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:19.508180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d35d5-184d-47ca-b8ad-b9545f5f23f8 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:19.508461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d35d5-184d-47ca-b8ad-b9545f5f23f8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:19.508733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d35d5-184d-47ca-b8ad-b9545f5f23f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:19.532412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644239e3-91ad-4df3-8de7-9ba89fca2612 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:19.563270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-803d35d5-184d-47ca-b8ad-b9545f5f23f8 None None] MFA Rules not processed for user `252d7659eedc4247bc71e9369a3f9b58`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:19.564494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-803d35d5-184d-47ca-b8ad-b9545f5f23f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:19.574759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:19.596818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:19.635843 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:19.636820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:19.637240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:19.637949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] PATH_INFO: `/v3/users/7bb3980978904e18909318804c3b3a21` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:19.639420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb3980978904e18909318804c3b3a21)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:19.645758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:19.727826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1063/2124] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:56:19.752773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb3980978904e18909318804c3b3a21'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:19.754542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d35d5-184d-47ca-b8ad-b9545f5f23f8 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:19.757468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-803d35d5-184d-47ca-b8ad-b9545f5f23f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:19.787055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb3980978904e18909318804c3b3a21'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:19.808508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb3980978904e18909318804c3b3a21'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:19.828371 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb3980978904e18909318804c3b3a21'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:19.829104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb3980978904e18909318804c3b3a21'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:19.839973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1062/2125] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:56:19 2022] DELETE /identity/v3/users/7bb3980978904e18909318804c3b3a21 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:19.870975 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d35d5-184d-47ca-b8ad-b9545f5f23f8 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:19.978581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724ff81-62ca-4c46-ad1c-6bdb8053709d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:19.979365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724ff81-62ca-4c46-ad1c-6bdb8053709d service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:19.980574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724ff81-62ca-4c46-ad1c-6bdb8053709d service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:19.980916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724ff81-62ca-4c46-ad1c-6bdb8053709d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:19.983173 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2724ff81-62ca-4c46-ad1c-6bdb8053709d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:20.132048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724ff81-62ca-4c46-ad1c-6bdb8053709d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:20.133554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724ff81-62ca-4c46-ad1c-6bdb8053709d service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:20.167515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1064/2126] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:22.657063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:22.659212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:22.825680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea983c-7470-475b-92d2-d7891d3b527f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:22.834067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:22.835709 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:22.836694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:22.837615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] PATH_INFO: `/v3/projects/f73d51442303432598683dcf40ca9823` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:22.839812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f73d51442303432598683dcf40ca9823)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:22.844381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:22.960805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73d51442303432598683dcf40ca9823', 'request_id': 'req-82c85783-95ac-49d4-b1f1-8147a5678ba2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:23.001357 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73d51442303432598683dcf40ca9823', 'request_id': 'req-82c85783-95ac-49d4-b1f1-8147a5678ba2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:23.005305 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:23.017683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73d51442303432598683dcf40ca9823', 'request_id': 'req-82c85783-95ac-49d4-b1f1-8147a5678ba2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:23.067854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] The token cache is being invalidate because project f73d51442303432598683dcf40ca9823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:23.070876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:23.072695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:23.075798 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1063/2127] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:22 2022] DELETE /identity/v3/projects/f73d51442303432598683dcf40ca9823 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:23.079772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724ff81-62ca-4c46-ad1c-6bdb8053709d service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:23.094304 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724ff81-62ca-4c46-ad1c-6bdb8053709d service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:23.120525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:23.217828 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa04ff-f872-4dc1-876c-bf73dbb1ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:23.218776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa04ff-f872-4dc1-876c-bf73dbb1ea0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:23.219170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa04ff-f872-4dc1-876c-bf73dbb1ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:23.219550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa04ff-f872-4dc1-876c-bf73dbb1ea0b admin admin] PATH_INFO: `/v3/users/8d3b3ed3525e49869d9b779f503dc07c` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:23.220949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa04ff-f872-4dc1-876c-bf73dbb1ea0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d3b3ed3525e49869d9b779f503dc07c)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:23.223133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa04ff-f872-4dc1-876c-bf73dbb1ea0b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:23.317251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3caa04ff-f872-4dc1-876c-bf73dbb1ea0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d3b3ed3525e49869d9b779f503dc07c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:23.318262 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3caa04ff-f872-4dc1-876c-bf73dbb1ea0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d3b3ed3525e49869d9b779f503dc07c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:23.342317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3caa04ff-f872-4dc1-876c-bf73dbb1ea0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d3b3ed3525e49869d9b779f503dc07c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:23.360599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3caa04ff-f872-4dc1-876c-bf73dbb1ea0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d3b3ed3525e49869d9b779f503dc07c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:23.388805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3caa04ff-f872-4dc1-876c-bf73dbb1ea0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d3b3ed3525e49869d9b779f503dc07c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:23.411155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1065/2128] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:56:23 2022] DELETE /identity/v3/users/8d3b3ed3525e49869d9b779f503dc07c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:24.714211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:24.715858 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:24.738538 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c85783-95ac-49d4-b1f1-8147a5678ba2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:24.840067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718b97f-8dc1-47e5-855d-a8ac148ef01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:24.841094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718b97f-8dc1-47e5-855d-a8ac148ef01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:24.841603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718b97f-8dc1-47e5-855d-a8ac148ef01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:24.842110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718b97f-8dc1-47e5-855d-a8ac148ef01d admin admin] PATH_INFO: `/v3/projects/e27e63d5705c496bbf8ac133fa3f8b5b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:24.843719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718b97f-8dc1-47e5-855d-a8ac148ef01d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e27e63d5705c496bbf8ac133fa3f8b5b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:24.846113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718b97f-8dc1-47e5-855d-a8ac148ef01d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:24.922421 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2718b97f-8dc1-47e5-855d-a8ac148ef01d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27e63d5705c496bbf8ac133fa3f8b5b', 'request_id': 'req-2718b97f-8dc1-47e5-855d-a8ac148ef01d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:24.932089 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2718b97f-8dc1-47e5-855d-a8ac148ef01d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27e63d5705c496bbf8ac133fa3f8b5b', 'request_id': 'req-2718b97f-8dc1-47e5-855d-a8ac148ef01d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:24.960501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2718b97f-8dc1-47e5-855d-a8ac148ef01d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27e63d5705c496bbf8ac133fa3f8b5b', 'request_id': 'req-2718b97f-8dc1-47e5-855d-a8ac148ef01d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:24.978422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2718b97f-8dc1-47e5-855d-a8ac148ef01d admin admin] The token cache is being invalidate because project e27e63d5705c496bbf8ac133fa3f8b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:24.978703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2718b97f-8dc1-47e5-855d-a8ac148ef01d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:24.979383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2718b97f-8dc1-47e5-855d-a8ac148ef01d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:24.981165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1064/2129] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:24 2022] DELETE /identity/v3/projects/e27e63d5705c496bbf8ac133fa3f8b5b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:24.986184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49df2-1d00-4cb2-8e66-928117b48dae None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:24.986780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49df2-1d00-4cb2-8e66-928117b48dae None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:24.986780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49df2-1d00-4cb2-8e66-928117b48dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:25.010183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-74b49df2-1d00-4cb2-8e66-928117b48dae None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:25.011718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-74b49df2-1d00-4cb2-8e66-928117b48dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:25.096681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d7d76-3b48-404f-a127-8b1c4e97eca3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:25.096968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d7d76-3b48-404f-a127-8b1c4e97eca3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:25.097244 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d7d76-3b48-404f-a127-8b1c4e97eca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:25.108497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1066/2130] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:25.130147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-866d7d76-3b48-404f-a127-8b1c4e97eca3 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:25.131929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-866d7d76-3b48-404f-a127-8b1c4e97eca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:25.140822 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1065/2131] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:25.147589 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b49df2-1d00-4cb2-8e66-928117b48dae None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:25.159064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b49df2-1d00-4cb2-8e66-928117b48dae None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:25.164776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d641665-0d99-4175-84ca-fc864106671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:25.165472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d641665-0d99-4175-84ca-fc864106671d admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:25.165755 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d641665-0d99-4175-84ca-fc864106671d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:25.166030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d641665-0d99-4175-84ca-fc864106671d admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:25.166750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d641665-0d99-4175-84ca-fc864106671d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:56:25.167984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d641665-0d99-4175-84ca-fc864106671d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:25.169935 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d641665-0d99-4175-84ca-fc864106671d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:25.187944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d7d76-3b48-404f-a127-8b1c4e97eca3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:25.190875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1067/2132] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:56:25.198612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d7d76-3b48-404f-a127-8b1c4e97eca3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:25.206247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec6660-3676-451e-8019-1a411ae7721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:25.219751 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec6660-3676-451e-8019-1a411ae7721e admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:25.221988 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec6660-3676-451e-8019-1a411ae7721e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:25.222460 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec6660-3676-451e-8019-1a411ae7721e admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:25.224502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec6660-3676-451e-8019-1a411ae7721e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:25.228407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec6660-3676-451e-8019-1a411ae7721e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:25.284185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1066/2133] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:56:25 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:56:25.288921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d641665-0d99-4175-84ca-fc864106671d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:25.302507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d641665-0d99-4175-84ca-fc864106671d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:25.335465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:25.381128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284bf46-a71d-49ff-9546-3887eec57a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:25.382668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284bf46-a71d-49ff-9546-3887eec57a40 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:25.382963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284bf46-a71d-49ff-9546-3887eec57a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:25.383242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284bf46-a71d-49ff-9546-3887eec57a40 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:25.383972 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284bf46-a71d-49ff-9546-3887eec57a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:25.386158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284bf46-a71d-49ff-9546-3887eec57a40 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:25.436086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec6660-3676-451e-8019-1a411ae7721e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:25.449693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1068/2134] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:56:25 2022] POST /identity/v3/users => generated 282 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:56:25.451817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec6660-3676-451e-8019-1a411ae7721e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:25.458105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679940e-f7e3-42b6-b9fe-7cb63bf16cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:25.458842 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679940e-f7e3-42b6-b9fe-7cb63bf16cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:25.459188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679940e-f7e3-42b6-b9fe-7cb63bf16cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:25.460219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679940e-f7e3-42b6-b9fe-7cb63bf16cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:25.461657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679940e-f7e3-42b6-b9fe-7cb63bf16cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:25.462741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679940e-f7e3-42b6-b9fe-7cb63bf16cb2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:25.488136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284bf46-a71d-49ff-9546-3887eec57a40 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:25.489066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1067/2135] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:56:25.507268 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284bf46-a71d-49ff-9546-3887eec57a40 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:25.522616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d2e1-20fc-4afd-bf54-4a728a3e0466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:25.523461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d2e1-20fc-4afd-bf54-4a728a3e0466 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:25.523894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d2e1-20fc-4afd-bf54-4a728a3e0466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:25.524305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d2e1-20fc-4afd-bf54-4a728a3e0466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:25.525747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97d2e1-20fc-4afd-bf54-4a728a3e0466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:25.527422 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97d2e1-20fc-4afd-bf54-4a728a3e0466 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:25.551345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1069/2136] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:56:25.551553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679940e-f7e3-42b6-b9fe-7cb63bf16cb2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:25.565286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679940e-f7e3-42b6-b9fe-7cb63bf16cb2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:25.572114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebec3bd-5336-4275-8ab7-856553012ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:25.573183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebec3bd-5336-4275-8ab7-856553012ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:25.573568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebec3bd-5336-4275-8ab7-856553012ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:25.573999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebec3bd-5336-4275-8ab7-856553012ae5 admin admin] PATH_INFO: `/v3/projects/12ffd694c40c4c0aa3d9fd048753afd4/users/d84c25d62eab4da6a354cc774ab32579/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:25.601768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebec3bd-5336-4275-8ab7-856553012ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ffd694c40c4c0aa3d9fd048753afd4, user_id=d84c25d62eab4da6a354cc774ab32579, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:25.606258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebec3bd-5336-4275-8ab7-856553012ae5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:25.640129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706450c-69a2-42b6-af98-78c3cade4165 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:25.640426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706450c-69a2-42b6-af98-78c3cade4165 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:25.640615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706450c-69a2-42b6-af98-78c3cade4165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:25.641329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1068/2137] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:56:25 2022] PUT /identity/v3/projects/12ffd694c40c4c0aa3d9fd048753afd4/users/d84c25d62eab4da6a354cc774ab32579/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:25.691473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2706450c-69a2-42b6-af98-78c3cade4165 None None] MFA Rules not processed for user `d84c25d62eab4da6a354cc774ab32579`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:25.692956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2706450c-69a2-42b6-af98-78c3cade4165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:25.805291 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1070/2138] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:25.811264 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebec3bd-5336-4275-8ab7-856553012ae5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:25.834708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:25.916958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebec3bd-5336-4275-8ab7-856553012ae5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:25.923123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8afa9e-3f91-4a18-ae68-b5e49541db5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:25.924121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8afa9e-3f91-4a18-ae68-b5e49541db5d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:25.924650 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8afa9e-3f91-4a18-ae68-b5e49541db5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:25.925130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8afa9e-3f91-4a18-ae68-b5e49541db5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:25.927220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8afa9e-3f91-4a18-ae68-b5e49541db5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:25.930873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8afa9e-3f91-4a18-ae68-b5e49541db5d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:26.001549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1069/2139] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:56:25 2022] POST /identity/v3/projects => generated 365 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:56:26.006057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706450c-69a2-42b6-af98-78c3cade4165 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:26.030510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706450c-69a2-42b6-af98-78c3cade4165 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:26.160705 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd6857-a880-40e0-a6e1-c87a64db066c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:26.161560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd6857-a880-40e0-a6e1-c87a64db066c admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:26.162187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd6857-a880-40e0-a6e1-c87a64db066c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:26.163157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd6857-a880-40e0-a6e1-c87a64db066c admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:26.164278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd6857-a880-40e0-a6e1-c87a64db066c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:26.166322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd6857-a880-40e0-a6e1-c87a64db066c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:26.203206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1071/2140] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:56:26 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:56:26.206072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8afa9e-3f91-4a18-ae68-b5e49541db5d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:26.222419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8afa9e-3f91-4a18-ae68-b5e49541db5d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:26.237028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e599f98-9d26-492f-9f60-b251f797ba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:26.238475 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e599f98-9d26-492f-9f60-b251f797ba18 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:26.239259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e599f98-9d26-492f-9f60-b251f797ba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:26.239740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e599f98-9d26-492f-9f60-b251f797ba18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:26.241413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e599f98-9d26-492f-9f60-b251f797ba18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:26.244323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e599f98-9d26-492f-9f60-b251f797ba18 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:26.267855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1070/2141] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:26.272743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd6857-a880-40e0-a6e1-c87a64db066c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:26.295027 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd6857-a880-40e0-a6e1-c87a64db066c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:26.302151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d425643-075e-4072-be26-0f93fd70dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:26.303863 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d425643-075e-4072-be26-0f93fd70dfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:26.304356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d425643-075e-4072-be26-0f93fd70dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:26.304838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d425643-075e-4072-be26-0f93fd70dfd2 admin admin] PATH_INFO: `/v3/projects/2fe83106585c4c31b1fba154fbcba4d0/users/5440934ac15746e895ec67322d5151c1/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:26.329979 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d425643-075e-4072-be26-0f93fd70dfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe83106585c4c31b1fba154fbcba4d0, user_id=5440934ac15746e895ec67322d5151c1, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:26.334034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d425643-075e-4072-be26-0f93fd70dfd2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:26.369590 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1072/2142] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:56:26 2022] PUT /identity/v3/projects/2fe83106585c4c31b1fba154fbcba4d0/users/5440934ac15746e895ec67322d5151c1/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:26.370327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e599f98-9d26-492f-9f60-b251f797ba18 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:26.410408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e599f98-9d26-492f-9f60-b251f797ba18 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:26.530755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c9e1e-9dea-4073-bfb2-dbc75e985c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:26.531610 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9e1e-9dea-4073-bfb2-dbc75e985c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:26.531893 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9e1e-9dea-4073-bfb2-dbc75e985c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:26.532165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9e1e-9dea-4073-bfb2-dbc75e985c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:26.532821 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c9e1e-9dea-4073-bfb2-dbc75e985c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:26.534451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c9e1e-9dea-4073-bfb2-dbc75e985c08 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:26.551450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1071/2143] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:26.555560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d425643-075e-4072-be26-0f93fd70dfd2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:26.561472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:26.572286 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d425643-075e-4072-be26-0f93fd70dfd2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:26.586456 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d958d1-9cad-4ca2-a3cc-70b5ab0d6533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:26.588864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d958d1-9cad-4ca2-a3cc-70b5ab0d6533 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:26.591020 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d958d1-9cad-4ca2-a3cc-70b5ab0d6533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:26.591684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d958d1-9cad-4ca2-a3cc-70b5ab0d6533 admin admin] PATH_INFO: `/v3/projects/2fe83106585c4c31b1fba154fbcba4d0/users/5440934ac15746e895ec67322d5151c1/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:26.599992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d958d1-9cad-4ca2-a3cc-70b5ab0d6533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe83106585c4c31b1fba154fbcba4d0, user_id=5440934ac15746e895ec67322d5151c1, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:26.605731 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d958d1-9cad-4ca2-a3cc-70b5ab0d6533 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:26.638606 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1073/2144] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:56:26 2022] PUT /identity/v3/projects/2fe83106585c4c31b1fba154fbcba4d0/users/5440934ac15746e895ec67322d5151c1/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:26.639018 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eec836-f003-48f0-9d62-72ce1a78be3a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:26.639310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eec836-f003-48f0-9d62-72ce1a78be3a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:26.639584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eec836-f003-48f0-9d62-72ce1a78be3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:26.684592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e4eec836-f003-48f0-9d62-72ce1a78be3a None None] MFA Rules not processed for user `5440934ac15746e895ec67322d5151c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:26.686753 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e4eec836-f003-48f0-9d62-72ce1a78be3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:26.843065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1072/2145] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:26.883534 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d958d1-9cad-4ca2-a3cc-70b5ab0d6533 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:26.885784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-49d958d1-9cad-4ca2-a3cc-70b5ab0d6533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:27.029956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d958d1-9cad-4ca2-a3cc-70b5ab0d6533 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:27.035344 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408499-ec41-45a8-a311-492dcd1c90ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:27.036271 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408499-ec41-45a8-a311-492dcd1c90ca service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:27.036732 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408499-ec41-45a8-a311-492dcd1c90ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:27.037656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408499-ec41-45a8-a311-492dcd1c90ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:27.055593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49408499-ec41-45a8-a311-492dcd1c90ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:27.059278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49408499-ec41-45a8-a311-492dcd1c90ca service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:27.088965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1074/2146] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:32.860986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eec836-f003-48f0-9d62-72ce1a78be3a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:32.863267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e4eec836-f003-48f0-9d62-72ce1a78be3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:32.910386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eec836-f003-48f0-9d62-72ce1a78be3a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:32.918647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed45408-4a93-45ed-8721-871f939826f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:32.921523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45408-4a93-45ed-8721-871f939826f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:32.922147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45408-4a93-45ed-8721-871f939826f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:32.931394 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45408-4a93-45ed-8721-871f939826f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:32.939203 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:33.099025 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed45408-4a93-45ed-8721-871f939826f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:33.101589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed45408-4a93-45ed-8721-871f939826f9 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:33.116156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1073/2147] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:35.127153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408499-ec41-45a8-a311-492dcd1c90ca service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:35.128658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-49408499-ec41-45a8-a311-492dcd1c90ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:35.256469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408499-ec41-45a8-a311-492dcd1c90ca service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:35.263240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:35.263992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:35.265200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:35.265544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] PATH_INFO: `/v3/users/252d7659eedc4247bc71e9369a3f9b58` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:35.277472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=252d7659eedc4247bc71e9369a3f9b58)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:35.279765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:35.399062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252d7659eedc4247bc71e9369a3f9b58'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:35.400182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252d7659eedc4247bc71e9369a3f9b58'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:35.416386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252d7659eedc4247bc71e9369a3f9b58'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:35.448297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252d7659eedc4247bc71e9369a3f9b58'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:35.467184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252d7659eedc4247bc71e9369a3f9b58'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:35.478591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1075/2148] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:56:35 2022] DELETE /identity/v3/users/252d7659eedc4247bc71e9369a3f9b58 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:35.480552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d5930-0789-45fe-bfd7-8784f3c00d24 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:35.481033 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d5930-0789-45fe-bfd7-8784f3c00d24 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:35.481284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d5930-0789-45fe-bfd7-8784f3c00d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:35.529250 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2f3d5930-0789-45fe-bfd7-8784f3c00d24 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:35.530672 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2f3d5930-0789-45fe-bfd7-8784f3c00d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:35.636921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1074/2149] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:35.680901 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:35.683336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:35.707407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:35.789368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334ec30-8295-43e1-91e2-d0618b62ffdb admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:35.794176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda558-736e-4732-b5df-d494e770b6d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:35.795467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda558-736e-4732-b5df-d494e770b6d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:35.796048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda558-736e-4732-b5df-d494e770b6d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:35.796770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda558-736e-4732-b5df-d494e770b6d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:35.810065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dda558-736e-4732-b5df-d494e770b6d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:35.812842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dda558-736e-4732-b5df-d494e770b6d1 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:35.830970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1076/2150] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:36.831329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d5930-0789-45fe-bfd7-8784f3c00d24 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:36.832777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2f3d5930-0789-45fe-bfd7-8784f3c00d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:36.855640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d5930-0789-45fe-bfd7-8784f3c00d24 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:36.862011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:36.864088 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:36.865357 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:36.865796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] PATH_INFO: `/v3/users/d84c25d62eab4da6a354cc774ab32579` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:36.868587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84c25d62eab4da6a354cc774ab32579)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:36.871927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:36.952417 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84c25d62eab4da6a354cc774ab32579'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:36.975960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84c25d62eab4da6a354cc774ab32579'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:36.983896 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84c25d62eab4da6a354cc774ab32579'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:37.009604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84c25d62eab4da6a354cc774ab32579'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:37.010450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84c25d62eab4da6a354cc774ab32579'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:37.025514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1075/2151] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:56:36 2022] DELETE /identity/v3/users/d84c25d62eab4da6a354cc774ab32579 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:37.029640 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946dec4-8beb-4cb1-b7e5-e7374d5c42be None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:37.030126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946dec4-8beb-4cb1-b7e5-e7374d5c42be None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:37.030235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946dec4-8beb-4cb1-b7e5-e7374d5c42be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:37.067591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5946dec4-8beb-4cb1-b7e5-e7374d5c42be None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:37.069527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5946dec4-8beb-4cb1-b7e5-e7374d5c42be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:37.155187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1077/2152] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:37.190023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:37.193327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:37.218856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:37.281324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008beaa-99ae-4269-80ea-110311d4b83b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:37.285844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11578063-cb7e-4813-a92f-a9f9202ba7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:37.286613 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11578063-cb7e-4813-a92f-a9f9202ba7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:37.287047 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11578063-cb7e-4813-a92f-a9f9202ba7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:37.287668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11578063-cb7e-4813-a92f-a9f9202ba7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:37.299570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11578063-cb7e-4813-a92f-a9f9202ba7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:37.302133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11578063-cb7e-4813-a92f-a9f9202ba7c2 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:37.313914 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1076/2153] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:37.479652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946dec4-8beb-4cb1-b7e5-e7374d5c42be None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:37.481133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5946dec4-8beb-4cb1-b7e5-e7374d5c42be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:37.496922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946dec4-8beb-4cb1-b7e5-e7374d5c42be None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:37.503379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:37.503960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:37.504464 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:37.504833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065 admin admin] PATH_INFO: `/v3/projects/cb0faceb9a524889936700d16fa3b6cb` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:37.507039 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0faceb9a524889936700d16fa3b6cb)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:37.511462 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:37.604956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0faceb9a524889936700d16fa3b6cb', 'request_id': 'req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:37.614901 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0faceb9a524889936700d16fa3b6cb', 'request_id': 'req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:37.623301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0faceb9a524889936700d16fa3b6cb', 'request_id': 'req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:37.650468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065 admin admin] The token cache is being invalidate because project cb0faceb9a524889936700d16fa3b6cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:37.650910 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:37.651554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4a29a92b-31f0-4e4c-a2e9-8d6dafe5a065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:37.653782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1078/2154] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:37 2022] DELETE /identity/v3/projects/cb0faceb9a524889936700d16fa3b6cb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:37.659102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1643-678e-468c-a6d2-8c1f2bd65033 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:37.659306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1643-678e-468c-a6d2-8c1f2bd65033 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:37.659502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1643-678e-468c-a6d2-8c1f2bd65033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:37.697563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0c3e1643-678e-468c-a6d2-8c1f2bd65033 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:37.698843 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0c3e1643-678e-468c-a6d2-8c1f2bd65033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:37.849040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1077/2155] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:37.858287 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42e0fd-038a-4f44-a75b-e62a8fa83af0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:37.858766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42e0fd-038a-4f44-a75b-e62a8fa83af0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:37.859114 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42e0fd-038a-4f44-a75b-e62a8fa83af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:37.891974 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2c42e0fd-038a-4f44-a75b-e62a8fa83af0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:37.895523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2c42e0fd-038a-4f44-a75b-e62a8fa83af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:37.917535 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1079/2156] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:37.920105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1643-678e-468c-a6d2-8c1f2bd65033 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:37.955994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1643-678e-468c-a6d2-8c1f2bd65033 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:37.964364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34aea9-e092-4bfd-85d4-8df392452342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:37.965244 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34aea9-e092-4bfd-85d4-8df392452342 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:37.965704 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34aea9-e092-4bfd-85d4-8df392452342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:37.966139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34aea9-e092-4bfd-85d4-8df392452342 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:37.967234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34aea9-e092-4bfd-85d4-8df392452342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:56:37.967816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34aea9-e092-4bfd-85d4-8df392452342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:37.970261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34aea9-e092-4bfd-85d4-8df392452342 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:37.994619 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1078/2157] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:56:37.999137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42e0fd-038a-4f44-a75b-e62a8fa83af0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:38.011763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42e0fd-038a-4f44-a75b-e62a8fa83af0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:38.024516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fc3ce-2737-4296-8068-27b8fc14cae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:38.026667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fc3ce-2737-4296-8068-27b8fc14cae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:38.027305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fc3ce-2737-4296-8068-27b8fc14cae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:38.028082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fc3ce-2737-4296-8068-27b8fc14cae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:38.030041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fc3ce-2737-4296-8068-27b8fc14cae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:38.039790 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fc3ce-2737-4296-8068-27b8fc14cae1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:38.108055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1080/2158] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:56:37 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:56:38.109669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34aea9-e092-4bfd-85d4-8df392452342 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:38.130082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34aea9-e092-4bfd-85d4-8df392452342 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:38.302442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cd550-4c04-45ab-8c76-d250d6240a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:38.304859 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd550-4c04-45ab-8c76-d250d6240a39 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:38.304859 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd550-4c04-45ab-8c76-d250d6240a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:38.304859 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd550-4c04-45ab-8c76-d250d6240a39 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:38.305172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cd550-4c04-45ab-8c76-d250d6240a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:38.307084 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cd550-4c04-45ab-8c76-d250d6240a39 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:38.362597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1079/2159] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:56:38 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:56:38.366039 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fc3ce-2737-4296-8068-27b8fc14cae1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:38.376999 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fc3ce-2737-4296-8068-27b8fc14cae1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:38.382920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50814384-68cb-4b2d-8652-b857ed6f0c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:38.384226 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50814384-68cb-4b2d-8652-b857ed6f0c58 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:38.384226 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50814384-68cb-4b2d-8652-b857ed6f0c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:38.384226 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50814384-68cb-4b2d-8652-b857ed6f0c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:38.386431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50814384-68cb-4b2d-8652-b857ed6f0c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:38.388096 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50814384-68cb-4b2d-8652-b857ed6f0c58 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:38.391224 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:38.405159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1081/2160] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:38.407323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cd550-4c04-45ab-8c76-d250d6240a39 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:38.423888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cd550-4c04-45ab-8c76-d250d6240a39 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:38.438534 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50814384-68cb-4b2d-8652-b857ed6f0c58 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:38.442112 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-50814384-68cb-4b2d-8652-b857ed6f0c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:38.449957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1e1f7-4e76-4214-a4a7-93a1c1d3a452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:38.450744 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1e1f7-4e76-4214-a4a7-93a1c1d3a452 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:38.451031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1e1f7-4e76-4214-a4a7-93a1c1d3a452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:38.451336 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1e1f7-4e76-4214-a4a7-93a1c1d3a452 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:38.451948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1e1f7-4e76-4214-a4a7-93a1c1d3a452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:38.457495 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1e1f7-4e76-4214-a4a7-93a1c1d3a452 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:38.462893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50814384-68cb-4b2d-8652-b857ed6f0c58 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:38.468713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:38.470632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:38.471384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:38.471669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] PATH_INFO: `/v3/projects/12ffd694c40c4c0aa3d9fd048753afd4` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:38.473221 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ffd694c40c4c0aa3d9fd048753afd4)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:38.480297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:38.485047 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1080/2161] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:38.489159 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1e1f7-4e76-4214-a4a7-93a1c1d3a452 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:38.510380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1e1f7-4e76-4214-a4a7-93a1c1d3a452 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:38.523237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c9d10-1542-4415-836a-d3aee9bff8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:38.523946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c9d10-1542-4415-836a-d3aee9bff8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:38.524190 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c9d10-1542-4415-836a-d3aee9bff8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:38.524489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c9d10-1542-4415-836a-d3aee9bff8b6 admin admin] PATH_INFO: `/v3/projects/518af5de781243449a655b4f925e15b8/users/bba6df848a4a48249012f6e6601e3956/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:38.557422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c9d10-1542-4415-836a-d3aee9bff8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=518af5de781243449a655b4f925e15b8, user_id=bba6df848a4a48249012f6e6601e3956, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:38.563564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c9d10-1542-4415-836a-d3aee9bff8b6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:38.590102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ffd694c40c4c0aa3d9fd048753afd4', 'request_id': 'req-51eb47f7-1a68-472e-b8ee-10eb00b151d1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:38.590969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1081/2162] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:56:38 2022] PUT /identity/v3/projects/518af5de781243449a655b4f925e15b8/users/bba6df848a4a48249012f6e6601e3956/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:56:38.602051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ead17-efcd-43ce-b2ca-fb0c59215e9e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:38.602428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ead17-efcd-43ce-b2ca-fb0c59215e9e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:38.602937 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ead17-efcd-43ce-b2ca-fb0c59215e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:38.606685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ffd694c40c4c0aa3d9fd048753afd4', 'request_id': 'req-51eb47f7-1a68-472e-b8ee-10eb00b151d1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:38.614188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:38.622712 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ffd694c40c4c0aa3d9fd048753afd4', 'request_id': 'req-51eb47f7-1a68-472e-b8ee-10eb00b151d1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:38.645548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] The token cache is being invalidate because project 12ffd694c40c4c0aa3d9fd048753afd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:38.645846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:38.647721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:38.653201 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1082/2163] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:38 2022] DELETE /identity/v3/projects/12ffd694c40c4c0aa3d9fd048753afd4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:38.656556 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:38.658127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:38.661814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-464ead17-efcd-43ce-b2ca-fb0c59215e9e None None] MFA Rules not processed for user `bba6df848a4a48249012f6e6601e3956`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:38.678056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-464ead17-efcd-43ce-b2ca-fb0c59215e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:38.840474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb47f7-1a68-472e-b8ee-10eb00b151d1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:38.853916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1082/2164] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:56:38.896313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ead17-efcd-43ce-b2ca-fb0c59215e9e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:38.898587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-464ead17-efcd-43ce-b2ca-fb0c59215e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:38.984137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:38.984788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:38.985069 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:38.985343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] PATH_INFO: `/v3/users/5440934ac15746e895ec67322d5151c1` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:38.987176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5440934ac15746e895ec67322d5151c1)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:38.990433 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:39.027685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ead17-efcd-43ce-b2ca-fb0c59215e9e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:39.040708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a9af-0905-41fd-929f-9a23f4bf156f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:39.043103 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a9af-0905-41fd-929f-9a23f4bf156f service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:39.045501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a9af-0905-41fd-929f-9a23f4bf156f service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:39.045788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a9af-0905-41fd-929f-9a23f4bf156f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:39.057388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:39.070371 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6a9af-0905-41fd-929f-9a23f4bf156f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:39.074461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6a9af-0905-41fd-929f-9a23f4bf156f service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:39.087563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5440934ac15746e895ec67322d5151c1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:39.088542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5440934ac15746e895ec67322d5151c1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:39.094221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1083/2165] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:56:39.099010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5440934ac15746e895ec67322d5151c1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:39.113314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5440934ac15746e895ec67322d5151c1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:39.141806 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5440934ac15746e895ec67322d5151c1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:39.155551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1083/2166] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:56:38 2022] DELETE /identity/v3/users/5440934ac15746e895ec67322d5151c1 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:56:39.992065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a9af-0905-41fd-929f-9a23f4bf156f service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:39.993545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8df6a9af-0905-41fd-929f-9a23f4bf156f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:40.022246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a9af-0905-41fd-929f-9a23f4bf156f service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:40.197308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790910a-e395-4713-960b-5e801bfb8307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:40.202475 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790910a-e395-4713-960b-5e801bfb8307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:40.205027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790910a-e395-4713-960b-5e801bfb8307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:40.205963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790910a-e395-4713-960b-5e801bfb8307 admin admin] PATH_INFO: `/v3/users/bba6df848a4a48249012f6e6601e3956` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:40.207766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790910a-e395-4713-960b-5e801bfb8307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba6df848a4a48249012f6e6601e3956)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:40.210642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:40.212996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:40.216020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790910a-e395-4713-960b-5e801bfb8307 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:40.252840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbfbdd-d699-4b7a-9742-2313b6be681c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:40.262618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a324c-7452-4760-a773-ade1f6f34148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:40.263847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a324c-7452-4760-a773-ade1f6f34148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:40.264391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a324c-7452-4760-a773-ade1f6f34148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:40.265041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a324c-7452-4760-a773-ade1f6f34148 admin admin] PATH_INFO: `/v3/projects/2fe83106585c4c31b1fba154fbcba4d0` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:40.266945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a324c-7452-4760-a773-ade1f6f34148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe83106585c4c31b1fba154fbcba4d0)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:40.269193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a324c-7452-4760-a773-ade1f6f34148 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:40.286813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:40.303059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c790910a-e395-4713-960b-5e801bfb8307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba6df848a4a48249012f6e6601e3956'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:40.325991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c790910a-e395-4713-960b-5e801bfb8307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba6df848a4a48249012f6e6601e3956'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:40.336964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c790910a-e395-4713-960b-5e801bfb8307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba6df848a4a48249012f6e6601e3956'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:40.350850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c790910a-e395-4713-960b-5e801bfb8307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba6df848a4a48249012f6e6601e3956'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:40.351894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c790910a-e395-4713-960b-5e801bfb8307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba6df848a4a48249012f6e6601e3956'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:40.369921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1084/2167] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:56:39 2022] DELETE /identity/v3/users/bba6df848a4a48249012f6e6601e3956 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:40.371398 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280b1e5-83a0-47e6-9d95-7d6753042abc None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:40.371673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280b1e5-83a0-47e6-9d95-7d6753042abc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:40.371949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280b1e5-83a0-47e6-9d95-7d6753042abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:40.381420 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-466a324c-7452-4760-a773-ade1f6f34148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe83106585c4c31b1fba154fbcba4d0', 'request_id': 'req-466a324c-7452-4760-a773-ade1f6f34148'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:40.397928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-466a324c-7452-4760-a773-ade1f6f34148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe83106585c4c31b1fba154fbcba4d0', 'request_id': 'req-466a324c-7452-4760-a773-ade1f6f34148'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:40.406667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-466a324c-7452-4760-a773-ade1f6f34148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe83106585c4c31b1fba154fbcba4d0', 'request_id': 'req-466a324c-7452-4760-a773-ade1f6f34148'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:40.418607 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b280b1e5-83a0-47e6-9d95-7d6753042abc None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:40.436598 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b280b1e5-83a0-47e6-9d95-7d6753042abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:40.441803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-466a324c-7452-4760-a773-ade1f6f34148 admin admin] The token cache is being invalidate because project 2fe83106585c4c31b1fba154fbcba4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:40.442114 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-466a324c-7452-4760-a773-ade1f6f34148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:40.442818 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-466a324c-7452-4760-a773-ade1f6f34148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:40.448264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1084/2168] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:40 2022] DELETE /identity/v3/projects/2fe83106585c4c31b1fba154fbcba4d0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:40.449987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb303b6e-7245-4ea9-a683-70aaf12316a0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:40.451934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb303b6e-7245-4ea9-a683-70aaf12316a0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:40.452217 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb303b6e-7245-4ea9-a683-70aaf12316a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:40.504756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-cb303b6e-7245-4ea9-a683-70aaf12316a0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:40.506575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cb303b6e-7245-4ea9-a683-70aaf12316a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:40.557501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1085/2169] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:40.575405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280b1e5-83a0-47e6-9d95-7d6753042abc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:40.577783 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b280b1e5-83a0-47e6-9d95-7d6753042abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:40.622210 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1085/2170] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:40.633066 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7573f4e-f4d7-441b-9186-79229adb73f9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:40.636555 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7573f4e-f4d7-441b-9186-79229adb73f9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:40.636975 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7573f4e-f4d7-441b-9186-79229adb73f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:40.669762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f7573f4e-f4d7-441b-9186-79229adb73f9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:40.671347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f7573f4e-f4d7-441b-9186-79229adb73f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:40.680796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1086/2171] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:56:40.681480 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280b1e5-83a0-47e6-9d95-7d6753042abc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:40.692059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7573f4e-f4d7-441b-9186-79229adb73f9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:40.692833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942317e-90f6-4f08-8c8c-ae803cf43b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:40.693815 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942317e-90f6-4f08-8c8c-ae803cf43b53 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:40.694160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942317e-90f6-4f08-8c8c-ae803cf43b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:40.694499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942317e-90f6-4f08-8c8c-ae803cf43b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:40.702211 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7573f4e-f4d7-441b-9186-79229adb73f9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:40.707179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942317e-90f6-4f08-8c8c-ae803cf43b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:40.708216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942317e-90f6-4f08-8c8c-ae803cf43b53 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:40.711318 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe23fcb-d747-4b5e-90d9-5b9a67ce2f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:40.712136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23fcb-d747-4b5e-90d9-5b9a67ce2f22 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:40.712599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23fcb-d747-4b5e-90d9-5b9a67ce2f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:40.713046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23fcb-d747-4b5e-90d9-5b9a67ce2f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:40.714076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe23fcb-d747-4b5e-90d9-5b9a67ce2f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:56:40.715051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe23fcb-d747-4b5e-90d9-5b9a67ce2f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:40.716843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe23fcb-d747-4b5e-90d9-5b9a67ce2f22 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:40.723439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1086/2172] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:40.738434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1087/2173] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:56:40.743097 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942317e-90f6-4f08-8c8c-ae803cf43b53 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:40.757639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942317e-90f6-4f08-8c8c-ae803cf43b53 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:40.763587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd74be-6c3a-412f-812d-6c6b252db1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:40.764487 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd74be-6c3a-412f-812d-6c6b252db1cf admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:40.764973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd74be-6c3a-412f-812d-6c6b252db1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:40.765444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd74be-6c3a-412f-812d-6c6b252db1cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:40.766280 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd74be-6c3a-412f-812d-6c6b252db1cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:40.769070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd74be-6c3a-412f-812d-6c6b252db1cf admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:40.810344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1087/2174] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:56:40 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:56:40.813959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe23fcb-d747-4b5e-90d9-5b9a67ce2f22 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:40.826777 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe23fcb-d747-4b5e-90d9-5b9a67ce2f22 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:40.847340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:40.917103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c810395-8604-480f-b86e-f64a26828224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:40.917810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810395-8604-480f-b86e-f64a26828224 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:40.918143 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810395-8604-480f-b86e-f64a26828224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:40.918898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810395-8604-480f-b86e-f64a26828224 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:40.919257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c810395-8604-480f-b86e-f64a26828224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:40.921416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c810395-8604-480f-b86e-f64a26828224 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:40.956081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1088/2175] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:56:40 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:56:40.957334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd74be-6c3a-412f-812d-6c6b252db1cf admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:40.969065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd74be-6c3a-412f-812d-6c6b252db1cf admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:40.974775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb1acd-ff48-45c9-ab6f-922cd0c66b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:40.975480 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb1acd-ff48-45c9-ab6f-922cd0c66b6a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:40.975826 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb1acd-ff48-45c9-ab6f-922cd0c66b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:40.976171 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb1acd-ff48-45c9-ab6f-922cd0c66b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:40.976900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb1acd-ff48-45c9-ab6f-922cd0c66b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:40.978565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb1acd-ff48-45c9-ab6f-922cd0c66b6a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:40.996075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1088/2176] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:40.998898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c810395-8604-480f-b86e-f64a26828224 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:41.012476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c810395-8604-480f-b86e-f64a26828224 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:41.018498 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e25d-03d2-47c2-8f2b-e1d7b365f119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:41.019395 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e25d-03d2-47c2-8f2b-e1d7b365f119 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:41.019600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e25d-03d2-47c2-8f2b-e1d7b365f119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:41.020189 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e25d-03d2-47c2-8f2b-e1d7b365f119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:41.020877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47e25d-03d2-47c2-8f2b-e1d7b365f119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:41.022621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47e25d-03d2-47c2-8f2b-e1d7b365f119 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:41.036018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1089/2177] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:41.040157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb1acd-ff48-45c9-ab6f-922cd0c66b6a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:41.051287 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb1acd-ff48-45c9-ab6f-922cd0c66b6a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:41.056834 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a1094-9002-4b68-a7b8-ea291b0d6522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:41.056834 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a1094-9002-4b68-a7b8-ea291b0d6522 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:41.056834 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a1094-9002-4b68-a7b8-ea291b0d6522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:41.056834 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a1094-9002-4b68-a7b8-ea291b0d6522 admin admin] PATH_INFO: `/v3/projects/7da2649ceae940aa8d29156dce154539/users/151edb585de746bfbab66d9f97372236/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:41.075369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a1094-9002-4b68-a7b8-ea291b0d6522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da2649ceae940aa8d29156dce154539, user_id=151edb585de746bfbab66d9f97372236, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:41.078003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a1094-9002-4b68-a7b8-ea291b0d6522 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:41.089230 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:41.094820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1089/2178] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:56:41 2022] PUT /identity/v3/projects/7da2649ceae940aa8d29156dce154539/users/151edb585de746bfbab66d9f97372236/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:41.105454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aceab3-0c74-49c9-9b66-b4fa9d8dae4f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:41.105895 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aceab3-0c74-49c9-9b66-b4fa9d8dae4f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:41.106049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aceab3-0c74-49c9-9b66-b4fa9d8dae4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:41.141233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-48aceab3-0c74-49c9-9b66-b4fa9d8dae4f None None] MFA Rules not processed for user `151edb585de746bfbab66d9f97372236`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:41.142623 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-48aceab3-0c74-49c9-9b66-b4fa9d8dae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:41.227892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1090/2179] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:41.246260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a1094-9002-4b68-a7b8-ea291b0d6522 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:41.290244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aceab3-0c74-49c9-9b66-b4fa9d8dae4f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:41.292346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-48aceab3-0c74-49c9-9b66-b4fa9d8dae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:41.363485 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a1094-9002-4b68-a7b8-ea291b0d6522 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:41.373630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e4ecc-8551-4f0a-90e2-ac74b75cbda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:41.375904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e4ecc-8551-4f0a-90e2-ac74b75cbda6 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:41.376996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e4ecc-8551-4f0a-90e2-ac74b75cbda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:41.377913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e4ecc-8551-4f0a-90e2-ac74b75cbda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:41.390921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e4ecc-8551-4f0a-90e2-ac74b75cbda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:41.393269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e4ecc-8551-4f0a-90e2-ac74b75cbda6 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:41.418637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aceab3-0c74-49c9-9b66-b4fa9d8dae4f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:41.420768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1090/2180] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:41.424479 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb6c33-02ef-4797-87b9-8b2d6383208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:41.425434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb6c33-02ef-4797-87b9-8b2d6383208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:41.425859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb6c33-02ef-4797-87b9-8b2d6383208d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:41.426300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb6c33-02ef-4797-87b9-8b2d6383208d admin admin] PATH_INFO: `/v3/projects/518af5de781243449a655b4f925e15b8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:41.428501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb6c33-02ef-4797-87b9-8b2d6383208d admin admin] RBAC: Authorizing `identity:delete_project(project_id=518af5de781243449a655b4f925e15b8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:41.432220 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb6c33-02ef-4797-87b9-8b2d6383208d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:41.461201 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:41.496756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-77bb6c33-02ef-4797-87b9-8b2d6383208d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '518af5de781243449a655b4f925e15b8', 'request_id': 'req-77bb6c33-02ef-4797-87b9-8b2d6383208d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:41.504211 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-77bb6c33-02ef-4797-87b9-8b2d6383208d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '518af5de781243449a655b4f925e15b8', 'request_id': 'req-77bb6c33-02ef-4797-87b9-8b2d6383208d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:41.512781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-77bb6c33-02ef-4797-87b9-8b2d6383208d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '518af5de781243449a655b4f925e15b8', 'request_id': 'req-77bb6c33-02ef-4797-87b9-8b2d6383208d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:41.529222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-77bb6c33-02ef-4797-87b9-8b2d6383208d admin admin] The token cache is being invalidate because project 518af5de781243449a655b4f925e15b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:41.529779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-77bb6c33-02ef-4797-87b9-8b2d6383208d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:41.530616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-77bb6c33-02ef-4797-87b9-8b2d6383208d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:41.532923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1091/2181] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:41 2022] DELETE /identity/v3/projects/518af5de781243449a655b4f925e15b8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:41.540478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209730c9-03af-4c38-bae0-5536f7a34bb6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:41.540478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209730c9-03af-4c38-bae0-5536f7a34bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:41.540478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209730c9-03af-4c38-bae0-5536f7a34bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:41.573475 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-209730c9-03af-4c38-bae0-5536f7a34bb6 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:41.576573 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-209730c9-03af-4c38-bae0-5536f7a34bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:41.663944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478afa4-572b-4503-80fa-334126a15150 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:41.664759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478afa4-572b-4503-80fa-334126a15150 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:41.665258 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478afa4-572b-4503-80fa-334126a15150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:41.669176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1091/2182] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:41.689712 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6478afa4-572b-4503-80fa-334126a15150 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:41.691070 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6478afa4-572b-4503-80fa-334126a15150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:41.700405 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1092/2183] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:56:41.704838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209730c9-03af-4c38-bae0-5536f7a34bb6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:41.720547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209730c9-03af-4c38-bae0-5536f7a34bb6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:41.726124 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5d1bb-329a-4d33-9c50-a73fc0349183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:41.726766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5d1bb-329a-4d33-9c50-a73fc0349183 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:41.727163 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5d1bb-329a-4d33-9c50-a73fc0349183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:41.727531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5d1bb-329a-4d33-9c50-a73fc0349183 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:41.728310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5d1bb-329a-4d33-9c50-a73fc0349183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:56:41.728714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5d1bb-329a-4d33-9c50-a73fc0349183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:41.730582 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5d1bb-329a-4d33-9c50-a73fc0349183 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:41.750962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1092/2184] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:56:41.756847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478afa4-572b-4503-80fa-334126a15150 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:41.766892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478afa4-572b-4503-80fa-334126a15150 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:41.772650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65c44c-ac00-44fb-b7a7-618b84d8c3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:41.773377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65c44c-ac00-44fb-b7a7-618b84d8c3bb admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:41.773754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65c44c-ac00-44fb-b7a7-618b84d8c3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:41.774123 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65c44c-ac00-44fb-b7a7-618b84d8c3bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:41.774908 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65c44c-ac00-44fb-b7a7-618b84d8c3bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:41.776912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65c44c-ac00-44fb-b7a7-618b84d8c3bb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:41.814386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1093/2185] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:56:41 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:56:41.821783 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5d1bb-329a-4d33-9c50-a73fc0349183 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:41.836108 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5d1bb-329a-4d33-9c50-a73fc0349183 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:41.925321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7ddaf-e8d8-48b4-91cb-f45e112d008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:41.925939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7ddaf-e8d8-48b4-91cb-f45e112d008b admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:41.926218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7ddaf-e8d8-48b4-91cb-f45e112d008b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:41.926489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7ddaf-e8d8-48b4-91cb-f45e112d008b admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:41.927215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7ddaf-e8d8-48b4-91cb-f45e112d008b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:41.930597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7ddaf-e8d8-48b4-91cb-f45e112d008b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:41.955968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1093/2186] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:56:41 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:56:41.960073 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65c44c-ac00-44fb-b7a7-618b84d8c3bb admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:41.971584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65c44c-ac00-44fb-b7a7-618b84d8c3bb admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:41.978610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53482a09-b1c5-47cf-9957-e75b230b2548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:41.979349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53482a09-b1c5-47cf-9957-e75b230b2548 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:41.979522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53482a09-b1c5-47cf-9957-e75b230b2548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:41.979797 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53482a09-b1c5-47cf-9957-e75b230b2548 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:41.980441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53482a09-b1c5-47cf-9957-e75b230b2548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:41.982204 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53482a09-b1c5-47cf-9957-e75b230b2548 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:41.995033 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1094/2187] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:41.999265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7ddaf-e8d8-48b4-91cb-f45e112d008b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:42.010610 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7ddaf-e8d8-48b4-91cb-f45e112d008b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:42.017495 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d9610-d101-4d9a-938f-b1731cbda430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:42.018148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d9610-d101-4d9a-938f-b1731cbda430 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:42.018429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d9610-d101-4d9a-938f-b1731cbda430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:42.018704 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d9610-d101-4d9a-938f-b1731cbda430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:42.019425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d9610-d101-4d9a-938f-b1731cbda430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:42.021254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d9610-d101-4d9a-938f-b1731cbda430 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:42.034105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1094/2188] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:42.039320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53482a09-b1c5-47cf-9957-e75b230b2548 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:42.049779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53482a09-b1c5-47cf-9957-e75b230b2548 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:42.055818 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d32f32-1f6a-40fa-b7be-44a3b1c3fc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:42.056572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d32f32-1f6a-40fa-b7be-44a3b1c3fc90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:42.056806 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d32f32-1f6a-40fa-b7be-44a3b1c3fc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:42.057083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d32f32-1f6a-40fa-b7be-44a3b1c3fc90 admin admin] PATH_INFO: `/v3/projects/dab6d1f8c6834031b111f9bc1fc69d34/users/0c14ce9bfb31412fa2220a5e8520ffc8/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:42.079144 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d32f32-1f6a-40fa-b7be-44a3b1c3fc90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab6d1f8c6834031b111f9bc1fc69d34, user_id=0c14ce9bfb31412fa2220a5e8520ffc8, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:42.082561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d32f32-1f6a-40fa-b7be-44a3b1c3fc90 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:42.102701 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1095/2189] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:56:42 2022] PUT /identity/v3/projects/dab6d1f8c6834031b111f9bc1fc69d34/users/0c14ce9bfb31412fa2220a5e8520ffc8/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:42.115561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0696d5-fc0a-4af8-92e5-0b101bc17749 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:42.115807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0696d5-fc0a-4af8-92e5-0b101bc17749 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:42.116086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0696d5-fc0a-4af8-92e5-0b101bc17749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:42.141231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:42.159264 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5f0696d5-fc0a-4af8-92e5-0b101bc17749 None None] MFA Rules not processed for user `0c14ce9bfb31412fa2220a5e8520ffc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:42.160482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5f0696d5-fc0a-4af8-92e5-0b101bc17749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:42.277102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1095/2190] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:42.287505 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d32f32-1f6a-40fa-b7be-44a3b1c3fc90 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:42.291634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e3d32f32-1f6a-40fa-b7be-44a3b1c3fc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:42.438149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d32f32-1f6a-40fa-b7be-44a3b1c3fc90 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:42.442763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c4fda-3554-4b41-abb4-cc45fe9bbdd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:42.443542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c4fda-3554-4b41-abb4-cc45fe9bbdd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:42.443817 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c4fda-3554-4b41-abb4-cc45fe9bbdd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:42.444339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c4fda-3554-4b41-abb4-cc45fe9bbdd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:42.474982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c4fda-3554-4b41-abb4-cc45fe9bbdd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:42.478458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c4fda-3554-4b41-abb4-cc45fe9bbdd1 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:42.492058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1096/2191] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:56:43.868113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0696d5-fc0a-4af8-92e5-0b101bc17749 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:43.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5f0696d5-fc0a-4af8-92e5-0b101bc17749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:43.969424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0696d5-fc0a-4af8-92e5-0b101bc17749 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:43.975008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:43.975969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:43.976307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:43.976643 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] PATH_INFO: `/v3/users/10b19250bb474346956b9bae502fa3c3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:43.978009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b19250bb474346956b9bae502fa3c3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:43.980217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:44.038373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b19250bb474346956b9bae502fa3c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:44.057032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b19250bb474346956b9bae502fa3c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:44.067517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b19250bb474346956b9bae502fa3c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:44.087654 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b19250bb474346956b9bae502fa3c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:44.088344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b19250bb474346956b9bae502fa3c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:44.099818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1096/2192] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:56:43 2022] DELETE /identity/v3/users/10b19250bb474346956b9bae502fa3c3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:44.101515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d193ca-c84f-4e90-88e9-23e9dc718e68 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:44.102720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d193ca-c84f-4e90-88e9-23e9dc718e68 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:44.103011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d193ca-c84f-4e90-88e9-23e9dc718e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:44.138567 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-78d193ca-c84f-4e90-88e9-23e9dc718e68 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:44.139835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-78d193ca-c84f-4e90-88e9-23e9dc718e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:44.233986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:44.257555 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1097/2193] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:44.308327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:44.310794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:44.366680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:44.491196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae617f2-dc18-47fa-a89a-19b3458998e3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:44.495810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d83192-8405-4065-9d7d-a5f461a3907e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:44.496701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d83192-8405-4065-9d7d-a5f461a3907e service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:44.497443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d83192-8405-4065-9d7d-a5f461a3907e service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:44.498086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d83192-8405-4065-9d7d-a5f461a3907e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:44.510306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d83192-8405-4065-9d7d-a5f461a3907e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:44.512107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d83192-8405-4065-9d7d-a5f461a3907e service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:44.530148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1097/2194] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:44.964282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d193ca-c84f-4e90-88e9-23e9dc718e68 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:44.966337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-78d193ca-c84f-4e90-88e9-23e9dc718e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:44.987632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d193ca-c84f-4e90-88e9-23e9dc718e68 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:44.997283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:44.997940 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:44.998219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:44.998492 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78 admin admin] PATH_INFO: `/v3/projects/0cd60fb3d574460ea27d84693bcd9ce5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:45.007678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd60fb3d574460ea27d84693bcd9ce5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:45.009631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:45.087632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd60fb3d574460ea27d84693bcd9ce5', 'request_id': 'req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:45.095922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd60fb3d574460ea27d84693bcd9ce5', 'request_id': 'req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:45.106643 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd60fb3d574460ea27d84693bcd9ce5', 'request_id': 'req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:45.127851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78 admin admin] The token cache is being invalidate because project 0cd60fb3d574460ea27d84693bcd9ce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:56:45.128616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:45.135909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-9bf31553-c0b5-42db-9f0e-a71d74fd3a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:56:45.143802 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1098/2195] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:56:44 2022] DELETE /identity/v3/projects/0cd60fb3d574460ea27d84693bcd9ce5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:45.144657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375b053-5f01-497d-9e23-d99df1d6d4e5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:45.145157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375b053-5f01-497d-9e23-d99df1d6d4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:45.145306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375b053-5f01-497d-9e23-d99df1d6d4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:45.187750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5375b053-5f01-497d-9e23-d99df1d6d4e5 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:45.190116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5375b053-5f01-497d-9e23-d99df1d6d4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:45.274951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1098/2196] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:45.283057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0023b-e369-4764-86d4-3fd7e5347cde None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:45.283459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0023b-e369-4764-86d4-3fd7e5347cde None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:45.283984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0023b-e369-4764-86d4-3fd7e5347cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:45.320242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-acf0023b-e369-4764-86d4-3fd7e5347cde None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:45.322344 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-acf0023b-e369-4764-86d4-3fd7e5347cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:45.335522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1099/2197] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:45.336299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375b053-5f01-497d-9e23-d99df1d6d4e5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:45.348217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375b053-5f01-497d-9e23-d99df1d6d4e5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:45.354247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be5a7-fe81-48b1-9bc2-328c7e9e0425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:45.355888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be5a7-fe81-48b1-9bc2-328c7e9e0425 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:45.356522 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be5a7-fe81-48b1-9bc2-328c7e9e0425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:45.356990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be5a7-fe81-48b1-9bc2-328c7e9e0425 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:45.357838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7be5a7-fe81-48b1-9bc2-328c7e9e0425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:56:45.358333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7be5a7-fe81-48b1-9bc2-328c7e9e0425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:45.360325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7be5a7-fe81-48b1-9bc2-328c7e9e0425 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:45.378812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1099/2198] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:56:45.384267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0023b-e369-4764-86d4-3fd7e5347cde None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:45.394760 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0023b-e369-4764-86d4-3fd7e5347cde None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:45.399564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d26504-dfb7-4f6c-935a-b774ac0c9c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:45.400171 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d26504-dfb7-4f6c-935a-b774ac0c9c78 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:45.400481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d26504-dfb7-4f6c-935a-b774ac0c9c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:45.400766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d26504-dfb7-4f6c-935a-b774ac0c9c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:45.401527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d26504-dfb7-4f6c-935a-b774ac0c9c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:45.403470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d26504-dfb7-4f6c-935a-b774ac0c9c78 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:45.452546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1100/2199] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:56:45 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:56:45.453687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be5a7-fe81-48b1-9bc2-328c7e9e0425 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:45.463799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be5a7-fe81-48b1-9bc2-328c7e9e0425 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:45.529747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d5fc3-e8a8-4443-84a6-72e7acc2323f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:45.530691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d5fc3-e8a8-4443-84a6-72e7acc2323f admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:45.531584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d5fc3-e8a8-4443-84a6-72e7acc2323f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:45.531916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d5fc3-e8a8-4443-84a6-72e7acc2323f admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:45.533281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d5fc3-e8a8-4443-84a6-72e7acc2323f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:45.534763 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d5fc3-e8a8-4443-84a6-72e7acc2323f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:45.566757 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1100/2200] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:56:45 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:56:45.568858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d26504-dfb7-4f6c-935a-b774ac0c9c78 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:45.590970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d26504-dfb7-4f6c-935a-b774ac0c9c78 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:45.599377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306579be-9530-4a9c-83d8-54d80adcabec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:45.600153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306579be-9530-4a9c-83d8-54d80adcabec admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:45.600433 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306579be-9530-4a9c-83d8-54d80adcabec admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:45.600703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306579be-9530-4a9c-83d8-54d80adcabec admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:45.601344 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306579be-9530-4a9c-83d8-54d80adcabec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:45.603009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306579be-9530-4a9c-83d8-54d80adcabec admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:45.615273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1101/2201] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:45.618684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d5fc3-e8a8-4443-84a6-72e7acc2323f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:45.634777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d5fc3-e8a8-4443-84a6-72e7acc2323f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:45.645447 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52131a03-206a-440e-865a-91b40434f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:45.646831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52131a03-206a-440e-865a-91b40434f78a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:45.647114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52131a03-206a-440e-865a-91b40434f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:45.647381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52131a03-206a-440e-865a-91b40434f78a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:45.648177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52131a03-206a-440e-865a-91b40434f78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:45.649803 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52131a03-206a-440e-865a-91b40434f78a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:45.668177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1101/2202] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:56:45.668772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306579be-9530-4a9c-83d8-54d80adcabec admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:45.690005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306579be-9530-4a9c-83d8-54d80adcabec admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:45.696353 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf174110-4adb-4140-8c98-629ab035c9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:45.697230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf174110-4adb-4140-8c98-629ab035c9da admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:45.697693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf174110-4adb-4140-8c98-629ab035c9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:45.698114 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf174110-4adb-4140-8c98-629ab035c9da admin admin] PATH_INFO: `/v3/projects/153b36284a9145378f79fa1300b0dddf/users/ab779a170d56400295f77401f847ab66/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:45.728019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf174110-4adb-4140-8c98-629ab035c9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=153b36284a9145378f79fa1300b0dddf, user_id=ab779a170d56400295f77401f847ab66, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:45.731303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf174110-4adb-4140-8c98-629ab035c9da admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:45.753008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1102/2203] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:56:45 2022] PUT /identity/v3/projects/153b36284a9145378f79fa1300b0dddf/users/ab779a170d56400295f77401f847ab66/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:56:45.758547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa88601-59ce-4fc1-b73c-579d63091d0c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:45.758969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa88601-59ce-4fc1-b73c-579d63091d0c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:45.759332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa88601-59ce-4fc1-b73c-579d63091d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:45.796218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1aa88601-59ce-4fc1-b73c-579d63091d0c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:45.798304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1aa88601-59ce-4fc1-b73c-579d63091d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:45.846808 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:45.943581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1102/2204] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:45.961646 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf174110-4adb-4140-8c98-629ab035c9da admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:45.966871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cf174110-4adb-4140-8c98-629ab035c9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:46.068248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf174110-4adb-4140-8c98-629ab035c9da admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:46.073379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75243fd7-678c-4f93-aa36-d445439088b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:46.074082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75243fd7-678c-4f93-aa36-d445439088b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:46.074422 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75243fd7-678c-4f93-aa36-d445439088b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:46.075007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75243fd7-678c-4f93-aa36-d445439088b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:46.093052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75243fd7-678c-4f93-aa36-d445439088b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:46.094685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75243fd7-678c-4f93-aa36-d445439088b6 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:46.117933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1103/2205] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:47.204087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f42346-8b1e-4a8c-b2c3-3094c448b51d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:47.204885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f42346-8b1e-4a8c-b2c3-3094c448b51d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:47.205316 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f42346-8b1e-4a8c-b2c3-3094c448b51d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:47.206861 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1103/2206] 10.222.0.33 () {54 vars in 961 bytes} [Sun Sep 11 00:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:56:47.214579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e0038-f5c0-4236-8816-13188801dc45 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:47.215053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e0038-f5c0-4236-8816-13188801dc45 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:47.215176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e0038-f5c0-4236-8816-13188801dc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:47.266086 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-1e2e0038-f5c0-4236-8816-13188801dc45 None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:47.268977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1e2e0038-f5c0-4236-8816-13188801dc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:47.288013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:47.457187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1104/2207] 10.222.0.33 () {58 vars in 1058 bytes} [Sun Sep 11 00:56:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:47.466712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f42346-8b1e-4a8c-b2c3-3094c448b51d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:47.491972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f42346-8b1e-4a8c-b2c3-3094c448b51d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:47.507067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a708e14-55ff-404b-9ecf-7659d2d37f86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:47.507727 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a708e14-55ff-404b-9ecf-7659d2d37f86 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:47.507992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a708e14-55ff-404b-9ecf-7659d2d37f86 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:47.508261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a708e14-55ff-404b-9ecf-7659d2d37f86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:47.513010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4a708e14-55ff-404b-9ecf-7659d2d37f86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:47.530572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a708e14-55ff-404b-9ecf-7659d2d37f86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:47.532390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a708e14-55ff-404b-9ecf-7659d2d37f86 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:47.544552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1104/2208] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:57.414923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=24 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:57.539362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=21 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:01.142187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e0038-f5c0-4236-8816-13188801dc45 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:01.144402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1e2e0038-f5c0-4236-8816-13188801dc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:01.180332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e0038-f5c0-4236-8816-13188801dc45 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:01.194636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b1108-e0b7-4219-835f-fb81006584b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:01.196644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b1108-e0b7-4219-835f-fb81006584b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:01.196927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b1108-e0b7-4219-835f-fb81006584b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:01.197200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b1108-e0b7-4219-835f-fb81006584b8 admin admin] PATH_INFO: `/v3/users/46b90940e030470d8ab21cb82011b920` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:01.199947 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b1108-e0b7-4219-835f-fb81006584b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b90940e030470d8ab21cb82011b920)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:01.205788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b1108-e0b7-4219-835f-fb81006584b8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:01.289037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-398b1108-e0b7-4219-835f-fb81006584b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b90940e030470d8ab21cb82011b920'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:01.292302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-398b1108-e0b7-4219-835f-fb81006584b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b90940e030470d8ab21cb82011b920'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:01.303943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-398b1108-e0b7-4219-835f-fb81006584b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b90940e030470d8ab21cb82011b920'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:01.329730 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-398b1108-e0b7-4219-835f-fb81006584b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b90940e030470d8ab21cb82011b920'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:01.353319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-398b1108-e0b7-4219-835f-fb81006584b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b90940e030470d8ab21cb82011b920'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:01.363071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1105/2209] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:57:01 2022] DELETE /identity/v3/users/46b90940e030470d8ab21cb82011b920 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:03.026662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a708e14-55ff-404b-9ecf-7659d2d37f86 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:03.048502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a708e14-55ff-404b-9ecf-7659d2d37f86 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:03.244898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94f531-a12f-475c-ab7b-bc6af52356fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:03.245971 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94f531-a12f-475c-ab7b-bc6af52356fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:03.246596 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94f531-a12f-475c-ab7b-bc6af52356fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:03.247347 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94f531-a12f-475c-ab7b-bc6af52356fb admin admin] PATH_INFO: `/v3/projects/502f274ce216466d8a3dbff4a784b9bf` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:03.252627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94f531-a12f-475c-ab7b-bc6af52356fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=502f274ce216466d8a3dbff4a784b9bf)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:03.255987 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94f531-a12f-475c-ab7b-bc6af52356fb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:03.329169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-be94f531-a12f-475c-ab7b-bc6af52356fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502f274ce216466d8a3dbff4a784b9bf', 'request_id': 'req-be94f531-a12f-475c-ab7b-bc6af52356fb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:03.339505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-be94f531-a12f-475c-ab7b-bc6af52356fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502f274ce216466d8a3dbff4a784b9bf', 'request_id': 'req-be94f531-a12f-475c-ab7b-bc6af52356fb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:03.349281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-be94f531-a12f-475c-ab7b-bc6af52356fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502f274ce216466d8a3dbff4a784b9bf', 'request_id': 'req-be94f531-a12f-475c-ab7b-bc6af52356fb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:03.365159 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-be94f531-a12f-475c-ab7b-bc6af52356fb admin admin] The token cache is being invalidate because project 502f274ce216466d8a3dbff4a784b9bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:57:03.365725 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-be94f531-a12f-475c-ab7b-bc6af52356fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:03.369162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-be94f531-a12f-475c-ab7b-bc6af52356fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:03.373973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1105/2210] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:57:03 2022] DELETE /identity/v3/projects/502f274ce216466d8a3dbff4a784b9bf => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:03.375779 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac433cd-922a-4797-b966-0f7cfa27cfc4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:03.376240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac433cd-922a-4797-b966-0f7cfa27cfc4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:03.376383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac433cd-922a-4797-b966-0f7cfa27cfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:03.413515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-bac433cd-922a-4797-b966-0f7cfa27cfc4 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:03.414941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bac433cd-922a-4797-b966-0f7cfa27cfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:03.534320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1106/2211] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:03.543008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb518e0f-9fb5-4261-8b53-e493aa416151 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:03.543664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb518e0f-9fb5-4261-8b53-e493aa416151 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:03.544076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb518e0f-9fb5-4261-8b53-e493aa416151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:03.587472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cb518e0f-9fb5-4261-8b53-e493aa416151 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:03.590102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cb518e0f-9fb5-4261-8b53-e493aa416151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:03.604874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1106/2212] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:03.610280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac433cd-922a-4797-b966-0f7cfa27cfc4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:03.624015 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac433cd-922a-4797-b966-0f7cfa27cfc4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:03.658887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797740d6-cccb-4787-be23-8d27bbb0af82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:03.659866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797740d6-cccb-4787-be23-8d27bbb0af82 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:03.660349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797740d6-cccb-4787-be23-8d27bbb0af82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:03.662701 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797740d6-cccb-4787-be23-8d27bbb0af82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:03.663897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797740d6-cccb-4787-be23-8d27bbb0af82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:57:03.664336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797740d6-cccb-4787-be23-8d27bbb0af82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:03.668070 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797740d6-cccb-4787-be23-8d27bbb0af82 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:03.705707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1107/2213] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:57:03.707174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb518e0f-9fb5-4261-8b53-e493aa416151 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:03.729814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb518e0f-9fb5-4261-8b53-e493aa416151 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:03.757144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4208817-8546-4f25-8b24-2336c1f6fd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:03.759598 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4208817-8546-4f25-8b24-2336c1f6fd78 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:03.759975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4208817-8546-4f25-8b24-2336c1f6fd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:03.760452 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4208817-8546-4f25-8b24-2336c1f6fd78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:03.762013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4208817-8546-4f25-8b24-2336c1f6fd78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:03.767950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4208817-8546-4f25-8b24-2336c1f6fd78 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:03.854990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1107/2214] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:57:03 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:57:03.859122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797740d6-cccb-4787-be23-8d27bbb0af82 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:03.874762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797740d6-cccb-4787-be23-8d27bbb0af82 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:03.994121 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840ab8-1a57-46df-9411-1d46a14f1aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:03.994803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840ab8-1a57-46df-9411-1d46a14f1aef admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:03.995032 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840ab8-1a57-46df-9411-1d46a14f1aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:03.995311 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840ab8-1a57-46df-9411-1d46a14f1aef admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:03.996253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b840ab8-1a57-46df-9411-1d46a14f1aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:03.998257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b840ab8-1a57-46df-9411-1d46a14f1aef admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:04.008183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:04.071285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4208817-8546-4f25-8b24-2336c1f6fd78 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:04.103364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1108/2215] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:57:03 2022] POST /identity/v3/users => generated 295 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:57:04.109832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4208817-8546-4f25-8b24-2336c1f6fd78 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:04.123247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a666aa-9dc5-4fa1-baef-422a3d0eb7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:04.125924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a666aa-9dc5-4fa1-baef-422a3d0eb7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:04.127221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a666aa-9dc5-4fa1-baef-422a3d0eb7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:04.128319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a666aa-9dc5-4fa1-baef-422a3d0eb7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:04.130552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a666aa-9dc5-4fa1-baef-422a3d0eb7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:04.137205 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a666aa-9dc5-4fa1-baef-422a3d0eb7a0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:04.189451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840ab8-1a57-46df-9411-1d46a14f1aef admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:04.200224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1108/2216] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:57:04.205743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840ab8-1a57-46df-9411-1d46a14f1aef admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:04.216604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ceb41-6748-4162-9d52-24539742366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:04.219176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ceb41-6748-4162-9d52-24539742366a admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:04.219468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ceb41-6748-4162-9d52-24539742366a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:04.219737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ceb41-6748-4162-9d52-24539742366a admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:04.220607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ceb41-6748-4162-9d52-24539742366a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:04.224082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ceb41-6748-4162-9d52-24539742366a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:04.278354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a666aa-9dc5-4fa1-baef-422a3d0eb7a0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:04.297371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1109/2217] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:57:04.308466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a666aa-9dc5-4fa1-baef-422a3d0eb7a0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:04.330082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b6436-06cf-42e5-b58d-fc068d0d6d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:04.332576 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6436-06cf-42e5-b58d-fc068d0d6d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:04.332857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6436-06cf-42e5-b58d-fc068d0d6d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:04.333128 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6436-06cf-42e5-b58d-fc068d0d6d43 admin admin] PATH_INFO: `/v3/projects/e3b7bd3c0a7240c8b51db34668bec185/users/c3a11f852a90491e9480bcb6af49ae77/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:04.369916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b6436-06cf-42e5-b58d-fc068d0d6d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b7bd3c0a7240c8b51db34668bec185, user_id=c3a11f852a90491e9480bcb6af49ae77, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:04.373489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b6436-06cf-42e5-b58d-fc068d0d6d43 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:04.407859 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1109/2218] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:57:04 2022] PUT /identity/v3/projects/e3b7bd3c0a7240c8b51db34668bec185/users/c3a11f852a90491e9480bcb6af49ae77/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:04.420174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cb6da-ea7e-4702-954a-1bfbffcc0e22 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:04.420710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cb6da-ea7e-4702-954a-1bfbffcc0e22 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:04.422329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cb6da-ea7e-4702-954a-1bfbffcc0e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:04.481847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-790cb6da-ea7e-4702-954a-1bfbffcc0e22 None None] MFA Rules not processed for user `c3a11f852a90491e9480bcb6af49ae77`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:04.487019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-790cb6da-ea7e-4702-954a-1bfbffcc0e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:04.664369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1110/2219] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:04.665646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b6436-06cf-42e5-b58d-fc068d0d6d43 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:04.730402 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:04.795580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b6436-06cf-42e5-b58d-fc068d0d6d43 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:04.813187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3274d9a-e9f4-478a-9497-623d6d77da4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:04.815029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3274d9a-e9f4-478a-9497-623d6d77da4c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:04.815315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3274d9a-e9f4-478a-9497-623d6d77da4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:04.815639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3274d9a-e9f4-478a-9497-623d6d77da4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:04.816561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3274d9a-e9f4-478a-9497-623d6d77da4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:04.824117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3274d9a-e9f4-478a-9497-623d6d77da4c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:04.920644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1110/2220] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:57:04 2022] POST /identity/v3/projects => generated 391 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:57:04.924674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cb6da-ea7e-4702-954a-1bfbffcc0e22 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:04.943997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cb6da-ea7e-4702-954a-1bfbffcc0e22 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:05.018561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bebeb-be71-4292-a712-1353bb11755f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:05.019133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bebeb-be71-4292-a712-1353bb11755f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:05.019596 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bebeb-be71-4292-a712-1353bb11755f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:05.078519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a93bebeb-be71-4292-a712-1353bb11755f None None] MFA Rules not processed for user `ab779a170d56400295f77401f847ab66`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:05.084313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a93bebeb-be71-4292-a712-1353bb11755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:05.095633 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa144d23-e23f-42bd-9a2c-70058afef15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:05.096397 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa144d23-e23f-42bd-9a2c-70058afef15a admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:05.096780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa144d23-e23f-42bd-9a2c-70058afef15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:05.097158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa144d23-e23f-42bd-9a2c-70058afef15a admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:05.104414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa144d23-e23f-42bd-9a2c-70058afef15a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:05.106140 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa144d23-e23f-42bd-9a2c-70058afef15a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:05.140192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1111/2221] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:57:04 2022] POST /identity/v3/users => generated 302 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:57:05.146279 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa144d23-e23f-42bd-9a2c-70058afef15a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:05.167980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa144d23-e23f-42bd-9a2c-70058afef15a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:05.183293 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47782f-5a19-41b7-abeb-bd6359bcd802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:05.184083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47782f-5a19-41b7-abeb-bd6359bcd802 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:05.184494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47782f-5a19-41b7-abeb-bd6359bcd802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:05.184872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47782f-5a19-41b7-abeb-bd6359bcd802 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:05.185723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47782f-5a19-41b7-abeb-bd6359bcd802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:05.187532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47782f-5a19-41b7-abeb-bd6359bcd802 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:05.216675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1112/2222] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:57:05.217889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47782f-5a19-41b7-abeb-bd6359bcd802 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:05.241651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47782f-5a19-41b7-abeb-bd6359bcd802 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:05.262784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a98fd-084a-4553-8716-1ecb2a2191a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:05.263536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a98fd-084a-4553-8716-1ecb2a2191a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:05.263951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a98fd-084a-4553-8716-1ecb2a2191a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:05.264328 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a98fd-084a-4553-8716-1ecb2a2191a2 admin admin] PATH_INFO: `/v3/projects/4917e77b92b14a4e8ccfaac19c3b26dd/users/5e0101372eef4f0caba19121ca745f54/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:05.283939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1111/2223] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:57:05.294057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bebeb-be71-4292-a712-1353bb11755f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:05.296587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a93bebeb-be71-4292-a712-1353bb11755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:05.302516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a98fd-084a-4553-8716-1ecb2a2191a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4917e77b92b14a4e8ccfaac19c3b26dd, user_id=5e0101372eef4f0caba19121ca745f54, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:05.305260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a98fd-084a-4553-8716-1ecb2a2191a2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:05.320691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bebeb-be71-4292-a712-1353bb11755f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:05.330295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f33f01-1fbd-4332-b211-6fa73903cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:05.331923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f33f01-1fbd-4332-b211-6fa73903cf5d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:05.332549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f33f01-1fbd-4332-b211-6fa73903cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:05.333503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f33f01-1fbd-4332-b211-6fa73903cf5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:05.335046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f33f01-1fbd-4332-b211-6fa73903cf5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:05.335409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1113/2224] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:57:05 2022] PUT /identity/v3/projects/4917e77b92b14a4e8ccfaac19c3b26dd/users/5e0101372eef4f0caba19121ca745f54/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:05.340274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a98fd-084a-4553-8716-1ecb2a2191a2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:05.342813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f33f01-1fbd-4332-b211-6fa73903cf5d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:05.423658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:05.454517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1112/2225] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:57:05 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:57:05.461050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f33f01-1fbd-4332-b211-6fa73903cf5d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:05.494071 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a98fd-084a-4553-8716-1ecb2a2191a2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:05.623124 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f33f01-1fbd-4332-b211-6fa73903cf5d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:05.639283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60dea4-e745-4a56-93bc-b6f3a8ef0b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:05.642949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60dea4-e745-4a56-93bc-b6f3a8ef0b24 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:05.643226 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60dea4-e745-4a56-93bc-b6f3a8ef0b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:05.643496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60dea4-e745-4a56-93bc-b6f3a8ef0b24 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:05.644395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60dea4-e745-4a56-93bc-b6f3a8ef0b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:05.650252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60dea4-e745-4a56-93bc-b6f3a8ef0b24 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:05.695147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4d8f8-1a91-4799-97ec-27498ee56c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:05.696100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4d8f8-1a91-4799-97ec-27498ee56c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:05.696697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4d8f8-1a91-4799-97ec-27498ee56c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:05.697215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4d8f8-1a91-4799-97ec-27498ee56c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:05.699505 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4d8f8-1a91-4799-97ec-27498ee56c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:05.701337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4d8f8-1a91-4799-97ec-27498ee56c5b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:05.726650 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1113/2226] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:57:05 2022] POST /identity/v3/users => generated 296 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:57:05.730590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60dea4-e745-4a56-93bc-b6f3a8ef0b24 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:05.746870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1114/2227] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:57:05.747977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4d8f8-1a91-4799-97ec-27498ee56c5b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:05.760878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4d8f8-1a91-4799-97ec-27498ee56c5b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:05.764110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60dea4-e745-4a56-93bc-b6f3a8ef0b24 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:05.787517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1dcb7-a683-472e-9590-d85b53dbe555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:05.787752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1dcb7-a683-472e-9590-d85b53dbe555 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:05.787997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1dcb7-a683-472e-9590-d85b53dbe555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:05.788277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1dcb7-a683-472e-9590-d85b53dbe555 admin admin] PATH_INFO: `/v3/projects/4917e77b92b14a4e8ccfaac19c3b26dd/users/5e0101372eef4f0caba19121ca745f54/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:05.791026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1dcb7-a683-472e-9590-d85b53dbe555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4917e77b92b14a4e8ccfaac19c3b26dd, user_id=5e0101372eef4f0caba19121ca745f54, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:05.793713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1dcb7-a683-472e-9590-d85b53dbe555 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:05.804870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103cb7f-a33c-4219-9834-a8718f107070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:05.807145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103cb7f-a33c-4219-9834-a8718f107070 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:05.807969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103cb7f-a33c-4219-9834-a8718f107070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:05.808805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103cb7f-a33c-4219-9834-a8718f107070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:05.811049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103cb7f-a33c-4219-9834-a8718f107070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:05.819228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103cb7f-a33c-4219-9834-a8718f107070 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:05.823845 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:05.827308 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1115/2228] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:57:05 2022] PUT /identity/v3/projects/4917e77b92b14a4e8ccfaac19c3b26dd/users/5e0101372eef4f0caba19121ca745f54/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:57:05.837504 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd9c48-6290-4eaf-8ec3-cc0d1eccd04c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:05.837795 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd9c48-6290-4eaf-8ec3-cc0d1eccd04c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:05.838075 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd9c48-6290-4eaf-8ec3-cc0d1eccd04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:05.868390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1114/2229] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:57:05.871858 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103cb7f-a33c-4219-9834-a8718f107070 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:05.909137 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103cb7f-a33c-4219-9834-a8718f107070 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:05.922130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2bcd9c48-6290-4eaf-8ec3-cc0d1eccd04c None None] MFA Rules not processed for user `5e0101372eef4f0caba19121ca745f54`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:05.923391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2bcd9c48-6290-4eaf-8ec3-cc0d1eccd04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:06.088293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa851a55-9293-4ae4-9ac7-bd1344ebbc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:06.094036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa851a55-9293-4ae4-9ac7-bd1344ebbc02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:06.094660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa851a55-9293-4ae4-9ac7-bd1344ebbc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:06.094973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa851a55-9293-4ae4-9ac7-bd1344ebbc02 admin admin] PATH_INFO: `/v3/projects/14e7a970d6e1436c9743edbb8e755389/users/bcd845e09ba840cca21c640d9f5d9b36/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:06.119634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1116/2230] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:06.144822 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd9c48-6290-4eaf-8ec3-cc0d1eccd04c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:06.146431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2bcd9c48-6290-4eaf-8ec3-cc0d1eccd04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:06.149327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa851a55-9293-4ae4-9ac7-bd1344ebbc02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e7a970d6e1436c9743edbb8e755389, user_id=bcd845e09ba840cca21c640d9f5d9b36, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:06.154419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa851a55-9293-4ae4-9ac7-bd1344ebbc02 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:06.205517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1115/2231] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:57:05 2022] PUT /identity/v3/projects/14e7a970d6e1436c9743edbb8e755389/users/bcd845e09ba840cca21c640d9f5d9b36/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:06.228417 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa851a55-9293-4ae4-9ac7-bd1344ebbc02 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:06.252161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:06.299026 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd9c48-6290-4eaf-8ec3-cc0d1eccd04c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:06.424827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa851a55-9293-4ae4-9ac7-bd1344ebbc02 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:06.438418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e02d-725c-4cde-af3b-25b5bfb548f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:06.439296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e02d-725c-4cde-af3b-25b5bfb548f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:06.439756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e02d-725c-4cde-af3b-25b5bfb548f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:06.440190 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e02d-725c-4cde-af3b-25b5bfb548f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:06.441548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100e02d-725c-4cde-af3b-25b5bfb548f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:06.449807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100e02d-725c-4cde-af3b-25b5bfb548f3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:06.492029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1116/2232] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:57:06.496339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e02d-725c-4cde-af3b-25b5bfb548f3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:06.504842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb8384-93bd-47c7-91bf-3802d756a89e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:06.505482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb8384-93bd-47c7-91bf-3802d756a89e service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:06.505765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb8384-93bd-47c7-91bf-3802d756a89e service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:06.506195 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb8384-93bd-47c7-91bf-3802d756a89e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:06.542009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e02d-725c-4cde-af3b-25b5bfb548f3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:06.562003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d1cbe-28a4-4224-ae79-881f420daa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:06.564909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d1cbe-28a4-4224-ae79-881f420daa45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:06.565506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d1cbe-28a4-4224-ae79-881f420daa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:06.566308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d1cbe-28a4-4224-ae79-881f420daa45 admin admin] PATH_INFO: `/v3/projects/14e7a970d6e1436c9743edbb8e755389/users/bcd845e09ba840cca21c640d9f5d9b36/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:06.579008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d1cbe-28a4-4224-ae79-881f420daa45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e7a970d6e1436c9743edbb8e755389, user_id=bcd845e09ba840cca21c640d9f5d9b36, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:06.594133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d1cbe-28a4-4224-ae79-881f420daa45 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:06.627825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1117/2233] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:57:06 2022] PUT /identity/v3/projects/14e7a970d6e1436c9743edbb8e755389/users/bcd845e09ba840cca21c640d9f5d9b36/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:06.674407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb8384-93bd-47c7-91bf-3802d756a89e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:06.676030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb8384-93bd-47c7-91bf-3802d756a89e service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:06.700559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1117/2234] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:57:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:57:16.618230 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=69,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:16.694836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=51 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:18.647921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d1cbe-28a4-4224-ae79-881f420daa45 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:18.756184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d1cbe-28a4-4224-ae79-881f420daa45 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:18.770673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb67cb9-60cd-47de-95f3-2bc39836b575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:18.771346 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb67cb9-60cd-47de-95f3-2bc39836b575 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:18.771623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb67cb9-60cd-47de-95f3-2bc39836b575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:18.771893 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb67cb9-60cd-47de-95f3-2bc39836b575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:18.940536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb67cb9-60cd-47de-95f3-2bc39836b575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:18.942334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb67cb9-60cd-47de-95f3-2bc39836b575 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:18.967390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1118/2235] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:57:18 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:57:28.048340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39373813-118e-46b4-bd0f-52b28d9a7f11 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:28.048907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39373813-118e-46b4-bd0f-52b28d9a7f11 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:28.048907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39373813-118e-46b4-bd0f-52b28d9a7f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:28.108678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-39373813-118e-46b4-bd0f-52b28d9a7f11 None None] MFA Rules not processed for user `bcd845e09ba840cca21c640d9f5d9b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:28.109873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-39373813-118e-46b4-bd0f-52b28d9a7f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:28.271534 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1118/2236] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:28.290667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb67cb9-60cd-47de-95f3-2bc39836b575 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:28.293284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5fb67cb9-60cd-47de-95f3-2bc39836b575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:28.471926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb67cb9-60cd-47de-95f3-2bc39836b575 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:28.479770 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c73467-6d16-4f8f-b674-e98ba3d98cab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:28.480836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c73467-6d16-4f8f-b674-e98ba3d98cab service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:28.481931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c73467-6d16-4f8f-b674-e98ba3d98cab service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:28.482396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c73467-6d16-4f8f-b674-e98ba3d98cab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:28.596953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:28.627652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c73467-6d16-4f8f-b674-e98ba3d98cab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:28.632396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c73467-6d16-4f8f-b674-e98ba3d98cab service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:28.673626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1119/2237] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:57:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:57:29.120577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39373813-118e-46b4-bd0f-52b28d9a7f11 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:29.259047 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39373813-118e-46b4-bd0f-52b28d9a7f11 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:29.266678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:29.268279 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:29.268751 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:29.269285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] PATH_INFO: `/v3/users/c3a11f852a90491e9480bcb6af49ae77` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:29.270676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a11f852a90491e9480bcb6af49ae77)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:29.273644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:29.356179 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a11f852a90491e9480bcb6af49ae77'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:29.357165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a11f852a90491e9480bcb6af49ae77'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:29.367490 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a11f852a90491e9480bcb6af49ae77'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:29.383705 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a11f852a90491e9480bcb6af49ae77'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:29.408056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a11f852a90491e9480bcb6af49ae77'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:29.422347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1119/2238] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:57:29 2022] DELETE /identity/v3/users/c3a11f852a90491e9480bcb6af49ae77 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:29.426979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d84da-fe7b-4a75-9e79-81aa28d54363 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:29.427470 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d84da-fe7b-4a75-9e79-81aa28d54363 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:29.427589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d84da-fe7b-4a75-9e79-81aa28d54363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:29.452680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-607d84da-fe7b-4a75-9e79-81aa28d54363 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:29.455388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-607d84da-fe7b-4a75-9e79-81aa28d54363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:29.567864 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1120/2239] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:29.694153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:29.695593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:29.703844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:29.837651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b03a9-009c-47d2-84bd-e22a0e1bbf9a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:29.850549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba93d8-b054-4ea2-8d8e-d9224f264cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:29.851415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba93d8-b054-4ea2-8d8e-d9224f264cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:29.851695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba93d8-b054-4ea2-8d8e-d9224f264cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:29.854111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba93d8-b054-4ea2-8d8e-d9224f264cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:29.878136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba93d8-b054-4ea2-8d8e-d9224f264cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:29.882117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba93d8-b054-4ea2-8d8e-d9224f264cb8 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:29.919587 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1120/2240] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:57:32.418819 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d84da-fe7b-4a75-9e79-81aa28d54363 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:32.420635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-607d84da-fe7b-4a75-9e79-81aa28d54363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:32.454644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d84da-fe7b-4a75-9e79-81aa28d54363 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:32.463263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:32.463911 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:32.464186 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:32.464453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] PATH_INFO: `/v3/projects/e3b7bd3c0a7240c8b51db34668bec185` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:32.469059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b7bd3c0a7240c8b51db34668bec185)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:32.471215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:32.576207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b7bd3c0a7240c8b51db34668bec185', 'request_id': 'req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:32.591412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b7bd3c0a7240c8b51db34668bec185', 'request_id': 'req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:32.599303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b7bd3c0a7240c8b51db34668bec185', 'request_id': 'req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:32.624763 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] The token cache is being invalidate because project e3b7bd3c0a7240c8b51db34668bec185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:57:32.625488 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:32.631216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:32.634537 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1121/2241] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:57:32 2022] DELETE /identity/v3/projects/e3b7bd3c0a7240c8b51db34668bec185 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:32.638683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba93d8-b054-4ea2-8d8e-d9224f264cb8 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:32.652075 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba93d8-b054-4ea2-8d8e-d9224f264cb8 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:32.833231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada1482-c893-49ba-b708-d3c7f9b44bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:32.834072 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada1482-c893-49ba-b708-d3c7f9b44bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:32.834356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada1482-c893-49ba-b708-d3c7f9b44bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:32.835064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada1482-c893-49ba-b708-d3c7f9b44bbb admin admin] PATH_INFO: `/v3/users/5e0101372eef4f0caba19121ca745f54` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:32.837060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada1482-c893-49ba-b708-d3c7f9b44bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0101372eef4f0caba19121ca745f54)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:32.839753 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada1482-c893-49ba-b708-d3c7f9b44bbb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:32.953990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fada1482-c893-49ba-b708-d3c7f9b44bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0101372eef4f0caba19121ca745f54'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:32.954613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fada1482-c893-49ba-b708-d3c7f9b44bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0101372eef4f0caba19121ca745f54'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:32.969314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fada1482-c893-49ba-b708-d3c7f9b44bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0101372eef4f0caba19121ca745f54'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:32.988474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fada1482-c893-49ba-b708-d3c7f9b44bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0101372eef4f0caba19121ca745f54'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:33.014694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fada1482-c893-49ba-b708-d3c7f9b44bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0101372eef4f0caba19121ca745f54'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:33.031960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1121/2242] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:57:32 2022] DELETE /identity/v3/users/5e0101372eef4f0caba19121ca745f54 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:34.772905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:34.775493 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:34.800685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74f294-3f94-45eb-bd3f-de6f9cfd8e56 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:34.958523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2a21-61eb-4ab9-88ee-9549af49799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:34.959426 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2a21-61eb-4ab9-88ee-9549af49799b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:34.959767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2a21-61eb-4ab9-88ee-9549af49799b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:34.960138 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2a21-61eb-4ab9-88ee-9549af49799b admin admin] PATH_INFO: `/v3/projects/4917e77b92b14a4e8ccfaac19c3b26dd` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:34.962348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a2a21-61eb-4ab9-88ee-9549af49799b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4917e77b92b14a4e8ccfaac19c3b26dd)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:34.973001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a2a21-61eb-4ab9-88ee-9549af49799b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:35.005341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:35.104032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d42a2a21-61eb-4ab9-88ee-9549af49799b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4917e77b92b14a4e8ccfaac19c3b26dd', 'request_id': 'req-d42a2a21-61eb-4ab9-88ee-9549af49799b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:35.117201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d42a2a21-61eb-4ab9-88ee-9549af49799b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4917e77b92b14a4e8ccfaac19c3b26dd', 'request_id': 'req-d42a2a21-61eb-4ab9-88ee-9549af49799b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:35.130669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d42a2a21-61eb-4ab9-88ee-9549af49799b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4917e77b92b14a4e8ccfaac19c3b26dd', 'request_id': 'req-d42a2a21-61eb-4ab9-88ee-9549af49799b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:35.157316 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d42a2a21-61eb-4ab9-88ee-9549af49799b admin admin] The token cache is being invalidate because project 4917e77b92b14a4e8ccfaac19c3b26dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:57:35.159951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d42a2a21-61eb-4ab9-88ee-9549af49799b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:35.163816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d42a2a21-61eb-4ab9-88ee-9549af49799b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:35.167536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1122/2243] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:57:34 2022] DELETE /identity/v3/projects/4917e77b92b14a4e8ccfaac19c3b26dd => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:35.172236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b704a-ea72-4624-b38b-66354cef90bb None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:35.172842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b704a-ea72-4624-b38b-66354cef90bb None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:35.172842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b704a-ea72-4624-b38b-66354cef90bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:35.221497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-910b704a-ea72-4624-b38b-66354cef90bb None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:35.222803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-910b704a-ea72-4624-b38b-66354cef90bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:35.275023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:35.360741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1122/2244] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:35.370400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a8f1-d38a-44ba-adbd-942828a7aa4d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:35.371372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a8f1-d38a-44ba-adbd-942828a7aa4d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:35.375056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a8f1-d38a-44ba-adbd-942828a7aa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:35.390050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b704a-ea72-4624-b38b-66354cef90bb None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:35.391538 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-910b704a-ea72-4624-b38b-66354cef90bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:35.413079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b704a-ea72-4624-b38b-66354cef90bb None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:35.439792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdba86-2fcb-48e7-a690-c15394fcc0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:35.442686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdba86-2fcb-48e7-a690-c15394fcc0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:35.443002 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdba86-2fcb-48e7-a690-c15394fcc0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:35.443273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdba86-2fcb-48e7-a690-c15394fcc0da admin admin] PATH_INFO: `/v3/users/389cbfbdb368417ca976261ec1e06914` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:35.446321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdba86-2fcb-48e7-a690-c15394fcc0da admin admin] RBAC: Authorizing `identity:delete_user(user_id=389cbfbdb368417ca976261ec1e06914)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:35.450929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdba86-2fcb-48e7-a690-c15394fcc0da admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:35.472722 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-dea2a8f1-d38a-44ba-adbd-942828a7aa4d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:35.474174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dea2a8f1-d38a-44ba-adbd-942828a7aa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:35.487489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1123/2245] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:35.491576 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2a8f1-d38a-44ba-adbd-942828a7aa4d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:35.523031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2a8f1-d38a-44ba-adbd-942828a7aa4d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:35.536636 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78934d7-592f-4d03-92b1-5156558ea1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:35.537259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78934d7-592f-4d03-92b1-5156558ea1fb admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:35.537954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78934d7-592f-4d03-92b1-5156558ea1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:35.539012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78934d7-592f-4d03-92b1-5156558ea1fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:35.541547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78934d7-592f-4d03-92b1-5156558ea1fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:57:35.542022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78934d7-592f-4d03-92b1-5156558ea1fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:35.545882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78934d7-592f-4d03-92b1-5156558ea1fb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:35.557478 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e4bdba86-2fcb-48e7-a690-c15394fcc0da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389cbfbdb368417ca976261ec1e06914'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:35.558403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e4bdba86-2fcb-48e7-a690-c15394fcc0da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389cbfbdb368417ca976261ec1e06914'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:35.567253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e4bdba86-2fcb-48e7-a690-c15394fcc0da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389cbfbdb368417ca976261ec1e06914'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:35.578157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1124/2246] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:57:35.582009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e4bdba86-2fcb-48e7-a690-c15394fcc0da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389cbfbdb368417ca976261ec1e06914'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:35.583081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78934d7-592f-4d03-92b1-5156558ea1fb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:35.587777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d78934d7-592f-4d03-92b1-5156558ea1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:35.601046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e4bdba86-2fcb-48e7-a690-c15394fcc0da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389cbfbdb368417ca976261ec1e06914'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:35.619097 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1123/2247] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:57:35 2022] DELETE /identity/v3/users/389cbfbdb368417ca976261ec1e06914 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:35.623305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f095b8-c309-4584-aa3f-4a12600f6277 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:35.624014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f095b8-c309-4584-aa3f-4a12600f6277 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:35.624492 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f095b8-c309-4584-aa3f-4a12600f6277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:35.631812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78934d7-592f-4d03-92b1-5156558ea1fb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:35.671756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a4f095b8-c309-4584-aa3f-4a12600f6277 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:35.674313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a4f095b8-c309-4584-aa3f-4a12600f6277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:35.811211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ab270-8357-43d7-a0f6-948e62907198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:35.812896 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ab270-8357-43d7-a0f6-948e62907198 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:35.813306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ab270-8357-43d7-a0f6-948e62907198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:35.813668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ab270-8357-43d7-a0f6-948e62907198 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:35.814065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ab270-8357-43d7-a0f6-948e62907198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:35.816984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ab270-8357-43d7-a0f6-948e62907198 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:35.828391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1124/2248] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:35.843682 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f095b8-c309-4584-aa3f-4a12600f6277 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:35.845102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a4f095b8-c309-4584-aa3f-4a12600f6277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:35.900727 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1125/2249] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:57:35 2022] POST /identity/v3/projects => generated 369 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:57:35.905609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ab270-8357-43d7-a0f6-948e62907198 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:35.958545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:35.988120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f095b8-c309-4584-aa3f-4a12600f6277 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:36.073397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ab270-8357-43d7-a0f6-948e62907198 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:36.093938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f66ef-f07c-4b92-8f42-9db0f59b196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:36.094651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f66ef-f07c-4b92-8f42-9db0f59b196d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:36.094973 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f66ef-f07c-4b92-8f42-9db0f59b196d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:36.095251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f66ef-f07c-4b92-8f42-9db0f59b196d admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:36.095904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f66ef-f07c-4b92-8f42-9db0f59b196d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:36.098588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f66ef-f07c-4b92-8f42-9db0f59b196d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:36.126120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76224166-1e51-44d8-843f-e752973cc56a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:36.130820 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76224166-1e51-44d8-843f-e752973cc56a service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:36.131529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76224166-1e51-44d8-843f-e752973cc56a service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:36.131951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76224166-1e51-44d8-843f-e752973cc56a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:36.142759 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:36.173573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76224166-1e51-44d8-843f-e752973cc56a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:36.175638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76224166-1e51-44d8-843f-e752973cc56a service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:36.191186 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1126/2250] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:57:35 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:57:36.192827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f66ef-f07c-4b92-8f42-9db0f59b196d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:36.214976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1125/2251] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:57:36.220288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f66ef-f07c-4b92-8f42-9db0f59b196d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:36.248215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84868864-25c6-455a-9a45-0c3a266dba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:36.248868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84868864-25c6-455a-9a45-0c3a266dba2b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:36.249147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84868864-25c6-455a-9a45-0c3a266dba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:36.249468 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84868864-25c6-455a-9a45-0c3a266dba2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:36.250081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84868864-25c6-455a-9a45-0c3a266dba2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:36.251785 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84868864-25c6-455a-9a45-0c3a266dba2b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:36.306083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1127/2252] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:57:36.310588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76224166-1e51-44d8-843f-e752973cc56a service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:36.339093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76224166-1e51-44d8-843f-e752973cc56a service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:36.352033 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9e069-0510-4c47-9a6f-11caccd27a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:36.353420 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9e069-0510-4c47-9a6f-11caccd27a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:36.354174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9e069-0510-4c47-9a6f-11caccd27a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:36.354642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9e069-0510-4c47-9a6f-11caccd27a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:36.356136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9e069-0510-4c47-9a6f-11caccd27a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:36.358334 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9e069-0510-4c47-9a6f-11caccd27a30 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:36.372859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1126/2253] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:57:36.377155 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84868864-25c6-455a-9a45-0c3a266dba2b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:36.396157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84868864-25c6-455a-9a45-0c3a266dba2b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:36.412903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1085a-d3dc-4d4c-89cd-563cc0fe1b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:36.413894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1085a-d3dc-4d4c-89cd-563cc0fe1b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:36.415942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1085a-d3dc-4d4c-89cd-563cc0fe1b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:36.416400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1085a-d3dc-4d4c-89cd-563cc0fe1b8a admin admin] PATH_INFO: `/v3/projects/ab815b9cd28c42319a3c068c9b5615fd/users/32343e6222da4aefa113308ded752126/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:36.480056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1085a-d3dc-4d4c-89cd-563cc0fe1b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab815b9cd28c42319a3c068c9b5615fd, user_id=32343e6222da4aefa113308ded752126, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:36.485823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1085a-d3dc-4d4c-89cd-563cc0fe1b8a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:36.526428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1128/2254] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:57:36 2022] PUT /identity/v3/projects/ab815b9cd28c42319a3c068c9b5615fd/users/32343e6222da4aefa113308ded752126/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:57:36.537383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d461b-84c7-4fbe-8a7f-60db843ec530 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:36.537667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d461b-84c7-4fbe-8a7f-60db843ec530 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:36.537941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d461b-84c7-4fbe-8a7f-60db843ec530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:36.589755 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2e0d461b-84c7-4fbe-8a7f-60db843ec530 None None] MFA Rules not processed for user `32343e6222da4aefa113308ded752126`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:36.591261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2e0d461b-84c7-4fbe-8a7f-60db843ec530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:36.702695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1127/2255] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:36.720465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1085a-d3dc-4d4c-89cd-563cc0fe1b8a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:36.820700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1085a-d3dc-4d4c-89cd-563cc0fe1b8a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:36.827886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5793c-f17d-473d-b63a-9cf8057a98af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:36.828648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5793c-f17d-473d-b63a-9cf8057a98af admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:36.828928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5793c-f17d-473d-b63a-9cf8057a98af admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:36.829272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5793c-f17d-473d-b63a-9cf8057a98af admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:36.829969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5793c-f17d-473d-b63a-9cf8057a98af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:36.832139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5793c-f17d-473d-b63a-9cf8057a98af admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:36.876174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1129/2256] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:57:36 2022] POST /identity/v3/projects => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:57:36.876670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d461b-84c7-4fbe-8a7f-60db843ec530 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:36.904367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d461b-84c7-4fbe-8a7f-60db843ec530 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:37.051863 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1086226-b5ec-4187-be44-81d31ef94c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:37.052581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1086226-b5ec-4187-be44-81d31ef94c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:37.052899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1086226-b5ec-4187-be44-81d31ef94c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:37.053209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1086226-b5ec-4187-be44-81d31ef94c7b admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:37.053874 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1086226-b5ec-4187-be44-81d31ef94c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:37.056004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1086226-b5ec-4187-be44-81d31ef94c7b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:37.088572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5793c-f17d-473d-b63a-9cf8057a98af admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:37.092339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-adf5793c-f17d-473d-b63a-9cf8057a98af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:37.126389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5793c-f17d-473d-b63a-9cf8057a98af admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:37.131913 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1128/2257] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:57:36 2022] POST /identity/v3/users => generated 290 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:57:37.134395 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1086226-b5ec-4187-be44-81d31ef94c7b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:37.146174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:37.149028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:37.151006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:37.151512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0 admin admin] PATH_INFO: `/v3/projects/290f7e0058d74266be61cb4464703389` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:37.153641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290f7e0058d74266be61cb4464703389)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:37.156660 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1086226-b5ec-4187-be44-81d31ef94c7b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:37.160239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:37.167758 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cca573-6b1d-4e29-90e8-5d8eb2ba8ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:37.170315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cca573-6b1d-4e29-90e8-5d8eb2ba8ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:37.170315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cca573-6b1d-4e29-90e8-5d8eb2ba8ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:37.170315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cca573-6b1d-4e29-90e8-5d8eb2ba8ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:37.170315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cca573-6b1d-4e29-90e8-5d8eb2ba8ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:37.175837 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cca573-6b1d-4e29-90e8-5d8eb2ba8ac2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:37.178200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:37.214556 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1129/2258] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:57:37.220198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cca573-6b1d-4e29-90e8-5d8eb2ba8ac2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:37.237601 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cca573-6b1d-4e29-90e8-5d8eb2ba8ac2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:37.251946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd98698-3388-4494-8c55-68245d171095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:37.252761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd98698-3388-4494-8c55-68245d171095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:37.253177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd98698-3388-4494-8c55-68245d171095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:37.253551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd98698-3388-4494-8c55-68245d171095 admin admin] PATH_INFO: `/v3/projects/2b078eb8ee454140abdaadf874b847f7/users/4c382fbd9b5b4394a9a58785c2560c39/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:37.314781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd98698-3388-4494-8c55-68245d171095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b078eb8ee454140abdaadf874b847f7, user_id=4c382fbd9b5b4394a9a58785c2560c39, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:37.324489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd98698-3388-4494-8c55-68245d171095 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:37.335240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290f7e0058d74266be61cb4464703389', 'request_id': 'req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:37.355534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290f7e0058d74266be61cb4464703389', 'request_id': 'req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:37.370703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1130/2259] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:57:37 2022] PUT /identity/v3/projects/2b078eb8ee454140abdaadf874b847f7/users/4c382fbd9b5b4394a9a58785c2560c39/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:37.375524 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd98698-3388-4494-8c55-68245d171095 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:37.376312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290f7e0058d74266be61cb4464703389', 'request_id': 'req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:37.411144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0 admin admin] The token cache is being invalidate because project 290f7e0058d74266be61cb4464703389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:57:37.411444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:37.412148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3d0fc18d-fe0d-4b7e-9c8d-bd1ea28f7cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:37.420726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1130/2260] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:57:37 2022] DELETE /identity/v3/projects/290f7e0058d74266be61cb4464703389 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:37.425762 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6d6a3-184d-4ee8-a747-c8124153c3c1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:37.426046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6d6a3-184d-4ee8-a747-c8124153c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:37.426322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6d6a3-184d-4ee8-a747-c8124153c3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:37.467780 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-41c6d6a3-184d-4ee8-a747-c8124153c3c1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:37.469317 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-41c6d6a3-184d-4ee8-a747-c8124153c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:37.529485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd98698-3388-4494-8c55-68245d171095 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:37.537029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1bec6-a1f6-4bd1-aa03-6b57b6e158b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:37.539793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1bec6-a1f6-4bd1-aa03-6b57b6e158b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:37.540309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1bec6-a1f6-4bd1-aa03-6b57b6e158b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:37.540893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1bec6-a1f6-4bd1-aa03-6b57b6e158b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:37.542003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1bec6-a1f6-4bd1-aa03-6b57b6e158b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:37.544403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1bec6-a1f6-4bd1-aa03-6b57b6e158b5 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:37.546931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:37.570658 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1131/2261] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:57:37.581149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1bec6-a1f6-4bd1-aa03-6b57b6e158b5 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:37.585200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-52f1bec6-a1f6-4bd1-aa03-6b57b6e158b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:37.607848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1bec6-a1f6-4bd1-aa03-6b57b6e158b5 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:37.623561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4b0fe-d263-4605-95ce-a9b4ea92006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:37.624744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4b0fe-d263-4605-95ce-a9b4ea92006c admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:37.625300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4b0fe-d263-4605-95ce-a9b4ea92006c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:37.625827 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4b0fe-d263-4605-95ce-a9b4ea92006c admin admin] PATH_INFO: `/v3/projects/2b078eb8ee454140abdaadf874b847f7/users/4c382fbd9b5b4394a9a58785c2560c39/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:37.634081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4b0fe-d263-4605-95ce-a9b4ea92006c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b078eb8ee454140abdaadf874b847f7, user_id=4c382fbd9b5b4394a9a58785c2560c39, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:37.646897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4b0fe-d263-4605-95ce-a9b4ea92006c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:37.659168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1131/2262] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:57:37.660598 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c3f9-da8a-4fce-8990-227c63b8b744 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:37.660889 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c3f9-da8a-4fce-8990-227c63b8b744 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:37.661160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c3f9-da8a-4fce-8990-227c63b8b744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:37.677807 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1132/2263] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:57:37 2022] PUT /identity/v3/projects/2b078eb8ee454140abdaadf874b847f7/users/4c382fbd9b5b4394a9a58785c2560c39/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:37.688137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f7874-faaa-49ba-85c0-85713515d93c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:37.688755 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f7874-faaa-49ba-85c0-85713515d93c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:37.689475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f7874-faaa-49ba-85c0-85713515d93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:37.703150 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a2a2c3f9-da8a-4fce-8990-227c63b8b744 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:37.704418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a2a2c3f9-da8a-4fce-8990-227c63b8b744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:37.764155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3a0f7874-faaa-49ba-85c0-85713515d93c None None] MFA Rules not processed for user `4c382fbd9b5b4394a9a58785c2560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:37.766860 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3a0f7874-faaa-49ba-85c0-85713515d93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:37.866785 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1132/2264] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:37.869451 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c3f9-da8a-4fce-8990-227c63b8b744 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:37.949974 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1133/2265] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:57:37.959615 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c3f9-da8a-4fce-8990-227c63b8b744 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:37.975575 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52943b49-04c1-4f07-abec-e728156e614a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:37.976572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52943b49-04c1-4f07-abec-e728156e614a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:37.977015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52943b49-04c1-4f07-abec-e728156e614a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:37.977554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52943b49-04c1-4f07-abec-e728156e614a admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:37.978449 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52943b49-04c1-4f07-abec-e728156e614a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:57:37.978995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52943b49-04c1-4f07-abec-e728156e614a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:37.981157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52943b49-04c1-4f07-abec-e728156e614a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:37.999942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f7874-faaa-49ba-85c0-85713515d93c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:38.001916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3a0f7874-faaa-49ba-85c0-85713515d93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:38.022690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1133/2266] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:57:38.032069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52943b49-04c1-4f07-abec-e728156e614a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:38.062030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52943b49-04c1-4f07-abec-e728156e614a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:38.080318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80a835-322a-41ac-b8de-a1433d2743ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:38.080950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a835-322a-41ac-b8de-a1433d2743ec admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:38.081285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a835-322a-41ac-b8de-a1433d2743ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:38.081855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a835-322a-41ac-b8de-a1433d2743ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:38.086332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80a835-322a-41ac-b8de-a1433d2743ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:38.088320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80a835-322a-41ac-b8de-a1433d2743ec admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:38.106366 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:38.139574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f7874-faaa-49ba-85c0-85713515d93c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:38.150805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b613e0e-0dbb-46fe-89f6-4d60416b52a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:38.152786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b613e0e-0dbb-46fe-89f6-4d60416b52a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:38.153074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b613e0e-0dbb-46fe-89f6-4d60416b52a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:38.153341 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b613e0e-0dbb-46fe-89f6-4d60416b52a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:38.161486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1134/2267] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:57:38 2022] POST /identity/v3/projects => generated 359 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:57:38.165905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80a835-322a-41ac-b8de-a1433d2743ec admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:38.183969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b613e0e-0dbb-46fe-89f6-4d60416b52a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:38.187495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b613e0e-0dbb-46fe-89f6-4d60416b52a6 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:38.229873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1134/2268] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:57:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:57:38.292105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80a835-322a-41ac-b8de-a1433d2743ec admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:38.307234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43051b2-663e-4168-b9ac-18c670d8dae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:38.308884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43051b2-663e-4168-b9ac-18c670d8dae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:38.309556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43051b2-663e-4168-b9ac-18c670d8dae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:38.310200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43051b2-663e-4168-b9ac-18c670d8dae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:38.311086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43051b2-663e-4168-b9ac-18c670d8dae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:38.313289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43051b2-663e-4168-b9ac-18c670d8dae5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:38.348503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1135/2269] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:57:38 2022] POST /identity/v3/users => generated 280 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:57:38.352131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b613e0e-0dbb-46fe-89f6-4d60416b52a6 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:38.371475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b613e0e-0dbb-46fe-89f6-4d60416b52a6 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:38.381314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9296a0d-4f6d-40e2-a018-7ea9969ec425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:38.382430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9296a0d-4f6d-40e2-a018-7ea9969ec425 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:38.383190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9296a0d-4f6d-40e2-a018-7ea9969ec425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:38.383687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9296a0d-4f6d-40e2-a018-7ea9969ec425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:38.384856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9296a0d-4f6d-40e2-a018-7ea9969ec425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:38.387521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9296a0d-4f6d-40e2-a018-7ea9969ec425 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:38.405798 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1135/2270] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:57:38.411119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43051b2-663e-4168-b9ac-18c670d8dae5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:38.457833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43051b2-663e-4168-b9ac-18c670d8dae5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:38.473163 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa150c-0339-4f94-9a6f-8c0bca31f644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:38.475219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa150c-0339-4f94-9a6f-8c0bca31f644 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:38.475724 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa150c-0339-4f94-9a6f-8c0bca31f644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:38.476215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa150c-0339-4f94-9a6f-8c0bca31f644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:38.477100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa150c-0339-4f94-9a6f-8c0bca31f644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:38.479342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa150c-0339-4f94-9a6f-8c0bca31f644 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:38.494994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1136/2271] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:57:38.497735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9296a0d-4f6d-40e2-a018-7ea9969ec425 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:38.512150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9296a0d-4f6d-40e2-a018-7ea9969ec425 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:38.524432 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa793104-56c3-470b-93b3-410a733a6f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:38.525120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa793104-56c3-470b-93b3-410a733a6f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:38.525402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa793104-56c3-470b-93b3-410a733a6f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:38.525673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa793104-56c3-470b-93b3-410a733a6f3a admin admin] PATH_INFO: `/v3/projects/01a284804f1c43dcbee087e0bd8a58ea/users/48225d6993a84a399edb2f87e6dd3213/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:38.560319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa793104-56c3-470b-93b3-410a733a6f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a284804f1c43dcbee087e0bd8a58ea, user_id=48225d6993a84a399edb2f87e6dd3213, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:38.562976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa793104-56c3-470b-93b3-410a733a6f3a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:38.606875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1136/2272] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:57:38 2022] PUT /identity/v3/projects/01a284804f1c43dcbee087e0bd8a58ea/users/48225d6993a84a399edb2f87e6dd3213/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:38.618169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed73683-ba1f-4398-aa51-4caff93b1f25 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:38.618857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed73683-ba1f-4398-aa51-4caff93b1f25 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:38.620667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed73683-ba1f-4398-aa51-4caff93b1f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:38.677618 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:38.689055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1ed73683-ba1f-4398-aa51-4caff93b1f25 None None] MFA Rules not processed for user `48225d6993a84a399edb2f87e6dd3213`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:38.690753 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1ed73683-ba1f-4398-aa51-4caff93b1f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:38.848786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1137/2273] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:57:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:38.875089 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa793104-56c3-470b-93b3-410a733a6f3a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:39.079107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa793104-56c3-470b-93b3-410a733a6f3a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:39.099824 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa1b42-8f9b-45a7-b254-a580c19223a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:39.102106 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa1b42-8f9b-45a7-b254-a580c19223a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:39.102493 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa1b42-8f9b-45a7-b254-a580c19223a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:39.102904 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa1b42-8f9b-45a7-b254-a580c19223a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:39.125661 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa1b42-8f9b-45a7-b254-a580c19223a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:39.133934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa1b42-8f9b-45a7-b254-a580c19223a2 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:39.163527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1137/2274] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:57:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:57:48.830599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=26 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:49.146465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=49,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:03.412124 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed73683-ba1f-4398-aa51-4caff93b1f25 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:03.711054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed73683-ba1f-4398-aa51-4caff93b1f25 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:03.722982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26a1c0-cc11-458a-a30d-a1b61dd178f7 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c382fbd9b5b4394a9a58785c2560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b078eb8ee454140abdaadf874b847f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:03.723566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26a1c0-cc11-458a-a30d-a1b61dd178f7 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:03.723864 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26a1c0-cc11-458a-a30d-a1b61dd178f7 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:03.727782 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26a1c0-cc11-458a-a30d-a1b61dd178f7 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:03.728654 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26a1c0-cc11-458a-a30d-a1b61dd178f7 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:58:03.732261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26a1c0-cc11-458a-a30d-a1b61dd178f7 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:03.733768 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26a1c0-cc11-458a-a30d-a1b61dd178f7 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:03.767004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1138/2275] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:58:03.771337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa1b42-8f9b-45a7-b254-a580c19223a2 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:03.788530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa1b42-8f9b-45a7-b254-a580c19223a2 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:03.803640 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b442910-4040-4822-9705-e6a23ddb0972 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c382fbd9b5b4394a9a58785c2560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b078eb8ee454140abdaadf874b847f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:03.804268 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b442910-4040-4822-9705-e6a23ddb0972 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:03.804552 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b442910-4040-4822-9705-e6a23ddb0972 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:03.804823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b442910-4040-4822-9705-e6a23ddb0972 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:03.805483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b442910-4040-4822-9705-e6a23ddb0972 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:03.807528 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b442910-4040-4822-9705-e6a23ddb0972 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:03.878613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1138/2276] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:58:03 2022] POST /identity/v3/projects => generated 349 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:58:03.879342 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26a1c0-cc11-458a-a30d-a1b61dd178f7 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:03.903267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26a1c0-cc11-458a-a30d-a1b61dd178f7 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:04.067532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9bd26-8367-4ac8-92cd-1b545ddd2a7e tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c382fbd9b5b4394a9a58785c2560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b078eb8ee454140abdaadf874b847f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:04.068491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9bd26-8367-4ac8-92cd-1b545ddd2a7e tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:04.069167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9bd26-8367-4ac8-92cd-1b545ddd2a7e tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:04.069640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9bd26-8367-4ac8-92cd-1b545ddd2a7e tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:04.070471 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9bd26-8367-4ac8-92cd-1b545ddd2a7e tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:58:04.071080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9bd26-8367-4ac8-92cd-1b545ddd2a7e tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:04.076388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9bd26-8367-4ac8-92cd-1b545ddd2a7e tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:04.107319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1139/2277] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:58:05.778971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b442910-4040-4822-9705-e6a23ddb0972 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:05.795287 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b442910-4040-4822-9705-e6a23ddb0972 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:05.801384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39f9ef-feca-48a6-b28b-2ef3cf31e244 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c382fbd9b5b4394a9a58785c2560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b078eb8ee454140abdaadf874b847f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:05.802642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39f9ef-feca-48a6-b28b-2ef3cf31e244 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:05.803147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39f9ef-feca-48a6-b28b-2ef3cf31e244 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:05.803609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39f9ef-feca-48a6-b28b-2ef3cf31e244 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] PATH_INFO: `/v3/projects/d7d2aebaee2d43b3a0eaa3c6095617c8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:05.804942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39f9ef-feca-48a6-b28b-2ef3cf31e244 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d7d2aebaee2d43b3a0eaa3c6095617c8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:05.807890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39f9ef-feca-48a6-b28b-2ef3cf31e244 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:05.917838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-da39f9ef-feca-48a6-b28b-2ef3cf31e244 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d2aebaee2d43b3a0eaa3c6095617c8', 'request_id': 'req-da39f9ef-feca-48a6-b28b-2ef3cf31e244'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:05.941185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-da39f9ef-feca-48a6-b28b-2ef3cf31e244 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d2aebaee2d43b3a0eaa3c6095617c8', 'request_id': 'req-da39f9ef-feca-48a6-b28b-2ef3cf31e244'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:05.963224 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-da39f9ef-feca-48a6-b28b-2ef3cf31e244 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d2aebaee2d43b3a0eaa3c6095617c8', 'request_id': 'req-da39f9ef-feca-48a6-b28b-2ef3cf31e244'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:06.004416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-da39f9ef-feca-48a6-b28b-2ef3cf31e244 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] The token cache is being invalidate because project d7d2aebaee2d43b3a0eaa3c6095617c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:58:06.004718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-da39f9ef-feca-48a6-b28b-2ef3cf31e244 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:06.010642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-da39f9ef-feca-48a6-b28b-2ef3cf31e244 tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:06.015146 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1139/2278] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:58:05 2022] DELETE /identity/v3/projects/d7d2aebaee2d43b3a0eaa3c6095617c8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:06.089272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9bd26-8367-4ac8-92cd-1b545ddd2a7e tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:06.091692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dbf9bd26-8367-4ac8-92cd-1b545ddd2a7e tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:06.119408 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf1e06-2fee-47f7-aa66-40b6ef258f8f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:06.119996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf1e06-2fee-47f7-aa66-40b6ef258f8f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:06.120553 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf1e06-2fee-47f7-aa66-40b6ef258f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:06.153792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-40cf1e06-2fee-47f7-aa66-40b6ef258f8f None None] MFA Rules not processed for user `ab779a170d56400295f77401f847ab66`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:06.159177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-40cf1e06-2fee-47f7-aa66-40b6ef258f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:06.249103 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9bd26-8367-4ac8-92cd-1b545ddd2a7e tempest-RoutersAdminTest-958308236 tempest-RoutersAdminTest-958308236-project-admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:06.300664 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1140/2279] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:58:06.343858 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:06.364405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616ba5-9388-4904-92e0-72f6e2431627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:06.365042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616ba5-9388-4904-92e0-72f6e2431627 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:06.365322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616ba5-9388-4904-92e0-72f6e2431627 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:06.365592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616ba5-9388-4904-92e0-72f6e2431627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:06.371821 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cc616ba5-9388-4904-92e0-72f6e2431627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:06.521578 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc616ba5-9388-4904-92e0-72f6e2431627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:06.523069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc616ba5-9388-4904-92e0-72f6e2431627 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:06.543270 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1140/2280] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:16.282267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=61,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:16.533042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=28 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:18.749018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf1e06-2fee-47f7-aa66-40b6ef258f8f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:18.750508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-40cf1e06-2fee-47f7-aa66-40b6ef258f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:18.946515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf1e06-2fee-47f7-aa66-40b6ef258f8f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:18.962718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3856d3-396d-4b93-b458-b30e167a1b1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:18.963492 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3856d3-396d-4b93-b458-b30e167a1b1b service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:18.963867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3856d3-396d-4b93-b458-b30e167a1b1b service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:18.964234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3856d3-396d-4b93-b458-b30e167a1b1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:18.966536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-dc3856d3-396d-4b93-b458-b30e167a1b1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:18.997575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3856d3-396d-4b93-b458-b30e167a1b1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:18.999473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3856d3-396d-4b93-b458-b30e167a1b1b service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:19.026797 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1141/2281] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:19.597955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616ba5-9388-4904-92e0-72f6e2431627 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:19.614796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616ba5-9388-4904-92e0-72f6e2431627 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:19.621330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357412c9-2139-4974-adbc-6eaf690ea2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:19.622426 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357412c9-2139-4974-adbc-6eaf690ea2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:19.623035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357412c9-2139-4974-adbc-6eaf690ea2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:19.623453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357412c9-2139-4974-adbc-6eaf690ea2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:19.625828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-357412c9-2139-4974-adbc-6eaf690ea2f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:19.752332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357412c9-2139-4974-adbc-6eaf690ea2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:19.754085 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357412c9-2139-4974-adbc-6eaf690ea2f9 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:19.769352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1141/2282] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:21.927726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3856d3-396d-4b93-b458-b30e167a1b1b service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:21.929380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-dc3856d3-396d-4b93-b458-b30e167a1b1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:21.944985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3856d3-396d-4b93-b458-b30e167a1b1b service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:21.950648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb64bff-98e3-4ee0-97f3-281584eb2f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:21.951790 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb64bff-98e3-4ee0-97f3-281584eb2f6b service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:21.952253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb64bff-98e3-4ee0-97f3-281584eb2f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:21.952759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb64bff-98e3-4ee0-97f3-281584eb2f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:21.955001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bfb64bff-98e3-4ee0-97f3-281584eb2f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:21.975595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb64bff-98e3-4ee0-97f3-281584eb2f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:21.977394 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb64bff-98e3-4ee0-97f3-281584eb2f6b service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:22.007506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1142/2283] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:24.388351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357412c9-2139-4974-adbc-6eaf690ea2f9 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:24.389960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-357412c9-2139-4974-adbc-6eaf690ea2f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:24.553037 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357412c9-2139-4974-adbc-6eaf690ea2f9 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:24.567653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:24.568324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:24.568784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:24.569228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] PATH_INFO: `/v3/users/00abdeb877524c58a68c7479fcb0e751` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:24.570513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=00abdeb877524c58a68c7479fcb0e751)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:24.572498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:24.651599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00abdeb877524c58a68c7479fcb0e751'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:24.667351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00abdeb877524c58a68c7479fcb0e751'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:24.684548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00abdeb877524c58a68c7479fcb0e751'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:24.697989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00abdeb877524c58a68c7479fcb0e751'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:24.699720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00abdeb877524c58a68c7479fcb0e751'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:24.716661 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1142/2284] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:58:24 2022] DELETE /identity/v3/users/00abdeb877524c58a68c7479fcb0e751 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:24.721471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6579da-7bd8-471d-9584-7caacd938b0f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:24.726815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6579da-7bd8-471d-9584-7caacd938b0f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:24.727269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6579da-7bd8-471d-9584-7caacd938b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:24.766380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7c6579da-7bd8-471d-9584-7caacd938b0f None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:24.772111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7c6579da-7bd8-471d-9584-7caacd938b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:24.929108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1143/2285] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:24.972529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:24.975680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:24.984998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:25.076891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01442180-b4dd-420d-9864-475bbe441ccb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:25.082378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95a626-e666-4ce3-9777-b38df71f7ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:25.083370 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95a626-e666-4ce3-9777-b38df71f7ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:25.083773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95a626-e666-4ce3-9777-b38df71f7ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:25.084269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95a626-e666-4ce3-9777-b38df71f7ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:25.096606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95a626-e666-4ce3-9777-b38df71f7ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:25.098453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95a626-e666-4ce3-9777-b38df71f7ff1 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:25.110455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1143/2286] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:26.329924 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6579da-7bd8-471d-9584-7caacd938b0f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:26.331427 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7c6579da-7bd8-471d-9584-7caacd938b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:26.350115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6579da-7bd8-471d-9584-7caacd938b0f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:26.355001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f413a9-ff62-4516-8545-1e50a037a556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:26.355865 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f413a9-ff62-4516-8545-1e50a037a556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:26.356313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f413a9-ff62-4516-8545-1e50a037a556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:26.357421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f413a9-ff62-4516-8545-1e50a037a556 admin admin] PATH_INFO: `/v3/projects/69e3cf0dce824ffebb77b4b258eba9a5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:26.358882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f413a9-ff62-4516-8545-1e50a037a556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e3cf0dce824ffebb77b4b258eba9a5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:26.361878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f413a9-ff62-4516-8545-1e50a037a556 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:26.440072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95a626-e666-4ce3-9777-b38df71f7ff1 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:26.441811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-75f413a9-ff62-4516-8545-1e50a037a556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e3cf0dce824ffebb77b4b258eba9a5', 'request_id': 'req-75f413a9-ff62-4516-8545-1e50a037a556'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:26.441944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ce95a626-e666-4ce3-9777-b38df71f7ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:26.454107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-75f413a9-ff62-4516-8545-1e50a037a556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e3cf0dce824ffebb77b4b258eba9a5', 'request_id': 'req-75f413a9-ff62-4516-8545-1e50a037a556'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:26.468632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-75f413a9-ff62-4516-8545-1e50a037a556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e3cf0dce824ffebb77b4b258eba9a5', 'request_id': 'req-75f413a9-ff62-4516-8545-1e50a037a556'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:26.488665 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:26.501214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-75f413a9-ff62-4516-8545-1e50a037a556 admin admin] The token cache is being invalidate because project 69e3cf0dce824ffebb77b4b258eba9a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:58:26.501655 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-75f413a9-ff62-4516-8545-1e50a037a556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:26.502688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-75f413a9-ff62-4516-8545-1e50a037a556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:26.506498 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1144/2287] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:58:26 2022] DELETE /identity/v3/projects/69e3cf0dce824ffebb77b4b258eba9a5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:26.512024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79297d43-426b-49d9-bd51-134b0189cc60 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:26.512910 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79297d43-426b-49d9-bd51-134b0189cc60 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:26.513190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79297d43-426b-49d9-bd51-134b0189cc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:26.555500 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-79297d43-426b-49d9-bd51-134b0189cc60 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:26.556732 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-79297d43-426b-49d9-bd51-134b0189cc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:26.574026 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95a626-e666-4ce3-9777-b38df71f7ff1 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:26.684085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1145/2288] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:26.685566 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e2bd-cf56-4f08-9d99-aa690236cf47 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:26.685856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e2bd-cf56-4f08-9d99-aa690236cf47 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:26.686127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e2bd-cf56-4f08-9d99-aa690236cf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:26.707910 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3500e2bd-cf56-4f08-9d99-aa690236cf47 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:26.709082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3500e2bd-cf56-4f08-9d99-aa690236cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:26.718598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1146/2289] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:26.719353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912365e5-b790-4947-81a4-b36e88df0645 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:26.722273 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912365e5-b790-4947-81a4-b36e88df0645 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:26.723530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912365e5-b790-4947-81a4-b36e88df0645 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:26.723821 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912365e5-b790-4947-81a4-b36e88df0645 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:26.725951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-912365e5-b790-4947-81a4-b36e88df0645 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:26.729434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e2bd-cf56-4f08-9d99-aa690236cf47 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:26.744292 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e2bd-cf56-4f08-9d99-aa690236cf47 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:26.748015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912365e5-b790-4947-81a4-b36e88df0645 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:26.750515 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912365e5-b790-4947-81a4-b36e88df0645 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:26.751836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601fcac-caf2-46cd-806b-2fa46d5fae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:26.752743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601fcac-caf2-46cd-806b-2fa46d5fae59 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:26.753293 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601fcac-caf2-46cd-806b-2fa46d5fae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:26.753734 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601fcac-caf2-46cd-806b-2fa46d5fae59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:26.754611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601fcac-caf2-46cd-806b-2fa46d5fae59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:58:26.755069 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601fcac-caf2-46cd-806b-2fa46d5fae59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:26.757432 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601fcac-caf2-46cd-806b-2fa46d5fae59 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:26.764073 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1144/2290] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:58:26.784198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912365e5-b790-4947-81a4-b36e88df0645 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:26.786037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1147/2291] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:58:26.819521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912365e5-b790-4947-81a4-b36e88df0645 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:26.857468 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d58ea1-9dc5-42e7-9bff-33d980a15ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:26.859924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d58ea1-9dc5-42e7-9bff-33d980a15ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:26.863428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d58ea1-9dc5-42e7-9bff-33d980a15ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:26.865820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d58ea1-9dc5-42e7-9bff-33d980a15ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:26.867734 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d58ea1-9dc5-42e7-9bff-33d980a15ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:26.873187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d58ea1-9dc5-42e7-9bff-33d980a15ea7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:26.925007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601fcac-caf2-46cd-806b-2fa46d5fae59 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:26.935668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1145/2292] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:58:26 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:58:26.940094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601fcac-caf2-46cd-806b-2fa46d5fae59 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:27.050803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd10ddc-a624-4606-9bb4-a8c5dcf242de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:27.051444 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd10ddc-a624-4606-9bb4-a8c5dcf242de admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:27.051777 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd10ddc-a624-4606-9bb4-a8c5dcf242de admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:27.052219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd10ddc-a624-4606-9bb4-a8c5dcf242de admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:27.052840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd10ddc-a624-4606-9bb4-a8c5dcf242de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:27.055206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd10ddc-a624-4606-9bb4-a8c5dcf242de admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:27.101828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d58ea1-9dc5-42e7-9bff-33d980a15ea7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:27.106831 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1148/2293] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:58:26 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:58:27.118719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d58ea1-9dc5-42e7-9bff-33d980a15ea7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:27.125813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044a5de-7bfe-4e87-b22e-b4f521348c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:27.126614 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044a5de-7bfe-4e87-b22e-b4f521348c98 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:27.126979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044a5de-7bfe-4e87-b22e-b4f521348c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:27.127301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044a5de-7bfe-4e87-b22e-b4f521348c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:27.128012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044a5de-7bfe-4e87-b22e-b4f521348c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:27.129953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044a5de-7bfe-4e87-b22e-b4f521348c98 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:27.154005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd10ddc-a624-4606-9bb4-a8c5dcf242de admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:27.154460 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1146/2294] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:58:27.170506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd10ddc-a624-4606-9bb4-a8c5dcf242de admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:27.177072 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2e6d8-5bd1-48d6-a0b0-bae994f174b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:27.177759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2e6d8-5bd1-48d6-a0b0-bae994f174b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:27.178038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2e6d8-5bd1-48d6-a0b0-bae994f174b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:27.178306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2e6d8-5bd1-48d6-a0b0-bae994f174b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:27.179053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2e6d8-5bd1-48d6-a0b0-bae994f174b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:27.182676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2e6d8-5bd1-48d6-a0b0-bae994f174b9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:27.207173 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1149/2295] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:58:27.211218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044a5de-7bfe-4e87-b22e-b4f521348c98 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:27.235309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044a5de-7bfe-4e87-b22e-b4f521348c98 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:27.251411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3dca9-f04f-4f37-bc8c-a4abb69dd718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:27.253249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3dca9-f04f-4f37-bc8c-a4abb69dd718 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:27.253530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3dca9-f04f-4f37-bc8c-a4abb69dd718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:27.256788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3dca9-f04f-4f37-bc8c-a4abb69dd718 admin admin] PATH_INFO: `/v3/projects/d39aa7dbfdab4a18842850f1b2de5d92/users/65d4bb96b5b04cb298ab2ca59837add1/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:27.262962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:27.290202 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3dca9-f04f-4f37-bc8c-a4abb69dd718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39aa7dbfdab4a18842850f1b2de5d92, user_id=65d4bb96b5b04cb298ab2ca59837add1, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:27.293553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3dca9-f04f-4f37-bc8c-a4abb69dd718 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:27.330653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1147/2296] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:58:27 2022] PUT /identity/v3/projects/d39aa7dbfdab4a18842850f1b2de5d92/users/65d4bb96b5b04cb298ab2ca59837add1/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:27.332564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d727063-f052-47b6-99c3-f30f27df3709 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:27.333028 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d727063-f052-47b6-99c3-f30f27df3709 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:27.333207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d727063-f052-47b6-99c3-f30f27df3709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:27.401323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4d727063-f052-47b6-99c3-f30f27df3709 None None] MFA Rules not processed for user `65d4bb96b5b04cb298ab2ca59837add1`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:27.403745 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4d727063-f052-47b6-99c3-f30f27df3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:27.506145 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:27.579484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1150/2297] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:27.646838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3dca9-f04f-4f37-bc8c-a4abb69dd718 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:27.650074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d7c3dca9-f04f-4f37-bc8c-a4abb69dd718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:27.780375 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3dca9-f04f-4f37-bc8c-a4abb69dd718 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:27.785996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b599e-ab93-4317-bf28-29a648545441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:27.786853 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b599e-ab93-4317-bf28-29a648545441 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:27.787207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b599e-ab93-4317-bf28-29a648545441 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:27.787540 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b599e-ab93-4317-bf28-29a648545441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:27.800350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b599e-ab93-4317-bf28-29a648545441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:27.801874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b599e-ab93-4317-bf28-29a648545441 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:27.821108 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1148/2298] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:36.810556 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d727063-f052-47b6-99c3-f30f27df3709 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:36.812626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4d727063-f052-47b6-99c3-f30f27df3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:36.832116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d727063-f052-47b6-99c3-f30f27df3709 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:36.847929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a2894-b7dd-4dc9-a3ad-b42ae83a4c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:36.849941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a2894-b7dd-4dc9-a3ad-b42ae83a4c4f service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:36.850385 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a2894-b7dd-4dc9-a3ad-b42ae83a4c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:36.851298 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a2894-b7dd-4dc9-a3ad-b42ae83a4c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:36.853707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a36a2894-b7dd-4dc9-a3ad-b42ae83a4c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:36.869170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a2894-b7dd-4dc9-a3ad-b42ae83a4c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:36.872243 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a2894-b7dd-4dc9-a3ad-b42ae83a4c4f service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:36.891602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1151/2299] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:37.810656 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:39.859181 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b599e-ab93-4317-bf28-29a648545441 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:39.869855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b599e-ab93-4317-bf28-29a648545441 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:39.874201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba902315-daef-4aea-913e-3a157dc8aff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:39.875071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902315-daef-4aea-913e-3a157dc8aff3 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:39.875546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902315-daef-4aea-913e-3a157dc8aff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:39.875986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902315-daef-4aea-913e-3a157dc8aff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:39.878660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ba902315-daef-4aea-913e-3a157dc8aff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:39.959736 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba902315-daef-4aea-913e-3a157dc8aff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:39.961932 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba902315-daef-4aea-913e-3a157dc8aff3 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:39.975344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1149/2300] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:42.177011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a2894-b7dd-4dc9-a3ad-b42ae83a4c4f service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:42.319004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a2894-b7dd-4dc9-a3ad-b42ae83a4c4f service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:42.327363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:42.328314 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:42.329083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:42.330215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] PATH_INFO: `/v3/users/65d4bb96b5b04cb298ab2ca59837add1` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:42.331844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d4bb96b5b04cb298ab2ca59837add1)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:42.335208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:42.433424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d4bb96b5b04cb298ab2ca59837add1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:42.433424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d4bb96b5b04cb298ab2ca59837add1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:42.444563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d4bb96b5b04cb298ab2ca59837add1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:42.467508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d4bb96b5b04cb298ab2ca59837add1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:42.487385 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d4bb96b5b04cb298ab2ca59837add1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:42.508578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1152/2301] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:58:42 2022] DELETE /identity/v3/users/65d4bb96b5b04cb298ab2ca59837add1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:42.510458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626874f1-08e2-471c-95fa-4cf8ead602df None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:42.510947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626874f1-08e2-471c-95fa-4cf8ead602df None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:42.510947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626874f1-08e2-471c-95fa-4cf8ead602df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:42.531982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-626874f1-08e2-471c-95fa-4cf8ead602df None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:42.533793 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-626874f1-08e2-471c-95fa-4cf8ead602df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:42.708249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1150/2302] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:42.735880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:42.737451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:42.839607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe16c62-6806-4986-a747-4582a3c664c5 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:42.859574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17479096-da93-401d-a66e-a09470686fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:42.860209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17479096-da93-401d-a66e-a09470686fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:42.860481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17479096-da93-401d-a66e-a09470686fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:42.860788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17479096-da93-401d-a66e-a09470686fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:42.874295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17479096-da93-401d-a66e-a09470686fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:42.877078 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17479096-da93-401d-a66e-a09470686fc9 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:42.883412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:42.898119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1153/2303] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:43.488100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626874f1-08e2-471c-95fa-4cf8ead602df None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:43.489746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-626874f1-08e2-471c-95fa-4cf8ead602df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:43.509496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626874f1-08e2-471c-95fa-4cf8ead602df None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:43.525597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77567c98-85c7-4d09-8754-6f065c4b4b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:43.529240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77567c98-85c7-4d09-8754-6f065c4b4b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:43.529983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77567c98-85c7-4d09-8754-6f065c4b4b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:43.530449 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77567c98-85c7-4d09-8754-6f065c4b4b25 admin admin] PATH_INFO: `/v3/projects/d39aa7dbfdab4a18842850f1b2de5d92` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:43.534174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77567c98-85c7-4d09-8754-6f065c4b4b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39aa7dbfdab4a18842850f1b2de5d92)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:43.537637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77567c98-85c7-4d09-8754-6f065c4b4b25 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:43.636491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-77567c98-85c7-4d09-8754-6f065c4b4b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39aa7dbfdab4a18842850f1b2de5d92', 'request_id': 'req-77567c98-85c7-4d09-8754-6f065c4b4b25'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:43.652861 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-77567c98-85c7-4d09-8754-6f065c4b4b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39aa7dbfdab4a18842850f1b2de5d92', 'request_id': 'req-77567c98-85c7-4d09-8754-6f065c4b4b25'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:43.665191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-77567c98-85c7-4d09-8754-6f065c4b4b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39aa7dbfdab4a18842850f1b2de5d92', 'request_id': 'req-77567c98-85c7-4d09-8754-6f065c4b4b25'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:43.694205 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-77567c98-85c7-4d09-8754-6f065c4b4b25 admin admin] The token cache is being invalidate because project d39aa7dbfdab4a18842850f1b2de5d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:58:43.694799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-77567c98-85c7-4d09-8754-6f065c4b4b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:43.695864 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-77567c98-85c7-4d09-8754-6f065c4b4b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:43.698849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1151/2304] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:58:43 2022] DELETE /identity/v3/projects/d39aa7dbfdab4a18842850f1b2de5d92 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:43.704275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6264610-b516-4b83-b4d0-02401fbbc67c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:43.704801 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6264610-b516-4b83-b4d0-02401fbbc67c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:43.704919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6264610-b516-4b83-b4d0-02401fbbc67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:43.727445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e6264610-b516-4b83-b4d0-02401fbbc67c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:43.730331 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e6264610-b516-4b83-b4d0-02401fbbc67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:43.836351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1154/2305] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:43.847321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89d008-1014-4835-ac3d-2dd9645ac340 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:43.848054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89d008-1014-4835-ac3d-2dd9645ac340 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:43.849003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89d008-1014-4835-ac3d-2dd9645ac340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:43.877831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6a89d008-1014-4835-ac3d-2dd9645ac340 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:43.879943 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6a89d008-1014-4835-ac3d-2dd9645ac340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:43.894673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1152/2306] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:43.898848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6264610-b516-4b83-b4d0-02401fbbc67c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:43.914227 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6264610-b516-4b83-b4d0-02401fbbc67c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:43.926226 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9d65f-f885-4b56-882f-a78cc67b36ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:43.927085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9d65f-f885-4b56-882f-a78cc67b36ac admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:43.927377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9d65f-f885-4b56-882f-a78cc67b36ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:43.927622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9d65f-f885-4b56-882f-a78cc67b36ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:43.928276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9d65f-f885-4b56-882f-a78cc67b36ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:58:43.928574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9d65f-f885-4b56-882f-a78cc67b36ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:43.930342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9d65f-f885-4b56-882f-a78cc67b36ac admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:43.947525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1155/2307] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:58:43.952087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89d008-1014-4835-ac3d-2dd9645ac340 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:43.963809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89d008-1014-4835-ac3d-2dd9645ac340 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:43.975900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254c5a0-815f-46f8-a534-766019338716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:43.976704 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c5a0-815f-46f8-a534-766019338716 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:43.977068 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c5a0-815f-46f8-a534-766019338716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:43.977432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c5a0-815f-46f8-a534-766019338716 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:43.978200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254c5a0-815f-46f8-a534-766019338716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:43.980271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254c5a0-815f-46f8-a534-766019338716 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:43.990964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:44.003093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9d65f-f885-4b56-882f-a78cc67b36ac admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:44.005104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-21b9d65f-f885-4b56-882f-a78cc67b36ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:44.018806 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1153/2308] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:58:43 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:58:44.019601 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9d65f-f885-4b56-882f-a78cc67b36ac admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:44.021248 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254c5a0-815f-46f8-a534-766019338716 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:44.090899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed5e9f-8dad-4c6c-bcaa-574ed629901c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:44.091706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed5e9f-8dad-4c6c-bcaa-574ed629901c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:44.092101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed5e9f-8dad-4c6c-bcaa-574ed629901c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:44.092376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed5e9f-8dad-4c6c-bcaa-574ed629901c admin admin] PATH_INFO: `/v3/users/f7bf5330c5f64d1986ba68f21ee4f05a` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:44.093566 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed5e9f-8dad-4c6c-bcaa-574ed629901c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bf5330c5f64d1986ba68f21ee4f05a)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:44.096303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed5e9f-8dad-4c6c-bcaa-574ed629901c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:44.100936 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254c5a0-815f-46f8-a534-766019338716 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:44.106580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3e169-f91c-4f2e-9445-d6ca82b45f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:44.107339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3e169-f91c-4f2e-9445-d6ca82b45f8e admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:44.107682 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3e169-f91c-4f2e-9445-d6ca82b45f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:44.108129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3e169-f91c-4f2e-9445-d6ca82b45f8e admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:44.108847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3e169-f91c-4f2e-9445-d6ca82b45f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:44.110949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3e169-f91c-4f2e-9445-d6ca82b45f8e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:44.137269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1154/2309] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:58:44 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:58:44.140970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3e169-f91c-4f2e-9445-d6ca82b45f8e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:44.153785 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3e169-f91c-4f2e-9445-d6ca82b45f8e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:44.154459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a4ed5e9f-8dad-4c6c-bcaa-574ed629901c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bf5330c5f64d1986ba68f21ee4f05a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:44.155228 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a4ed5e9f-8dad-4c6c-bcaa-574ed629901c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bf5330c5f64d1986ba68f21ee4f05a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:44.159222 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d782166-45f7-471f-a1fe-6718138091b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:44.159924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d782166-45f7-471f-a1fe-6718138091b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:44.160529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d782166-45f7-471f-a1fe-6718138091b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:44.160942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d782166-45f7-471f-a1fe-6718138091b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:44.161681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d782166-45f7-471f-a1fe-6718138091b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:44.163354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d782166-45f7-471f-a1fe-6718138091b2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:44.164982 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a4ed5e9f-8dad-4c6c-bcaa-574ed629901c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bf5330c5f64d1986ba68f21ee4f05a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:44.174783 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1155/2310] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:58:44.176368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a4ed5e9f-8dad-4c6c-bcaa-574ed629901c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bf5330c5f64d1986ba68f21ee4f05a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:44.179040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d782166-45f7-471f-a1fe-6718138091b2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:44.181102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6d782166-45f7-471f-a1fe-6718138091b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:44.193600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a4ed5e9f-8dad-4c6c-bcaa-574ed629901c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bf5330c5f64d1986ba68f21ee4f05a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:44.195301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d782166-45f7-471f-a1fe-6718138091b2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:44.200963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcb956-d5b7-4986-81e5-d0e16aa46220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:44.201221 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1156/2311] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:58:44 2022] DELETE /identity/v3/users/f7bf5330c5f64d1986ba68f21ee4f05a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:44.202249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcb956-d5b7-4986-81e5-d0e16aa46220 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:44.202365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcb956-d5b7-4986-81e5-d0e16aa46220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:44.202563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcb956-d5b7-4986-81e5-d0e16aa46220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:44.203276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcb956-d5b7-4986-81e5-d0e16aa46220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:44.205611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcb956-d5b7-4986-81e5-d0e16aa46220 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:44.206469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a89447-d19d-45f8-bdc4-e260c1a2d0c5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:44.206771 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a89447-d19d-45f8-bdc4-e260c1a2d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:44.207164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a89447-d19d-45f8-bdc4-e260c1a2d0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:44.217248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:44.220779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1156/2312] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:58:44.221926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcb956-d5b7-4986-81e5-d0e16aa46220 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:44.232957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-89a89447-d19d-45f8-bdc4-e260c1a2d0c5 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:44.233160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcb956-d5b7-4986-81e5-d0e16aa46220 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:44.235494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-89a89447-d19d-45f8-bdc4-e260c1a2d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:44.297836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064968c-e5df-4163-9f91-e7f77bbeeb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:44.298629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064968c-e5df-4163-9f91-e7f77bbeeb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:44.299007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064968c-e5df-4163-9f91-e7f77bbeeb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:44.299353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064968c-e5df-4163-9f91-e7f77bbeeb99 admin admin] PATH_INFO: `/v3/projects/c32be9dbce3c46dfa4a08445f8295cb9/users/48f4b8f00e304e618afbed37c9d952c3/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:44.310902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1157/2313] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:44.315571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064968c-e5df-4163-9f91-e7f77bbeeb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32be9dbce3c46dfa4a08445f8295cb9, user_id=48f4b8f00e304e618afbed37c9d952c3, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:44.318894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064968c-e5df-4163-9f91-e7f77bbeeb99 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:44.320634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a89447-d19d-45f8-bdc4-e260c1a2d0c5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:44.322870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-89a89447-d19d-45f8-bdc4-e260c1a2d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:44.333754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1157/2314] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:58:44 2022] PUT /identity/v3/projects/c32be9dbce3c46dfa4a08445f8295cb9/users/48f4b8f00e304e618afbed37c9d952c3/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:44.344432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2280cd4-3cec-4c4f-ac0f-e546db82503e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:44.344718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2280cd4-3cec-4c4f-ac0f-e546db82503e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:44.345518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2280cd4-3cec-4c4f-ac0f-e546db82503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:44.377422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c2280cd4-3cec-4c4f-ac0f-e546db82503e None None] MFA Rules not processed for user `48f4b8f00e304e618afbed37c9d952c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:44.378791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c2280cd4-3cec-4c4f-ac0f-e546db82503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:44.409350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a89447-d19d-45f8-bdc4-e260c1a2d0c5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:44.417844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:44.474666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97d1b1-391e-4406-a781-92bac42d577f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:44.479277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1158/2315] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:44.479467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97d1b1-391e-4406-a781-92bac42d577f service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:44.479467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97d1b1-391e-4406-a781-92bac42d577f service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:44.479467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97d1b1-391e-4406-a781-92bac42d577f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:44.487281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2280cd4-3cec-4c4f-ac0f-e546db82503e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:44.497901 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2280cd4-3cec-4c4f-ac0f-e546db82503e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:44.501837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623b1e0-a47d-48dc-aebb-55855d84504e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:44.502583 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623b1e0-a47d-48dc-aebb-55855d84504e service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:44.502981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623b1e0-a47d-48dc-aebb-55855d84504e service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:44.503346 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623b1e0-a47d-48dc-aebb-55855d84504e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:44.512628 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623b1e0-a47d-48dc-aebb-55855d84504e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:44.514146 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623b1e0-a47d-48dc-aebb-55855d84504e service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:44.524779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1159/2316] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:58:44.556023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97d1b1-391e-4406-a781-92bac42d577f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:44.557540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97d1b1-391e-4406-a781-92bac42d577f service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:44.569278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1158/2317] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:58:44.979641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623b1e0-a47d-48dc-aebb-55855d84504e service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:44.981518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4623b1e0-a47d-48dc-aebb-55855d84504e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:45.008656 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623b1e0-a47d-48dc-aebb-55855d84504e service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:45.016557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:45.017871 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:45.018261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:45.018544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4 admin admin] PATH_INFO: `/v3/projects/4e83ff0f5b4b49d7a05b32ef0d2a7aa6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:45.019828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e83ff0f5b4b49d7a05b32ef0d2a7aa6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:45.021800 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:45.102801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e83ff0f5b4b49d7a05b32ef0d2a7aa6', 'request_id': 'req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:45.119038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e83ff0f5b4b49d7a05b32ef0d2a7aa6', 'request_id': 'req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:45.135336 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e83ff0f5b4b49d7a05b32ef0d2a7aa6', 'request_id': 'req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:45.154286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4 admin admin] The token cache is being invalidate because project 4e83ff0f5b4b49d7a05b32ef0d2a7aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:58:45.154757 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:45.155529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b3412cb2-a822-4bd2-9d0c-5bd8842ce2f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:45.160949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1160/2318] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:58:44 2022] DELETE /identity/v3/projects/4e83ff0f5b4b49d7a05b32ef0d2a7aa6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:45.163632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9d60-631b-483b-b10e-fee710abb6fc None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:45.164126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9d60-631b-483b-b10e-fee710abb6fc None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:45.165110 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9d60-631b-483b-b10e-fee710abb6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:45.189656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e13c9d60-631b-483b-b10e-fee710abb6fc None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:45.192744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e13c9d60-631b-483b-b10e-fee710abb6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:45.201081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:45.275398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1159/2319] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:45.277132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f64bd-f63e-45bb-b532-2aa42e15aafe None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:45.277567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f64bd-f63e-45bb-b532-2aa42e15aafe None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:45.278810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f64bd-f63e-45bb-b532-2aa42e15aafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:45.306773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b49f64bd-f63e-45bb-b532-2aa42e15aafe None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:45.308389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b49f64bd-f63e-45bb-b532-2aa42e15aafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:45.318556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1161/2320] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:58:45.323368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c9d60-631b-483b-b10e-fee710abb6fc None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:45.337103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c9d60-631b-483b-b10e-fee710abb6fc None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:45.342058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc0ba9-59e9-4046-862c-7419c9f071aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:45.342850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc0ba9-59e9-4046-862c-7419c9f071aa admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:45.343128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc0ba9-59e9-4046-862c-7419c9f071aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:45.343391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc0ba9-59e9-4046-862c-7419c9f071aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:45.344088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc0ba9-59e9-4046-862c-7419c9f071aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:58:45.344339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc0ba9-59e9-4046-862c-7419c9f071aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:45.346098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc0ba9-59e9-4046-862c-7419c9f071aa admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:45.386759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1160/2321] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:58:45.391365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f64bd-f63e-45bb-b532-2aa42e15aafe None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:45.405739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f64bd-f63e-45bb-b532-2aa42e15aafe None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:45.415881 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c641a-e8a1-4253-b166-f190949a4a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:45.416754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c641a-e8a1-4253-b166-f190949a4a0c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:45.417160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c641a-e8a1-4253-b166-f190949a4a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:45.418021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c641a-e8a1-4253-b166-f190949a4a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:45.418907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c641a-e8a1-4253-b166-f190949a4a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:45.421732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c641a-e8a1-4253-b166-f190949a4a0c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:45.504628 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1162/2322] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:58:45 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:58:45.510015 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc0ba9-59e9-4046-862c-7419c9f071aa admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:45.526062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc0ba9-59e9-4046-862c-7419c9f071aa admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:45.613112 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95205a66-3118-4b0d-b271-67335a7d3abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:45.613861 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95205a66-3118-4b0d-b271-67335a7d3abe admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:45.614234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95205a66-3118-4b0d-b271-67335a7d3abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:45.614604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95205a66-3118-4b0d-b271-67335a7d3abe admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:45.615430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95205a66-3118-4b0d-b271-67335a7d3abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:45.619634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95205a66-3118-4b0d-b271-67335a7d3abe admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:45.653393 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1161/2323] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:58:45 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:58:45.657322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c641a-e8a1-4253-b166-f190949a4a0c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:45.674492 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c641a-e8a1-4253-b166-f190949a4a0c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:45.684779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7e246-584a-481a-9a72-cf943c6e6b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:45.685564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7e246-584a-481a-9a72-cf943c6e6b15 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:45.686478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7e246-584a-481a-9a72-cf943c6e6b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:45.686892 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7e246-584a-481a-9a72-cf943c6e6b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:45.687838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7e246-584a-481a-9a72-cf943c6e6b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:45.690197 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7e246-584a-481a-9a72-cf943c6e6b15 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:45.706408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1163/2324] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:58:45.710402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95205a66-3118-4b0d-b271-67335a7d3abe admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:45.725697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95205a66-3118-4b0d-b271-67335a7d3abe admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:45.732773 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a9d1a-74e1-454b-ba42-05060e7bc346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:45.733513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a9d1a-74e1-454b-ba42-05060e7bc346 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:45.733986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a9d1a-74e1-454b-ba42-05060e7bc346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:45.734598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a9d1a-74e1-454b-ba42-05060e7bc346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:45.735399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a9d1a-74e1-454b-ba42-05060e7bc346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:45.737508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a9d1a-74e1-454b-ba42-05060e7bc346 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:45.756425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1162/2325] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:58:45.757671 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7e246-584a-481a-9a72-cf943c6e6b15 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:45.774702 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7e246-584a-481a-9a72-cf943c6e6b15 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:45.795399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959e579-15a8-4da0-8468-2253fe694229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:45.796760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959e579-15a8-4da0-8468-2253fe694229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:45.797252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959e579-15a8-4da0-8468-2253fe694229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:45.797671 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959e579-15a8-4da0-8468-2253fe694229 admin admin] PATH_INFO: `/v3/projects/c375ee60d68440e982f4a099a2712bb1/users/54ebbc3b1a4a4a959edc84068eef043f/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:45.821235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959e579-15a8-4da0-8468-2253fe694229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c375ee60d68440e982f4a099a2712bb1, user_id=54ebbc3b1a4a4a959edc84068eef043f, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:45.825807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959e579-15a8-4da0-8468-2253fe694229 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:45.847521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1164/2326] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:58:45 2022] PUT /identity/v3/projects/c375ee60d68440e982f4a099a2712bb1/users/54ebbc3b1a4a4a959edc84068eef043f/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:45.861374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a99961-d24f-47da-8b1f-60f960fadbea None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:45.861768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a99961-d24f-47da-8b1f-60f960fadbea None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:45.862139 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a99961-d24f-47da-8b1f-60f960fadbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:45.894918 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-02a99961-d24f-47da-8b1f-60f960fadbea None None] MFA Rules not processed for user `54ebbc3b1a4a4a959edc84068eef043f`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:45.896345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-02a99961-d24f-47da-8b1f-60f960fadbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:45.995343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1163/2327] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:46.029767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959e579-15a8-4da0-8468-2253fe694229 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:46.035681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4959e579-15a8-4da0-8468-2253fe694229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:46.134705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:46.184957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959e579-15a8-4da0-8468-2253fe694229 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:46.202784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a358d64-f0c6-43d0-ac67-de621175cfc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:46.203499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a358d64-f0c6-43d0-ac67-de621175cfc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:46.203844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a358d64-f0c6-43d0-ac67-de621175cfc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:46.204195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a358d64-f0c6-43d0-ac67-de621175cfc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:46.223398 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a358d64-f0c6-43d0-ac67-de621175cfc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:46.225192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a358d64-f0c6-43d0-ac67-de621175cfc0 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:46.238298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1165/2328] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:47.588791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a99961-d24f-47da-8b1f-60f960fadbea None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:47.614488 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:47.772928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a99961-d24f-47da-8b1f-60f960fadbea None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:47.786230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:47.787432 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:47.787432 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:47.787704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] PATH_INFO: `/v3/users/54ebbc3b1a4a4a959edc84068eef043f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:47.789385 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ebbc3b1a4a4a959edc84068eef043f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:47.791451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:47.846172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ebbc3b1a4a4a959edc84068eef043f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:47.847051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ebbc3b1a4a4a959edc84068eef043f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:47.855496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ebbc3b1a4a4a959edc84068eef043f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:47.864001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ebbc3b1a4a4a959edc84068eef043f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:47.880838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ebbc3b1a4a4a959edc84068eef043f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:47.892486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1164/2329] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:58:47 2022] DELETE /identity/v3/users/54ebbc3b1a4a4a959edc84068eef043f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:47.896553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34087f74-9e53-4d25-a06d-6777f7eceae0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:47.897537 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34087f74-9e53-4d25-a06d-6777f7eceae0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:47.898820 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34087f74-9e53-4d25-a06d-6777f7eceae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:47.931186 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-34087f74-9e53-4d25-a06d-6777f7eceae0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:47.933005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-34087f74-9e53-4d25-a06d-6777f7eceae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:48.024522 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1166/2330] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:58:48.041016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:48.042523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:48.162424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b1569-0234-426e-b184-69d6ead1270c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:48.169533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a093af9-dafd-46f0-8249-737d08c775b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:48.170810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a093af9-dafd-46f0-8249-737d08c775b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:48.171563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a093af9-dafd-46f0-8249-737d08c775b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:48.172042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a093af9-dafd-46f0-8249-737d08c775b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:48.189591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a093af9-dafd-46f0-8249-737d08c775b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:48.191959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a093af9-dafd-46f0-8249-737d08c775b1 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:48.205266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1165/2331] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:49.284539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34087f74-9e53-4d25-a06d-6777f7eceae0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:49.289886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-34087f74-9e53-4d25-a06d-6777f7eceae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:49.321778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a093af9-dafd-46f0-8249-737d08c775b1 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:49.324541 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9a093af9-dafd-46f0-8249-737d08c775b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:49.394585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34087f74-9e53-4d25-a06d-6777f7eceae0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:49.412261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:49.412261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:49.412487 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:49.412730 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0 admin admin] PATH_INFO: `/v3/projects/c375ee60d68440e982f4a099a2712bb1` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:49.416348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:49.420150 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c375ee60d68440e982f4a099a2712bb1)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:49.425400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:49.539210 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a093af9-dafd-46f0-8249-737d08c775b1 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:49.560012 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529592dd-d905-479a-8d0d-f6b96f1ba15b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:49.560648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529592dd-d905-479a-8d0d-f6b96f1ba15b service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:49.560928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529592dd-d905-479a-8d0d-f6b96f1ba15b service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:49.561200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529592dd-d905-479a-8d0d-f6b96f1ba15b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:49.570424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-529592dd-d905-479a-8d0d-f6b96f1ba15b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:49.582515 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c375ee60d68440e982f4a099a2712bb1', 'request_id': 'req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:49.601249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529592dd-d905-479a-8d0d-f6b96f1ba15b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:49.602921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529592dd-d905-479a-8d0d-f6b96f1ba15b service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:49.616989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c375ee60d68440e982f4a099a2712bb1', 'request_id': 'req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:49.629710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1166/2332] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:49.637688 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c375ee60d68440e982f4a099a2712bb1', 'request_id': 'req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:49.654117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0 admin admin] The token cache is being invalidate because project c375ee60d68440e982f4a099a2712bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:58:49.654962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:49.655967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-26b15837-2a09-4eb3-bdc2-c4fd4c9306d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:49.658291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1167/2333] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:58:49 2022] DELETE /identity/v3/projects/c375ee60d68440e982f4a099a2712bb1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:49.664145 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91a250-078d-409f-875b-9a2ef15e4ce2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:49.665010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91a250-078d-409f-875b-9a2ef15e4ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:49.665539 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91a250-078d-409f-875b-9a2ef15e4ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:49.699724 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9e91a250-078d-409f-875b-9a2ef15e4ce2 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:49.702355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9e91a250-078d-409f-875b-9a2ef15e4ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:49.795748 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1167/2334] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:58:49.804449 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee86e6-1551-4d46-95be-a29cc395b8c7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:49.804911 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee86e6-1551-4d46-95be-a29cc395b8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:49.805272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee86e6-1551-4d46-95be-a29cc395b8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:49.832577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-23ee86e6-1551-4d46-95be-a29cc395b8c7 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:49.834048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-23ee86e6-1551-4d46-95be-a29cc395b8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:49.845461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1168/2335] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:49.849777 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91a250-078d-409f-875b-9a2ef15e4ce2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:49.864741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91a250-078d-409f-875b-9a2ef15e4ce2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:49.880842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25333b-e3cf-4f17-9f86-0f877900ef1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:49.881615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25333b-e3cf-4f17-9f86-0f877900ef1e admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:49.882032 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25333b-e3cf-4f17-9f86-0f877900ef1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:49.882912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25333b-e3cf-4f17-9f86-0f877900ef1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:49.883804 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25333b-e3cf-4f17-9f86-0f877900ef1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:58:49.884262 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25333b-e3cf-4f17-9f86-0f877900ef1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:49.891156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25333b-e3cf-4f17-9f86-0f877900ef1e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:49.910981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1168/2336] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:58:49.914789 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee86e6-1551-4d46-95be-a29cc395b8c7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:49.927986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee86e6-1551-4d46-95be-a29cc395b8c7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:49.935454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc752e-cb1a-4b0d-8308-5bb5f193b6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:49.936351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc752e-cb1a-4b0d-8308-5bb5f193b6fc admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:49.939692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc752e-cb1a-4b0d-8308-5bb5f193b6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:49.940467 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc752e-cb1a-4b0d-8308-5bb5f193b6fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:49.941714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc752e-cb1a-4b0d-8308-5bb5f193b6fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:49.944744 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc752e-cb1a-4b0d-8308-5bb5f193b6fc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:49.987492 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1169/2337] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:58:49 2022] POST /identity/v3/projects => generated 353 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:58:49.993590 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25333b-e3cf-4f17-9f86-0f877900ef1e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:50.014085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25333b-e3cf-4f17-9f86-0f877900ef1e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:50.099216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f2ba9-0a84-4026-97b2-aa80ccf44a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:50.100011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2ba9-0a84-4026-97b2-aa80ccf44a3b admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:50.100360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2ba9-0a84-4026-97b2-aa80ccf44a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:50.100969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2ba9-0a84-4026-97b2-aa80ccf44a3b admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:50.101733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f2ba9-0a84-4026-97b2-aa80ccf44a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:50.104674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f2ba9-0a84-4026-97b2-aa80ccf44a3b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:50.159213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1169/2338] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:58:49 2022] POST /identity/v3/users => generated 277 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:58:50.163584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc752e-cb1a-4b0d-8308-5bb5f193b6fc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:50.182513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc752e-cb1a-4b0d-8308-5bb5f193b6fc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:50.193295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9da833-e021-4d75-9c8c-1a7bbb035258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:50.194120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da833-e021-4d75-9c8c-1a7bbb035258 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:50.195292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da833-e021-4d75-9c8c-1a7bbb035258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:50.195674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da833-e021-4d75-9c8c-1a7bbb035258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:50.196429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9da833-e021-4d75-9c8c-1a7bbb035258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:50.200567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9da833-e021-4d75-9c8c-1a7bbb035258 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:50.223351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1170/2339] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:58:50.225600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f2ba9-0a84-4026-97b2-aa80ccf44a3b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:50.237944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f2ba9-0a84-4026-97b2-aa80ccf44a3b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:50.244984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3b807-126e-423a-a67a-5c744db9081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:50.247011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3b807-126e-423a-a67a-5c744db9081f admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:50.247532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3b807-126e-423a-a67a-5c744db9081f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:50.248560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3b807-126e-423a-a67a-5c744db9081f admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:50.249445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3b807-126e-423a-a67a-5c744db9081f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:50.252682 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3b807-126e-423a-a67a-5c744db9081f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:50.272442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1170/2340] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:58:50.273076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9da833-e021-4d75-9c8c-1a7bbb035258 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:50.284909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9da833-e021-4d75-9c8c-1a7bbb035258 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:50.292479 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5747a-8adb-46d6-8515-597f4c3a8162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:50.293179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5747a-8adb-46d6-8515-597f4c3a8162 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:50.293518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5747a-8adb-46d6-8515-597f4c3a8162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:50.293801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5747a-8adb-46d6-8515-597f4c3a8162 admin admin] PATH_INFO: `/v3/projects/47cefe4aa13b4b498944c68a1077dbab/users/f437062279e34ae78f00f21a7a1898c9/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:50.315911 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5747a-8adb-46d6-8515-597f4c3a8162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cefe4aa13b4b498944c68a1077dbab, user_id=f437062279e34ae78f00f21a7a1898c9, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:50.319407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5747a-8adb-46d6-8515-597f4c3a8162 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:50.328280 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:50.338131 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1171/2341] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:58:50 2022] PUT /identity/v3/projects/47cefe4aa13b4b498944c68a1077dbab/users/f437062279e34ae78f00f21a7a1898c9/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:58:50.348583 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74607b67-b3ae-4abc-b69c-38524ed5a128 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:50.349135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74607b67-b3ae-4abc-b69c-38524ed5a128 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:50.349135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74607b67-b3ae-4abc-b69c-38524ed5a128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:50.384393 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-74607b67-b3ae-4abc-b69c-38524ed5a128 None None] MFA Rules not processed for user `f437062279e34ae78f00f21a7a1898c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:50.385550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-74607b67-b3ae-4abc-b69c-38524ed5a128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:50.396436 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:50.523299 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1171/2342] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:50.536221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5747a-8adb-46d6-8515-597f4c3a8162 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:50.538905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4ce5747a-8adb-46d6-8515-597f4c3a8162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:50.617766 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5747a-8adb-46d6-8515-597f4c3a8162 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:50.624347 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1817931-b7a2-4f15-8f89-ff6ea439059d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:50.626994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1817931-b7a2-4f15-8f89-ff6ea439059d service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:50.627430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1817931-b7a2-4f15-8f89-ff6ea439059d service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:50.627835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1817931-b7a2-4f15-8f89-ff6ea439059d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:50.645189 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1817931-b7a2-4f15-8f89-ff6ea439059d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:50.646832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1817931-b7a2-4f15-8f89-ff6ea439059d service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:50.660616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1172/2343] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:55.458440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74607b67-b3ae-4abc-b69c-38524ed5a128 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:55.552046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74607b67-b3ae-4abc-b69c-38524ed5a128 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:55.557526 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:55.558334 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:55.558711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:55.559124 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] PATH_INFO: `/v3/users/f437062279e34ae78f00f21a7a1898c9` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:55.560555 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f437062279e34ae78f00f21a7a1898c9)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:55.562803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:55.643996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f437062279e34ae78f00f21a7a1898c9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:55.644901 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f437062279e34ae78f00f21a7a1898c9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:55.657777 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f437062279e34ae78f00f21a7a1898c9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:55.671207 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f437062279e34ae78f00f21a7a1898c9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:55.691791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f437062279e34ae78f00f21a7a1898c9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:55.708626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a2393-48f3-4eaa-ade4-c3c2a95641ba None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:55.709168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a2393-48f3-4eaa-ade4-c3c2a95641ba None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:55.709705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a2393-48f3-4eaa-ade4-c3c2a95641ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:55.713147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1172/2344] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:58:55 2022] DELETE /identity/v3/users/f437062279e34ae78f00f21a7a1898c9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:55.738888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9f5a2393-48f3-4eaa-ade4-c3c2a95641ba None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:55.742930 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9f5a2393-48f3-4eaa-ade4-c3c2a95641ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:55.886230 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1173/2345] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:55.895537 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:55.897555 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:55.950971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:55.990254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392da0a-558a-4802-9b2e-54883e223ff1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:55.994508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb428b29-c1a1-47ff-814f-bb42abf6b333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:55.995307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb428b29-c1a1-47ff-814f-bb42abf6b333 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:55.995690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb428b29-c1a1-47ff-814f-bb42abf6b333 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:55.996066 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb428b29-c1a1-47ff-814f-bb42abf6b333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:56.011524 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb428b29-c1a1-47ff-814f-bb42abf6b333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:56.013198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb428b29-c1a1-47ff-814f-bb42abf6b333 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:56.027107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1173/2346] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:56.716702 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a2393-48f3-4eaa-ade4-c3c2a95641ba None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:56.718181 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9f5a2393-48f3-4eaa-ade4-c3c2a95641ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:56.739560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a2393-48f3-4eaa-ade4-c3c2a95641ba None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:56.748741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:56.750392 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:56.750959 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:56.751948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6 admin admin] PATH_INFO: `/v3/projects/47cefe4aa13b4b498944c68a1077dbab` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:56.753527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47cefe4aa13b4b498944c68a1077dbab)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:56.756754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:56.927152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47cefe4aa13b4b498944c68a1077dbab', 'request_id': 'req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:56.956849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47cefe4aa13b4b498944c68a1077dbab', 'request_id': 'req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:56.966799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47cefe4aa13b4b498944c68a1077dbab', 'request_id': 'req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:56.984934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6 admin admin] The token cache is being invalidate because project 47cefe4aa13b4b498944c68a1077dbab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:58:56.986066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:56.987053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab84ac28-e258-4665-8f21-9c0bc7b4feb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:58:56.989181 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1174/2347] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:58:56 2022] DELETE /identity/v3/projects/47cefe4aa13b4b498944c68a1077dbab => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:56.994432 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2223d13-e83c-49ae-a891-bfba08d4a591 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:56.995473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2223d13-e83c-49ae-a891-bfba08d4a591 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:56.995959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2223d13-e83c-49ae-a891-bfba08d4a591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:57.037259 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b2223d13-e83c-49ae-a891-bfba08d4a591 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:57.038811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b2223d13-e83c-49ae-a891-bfba08d4a591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:57.154829 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1174/2348] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:57.221303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d4aa1-2acf-48de-a19f-def63d105341 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:57.221596 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d4aa1-2acf-48de-a19f-def63d105341 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:57.222032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d4aa1-2acf-48de-a19f-def63d105341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:57.268144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-225d4aa1-2acf-48de-a19f-def63d105341 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:57.269444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-225d4aa1-2acf-48de-a19f-def63d105341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:57.292990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1175/2349] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:57.300887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2223d13-e83c-49ae-a891-bfba08d4a591 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:57.336201 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2223d13-e83c-49ae-a891-bfba08d4a591 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:57.369261 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c0f15-c4c3-4141-81f7-d6e5970eb40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:57.369899 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c0f15-c4c3-4141-81f7-d6e5970eb40c admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:57.370180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c0f15-c4c3-4141-81f7-d6e5970eb40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:57.370599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c0f15-c4c3-4141-81f7-d6e5970eb40c admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:57.371359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c0f15-c4c3-4141-81f7-d6e5970eb40c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:58:57.371668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c0f15-c4c3-4141-81f7-d6e5970eb40c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:57.376363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c0f15-c4c3-4141-81f7-d6e5970eb40c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:57.427871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1175/2350] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:58:57.438629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d4aa1-2acf-48de-a19f-def63d105341 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:57.451788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d4aa1-2acf-48de-a19f-def63d105341 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:57.458771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7aa487-d082-48d6-8a27-876e835ed0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:57.459253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7aa487-d082-48d6-8a27-876e835ed0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:57.459446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7aa487-d082-48d6-8a27-876e835ed0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:57.459607 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7aa487-d082-48d6-8a27-876e835ed0b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:57.461036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7aa487-d082-48d6-8a27-876e835ed0b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:57.463903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7aa487-d082-48d6-8a27-876e835ed0b7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:57.493547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:57.524966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1176/2351] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:58:57 2022] POST /identity/v3/projects => generated 391 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:58:57.526337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c0f15-c4c3-4141-81f7-d6e5970eb40c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:57.596193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c0f15-c4c3-4141-81f7-d6e5970eb40c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:57.689786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65703183-8d15-4f60-908e-97509bab58e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:57.690865 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65703183-8d15-4f60-908e-97509bab58e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:57.691627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65703183-8d15-4f60-908e-97509bab58e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:57.692247 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65703183-8d15-4f60-908e-97509bab58e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:57.693117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65703183-8d15-4f60-908e-97509bab58e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:57.695726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65703183-8d15-4f60-908e-97509bab58e3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:57.737560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1176/2352] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:58:57 2022] POST /identity/v3/users => generated 296 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:58:57.738622 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7aa487-d082-48d6-8a27-876e835ed0b7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:57.752600 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7aa487-d082-48d6-8a27-876e835ed0b7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:57.761446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5471c-45ae-4413-82e7-681e73c35cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:57.762519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5471c-45ae-4413-82e7-681e73c35cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:57.762878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5471c-45ae-4413-82e7-681e73c35cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:57.763151 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5471c-45ae-4413-82e7-681e73c35cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:57.764101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5471c-45ae-4413-82e7-681e73c35cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:57.765912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5471c-45ae-4413-82e7-681e73c35cf2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:57.779309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1177/2353] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:58:57.783407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65703183-8d15-4f60-908e-97509bab58e3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:57.794281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65703183-8d15-4f60-908e-97509bab58e3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:57.799236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19843d3a-00bd-4777-8c67-b33fab047815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:57.799937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19843d3a-00bd-4777-8c67-b33fab047815 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:57.800289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19843d3a-00bd-4777-8c67-b33fab047815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:57.800718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19843d3a-00bd-4777-8c67-b33fab047815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:57.801439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19843d3a-00bd-4777-8c67-b33fab047815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:57.804336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19843d3a-00bd-4777-8c67-b33fab047815 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:57.816660 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1177/2354] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:58:57.821837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5471c-45ae-4413-82e7-681e73c35cf2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:57.836669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5471c-45ae-4413-82e7-681e73c35cf2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:57.841849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc8f27-5e8c-40e6-91c6-8cfd03703249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:57.842720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc8f27-5e8c-40e6-91c6-8cfd03703249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:57.843231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc8f27-5e8c-40e6-91c6-8cfd03703249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:57.843955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc8f27-5e8c-40e6-91c6-8cfd03703249 admin admin] PATH_INFO: `/v3/projects/ddead0843ffd40379ec3d0b7a74f0d99/users/b8b67a8814914e029479315bbd3858a7/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:57.870462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc8f27-5e8c-40e6-91c6-8cfd03703249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddead0843ffd40379ec3d0b7a74f0d99, user_id=b8b67a8814914e029479315bbd3858a7, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:57.881353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc8f27-5e8c-40e6-91c6-8cfd03703249 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:57.903079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1178/2355] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:58:57 2022] PUT /identity/v3/projects/ddead0843ffd40379ec3d0b7a74f0d99/users/b8b67a8814914e029479315bbd3858a7/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:57.914332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a03d6c-581d-4719-9aff-0bbb527725b6 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:57.914797 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a03d6c-581d-4719-9aff-0bbb527725b6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:57.915113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a03d6c-581d-4719-9aff-0bbb527725b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:57.946477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-22a03d6c-581d-4719-9aff-0bbb527725b6 None None] MFA Rules not processed for user `b8b67a8814914e029479315bbd3858a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:57.947852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-22a03d6c-581d-4719-9aff-0bbb527725b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:57.985836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:58.056505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc8f27-5e8c-40e6-91c6-8cfd03703249 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:58.059020 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1178/2356] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:58.152918 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc8f27-5e8c-40e6-91c6-8cfd03703249 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:58.175725 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4544b-cf98-463b-9655-10237e9f4607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:58.176663 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4544b-cf98-463b-9655-10237e9f4607 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:58.176944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4544b-cf98-463b-9655-10237e9f4607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:58.177493 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4544b-cf98-463b-9655-10237e9f4607 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:58.178665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4544b-cf98-463b-9655-10237e9f4607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:58.181374 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4544b-cf98-463b-9655-10237e9f4607 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:58.230396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1179/2357] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:58:58 2022] POST /identity/v3/projects => generated 393 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:58:58.233794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a03d6c-581d-4719-9aff-0bbb527725b6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:58.254327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a03d6c-581d-4719-9aff-0bbb527725b6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:58.342025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8feef-3653-4c75-97b5-220d9a645719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:58.342705 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8feef-3653-4c75-97b5-220d9a645719 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:58.343009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8feef-3653-4c75-97b5-220d9a645719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:58.343388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8feef-3653-4c75-97b5-220d9a645719 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:58.344104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8feef-3653-4c75-97b5-220d9a645719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:58.346918 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8feef-3653-4c75-97b5-220d9a645719 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:58.383569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1179/2358] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:58:58 2022] POST /identity/v3/users => generated 303 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:58:58.387970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4544b-cf98-463b-9655-10237e9f4607 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:58.408899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4544b-cf98-463b-9655-10237e9f4607 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:58.416577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8985e4-1878-4bd6-8472-94ad8ade647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:58.417248 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8985e4-1878-4bd6-8472-94ad8ade647b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:58.417533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8985e4-1878-4bd6-8472-94ad8ade647b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:58.417805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8985e4-1878-4bd6-8472-94ad8ade647b admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:58.418454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8985e4-1878-4bd6-8472-94ad8ade647b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:58.427220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8985e4-1878-4bd6-8472-94ad8ade647b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:58.454807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1180/2359] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:58:58.458720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8feef-3653-4c75-97b5-220d9a645719 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:58.477144 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8feef-3653-4c75-97b5-220d9a645719 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:58.483687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa4759-4711-4575-aab6-85048d1a9f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:58.484370 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa4759-4711-4575-aab6-85048d1a9f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:58.484653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa4759-4711-4575-aab6-85048d1a9f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:58.484933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa4759-4711-4575-aab6-85048d1a9f12 admin admin] PATH_INFO: `/v3/projects/6aaeb41da2674ec5a031251292d57235/users/77982ca1f0d04b4fa6fae6af4fb7ef12/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:58.508264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa4759-4711-4575-aab6-85048d1a9f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aaeb41da2674ec5a031251292d57235, user_id=77982ca1f0d04b4fa6fae6af4fb7ef12, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:58.511053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa4759-4711-4575-aab6-85048d1a9f12 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:58.531370 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1180/2360] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:58:58 2022] PUT /identity/v3/projects/6aaeb41da2674ec5a031251292d57235/users/77982ca1f0d04b4fa6fae6af4fb7ef12/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:58.536052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8985e4-1878-4bd6-8472-94ad8ade647b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:58.550377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8985e4-1878-4bd6-8472-94ad8ade647b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:58.647465 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883e3dd-540d-4cf9-aa31-eb56f548bab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:58.648098 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883e3dd-540d-4cf9-aa31-eb56f548bab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:58.648534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883e3dd-540d-4cf9-aa31-eb56f548bab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:58.648935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883e3dd-540d-4cf9-aa31-eb56f548bab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:58.649592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883e3dd-540d-4cf9-aa31-eb56f548bab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:58.651405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883e3dd-540d-4cf9-aa31-eb56f548bab0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:58.668557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1181/2361] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:58:58.672866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa4759-4711-4575-aab6-85048d1a9f12 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:58.686836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa4759-4711-4575-aab6-85048d1a9f12 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:58.694438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bc5e1-1c8e-48c4-a48c-7732cc13d101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:58.695444 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bc5e1-1c8e-48c4-a48c-7732cc13d101 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:58.695829 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bc5e1-1c8e-48c4-a48c-7732cc13d101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:58.696202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bc5e1-1c8e-48c4-a48c-7732cc13d101 admin admin] PATH_INFO: `/v3/projects/6aaeb41da2674ec5a031251292d57235/users/77982ca1f0d04b4fa6fae6af4fb7ef12/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:58.698988 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bc5e1-1c8e-48c4-a48c-7732cc13d101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aaeb41da2674ec5a031251292d57235, user_id=77982ca1f0d04b4fa6fae6af4fb7ef12, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:58.701912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bc5e1-1c8e-48c4-a48c-7732cc13d101 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:58.729976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073be15-761b-4a87-b369-29a91b4c2ab0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:58.730407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073be15-761b-4a87-b369-29a91b4c2ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:58.730868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073be15-761b-4a87-b369-29a91b4c2ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:58.733836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1181/2362] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:58:58 2022] PUT /identity/v3/projects/6aaeb41da2674ec5a031251292d57235/users/77982ca1f0d04b4fa6fae6af4fb7ef12/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:58:58.771918 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2073be15-761b-4a87-b369-29a91b4c2ab0 None None] MFA Rules not processed for user `77982ca1f0d04b4fa6fae6af4fb7ef12`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:58.773279 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2073be15-761b-4a87-b369-29a91b4c2ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:58.800571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:58.889288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1182/2363] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:58:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:58.912838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bc5e1-1c8e-48c4-a48c-7732cc13d101 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:58.914768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d35bc5e1-1c8e-48c4-a48c-7732cc13d101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:59.030251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bc5e1-1c8e-48c4-a48c-7732cc13d101 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:59.037614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225ad33-43cc-49bc-9f89-5debba5f6167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:59.038608 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225ad33-43cc-49bc-9f89-5debba5f6167 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:59.038761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225ad33-43cc-49bc-9f89-5debba5f6167 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:59.039397 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225ad33-43cc-49bc-9f89-5debba5f6167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:59.067703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:59.162152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225ad33-43cc-49bc-9f89-5debba5f6167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:59.167029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225ad33-43cc-49bc-9f89-5debba5f6167 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:59.193455 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1182/2364] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:58:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:04.277984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073be15-761b-4a87-b369-29a91b4c2ab0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:04.280528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2073be15-761b-4a87-b369-29a91b4c2ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:04.438192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073be15-761b-4a87-b369-29a91b4c2ab0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:04.445838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:04.446592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:04.446989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:04.447353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] PATH_INFO: `/v3/users/48f4b8f00e304e618afbed37c9d952c3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:04.448727 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f4b8f00e304e618afbed37c9d952c3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:04.450845 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:04.531575 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f4b8f00e304e618afbed37c9d952c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:04.571990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f4b8f00e304e618afbed37c9d952c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:04.583407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f4b8f00e304e618afbed37c9d952c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:04.596825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f4b8f00e304e618afbed37c9d952c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:04.598201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f4b8f00e304e618afbed37c9d952c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:04.612922 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1183/2365] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:59:04 2022] DELETE /identity/v3/users/48f4b8f00e304e618afbed37c9d952c3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:04.614368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24391-8ab9-436b-8dfb-fbcef4334846 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:04.614902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24391-8ab9-436b-8dfb-fbcef4334846 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:04.614988 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24391-8ab9-436b-8dfb-fbcef4334846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:04.655942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-10b24391-8ab9-436b-8dfb-fbcef4334846 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:04.657323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-10b24391-8ab9-436b-8dfb-fbcef4334846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:04.809551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1183/2366] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:59:04.831849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:04.839016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:05.003891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:05.051193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf622-7b9f-4f5a-aedf-dff6ee57076a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:05.057386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa5204-e266-4fe6-9cff-a9e1c56ac8f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:05.058509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa5204-e266-4fe6-9cff-a9e1c56ac8f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:05.058821 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa5204-e266-4fe6-9cff-a9e1c56ac8f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:05.059095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa5204-e266-4fe6-9cff-a9e1c56ac8f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:05.078332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa5204-e266-4fe6-9cff-a9e1c56ac8f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:05.080512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa5204-e266-4fe6-9cff-a9e1c56ac8f5 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:05.100696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1184/2367] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:06.253191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b24391-8ab9-436b-8dfb-fbcef4334846 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:06.256884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-10b24391-8ab9-436b-8dfb-fbcef4334846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:06.275568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b24391-8ab9-436b-8dfb-fbcef4334846 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:06.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcd522-0324-4789-b4f4-cf9fb225b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:06.284128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcd522-0324-4789-b4f4-cf9fb225b347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:06.284585 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcd522-0324-4789-b4f4-cf9fb225b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:06.285134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcd522-0324-4789-b4f4-cf9fb225b347 admin admin] PATH_INFO: `/v3/projects/c32be9dbce3c46dfa4a08445f8295cb9` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:06.287098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcd522-0324-4789-b4f4-cf9fb225b347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c32be9dbce3c46dfa4a08445f8295cb9)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:06.290299 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcd522-0324-4789-b4f4-cf9fb225b347 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:06.418402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-eafcd522-0324-4789-b4f4-cf9fb225b347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c32be9dbce3c46dfa4a08445f8295cb9', 'request_id': 'req-eafcd522-0324-4789-b4f4-cf9fb225b347'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:06.429095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-eafcd522-0324-4789-b4f4-cf9fb225b347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c32be9dbce3c46dfa4a08445f8295cb9', 'request_id': 'req-eafcd522-0324-4789-b4f4-cf9fb225b347'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:06.442683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-eafcd522-0324-4789-b4f4-cf9fb225b347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c32be9dbce3c46dfa4a08445f8295cb9', 'request_id': 'req-eafcd522-0324-4789-b4f4-cf9fb225b347'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:06.458887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-eafcd522-0324-4789-b4f4-cf9fb225b347 admin admin] The token cache is being invalidate because project c32be9dbce3c46dfa4a08445f8295cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:59:06.459541 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-eafcd522-0324-4789-b4f4-cf9fb225b347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:06.460428 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-eafcd522-0324-4789-b4f4-cf9fb225b347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:06.465914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1184/2368] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:59:06 2022] DELETE /identity/v3/projects/c32be9dbce3c46dfa4a08445f8295cb9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:06.468051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d19522-1db7-468b-a236-869f50924d6b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:06.468519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d19522-1db7-468b-a236-869f50924d6b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:06.468772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d19522-1db7-468b-a236-869f50924d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:06.496119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d4d19522-1db7-468b-a236-869f50924d6b None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:06.497571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d4d19522-1db7-468b-a236-869f50924d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:06.588251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1185/2369] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:06.595609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c5c90-f28d-4e5a-a28a-89bfd6bb4481 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:06.596324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c5c90-f28d-4e5a-a28a-89bfd6bb4481 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:06.596324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c5c90-f28d-4e5a-a28a-89bfd6bb4481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:06.623778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b54c5c90-f28d-4e5a-a28a-89bfd6bb4481 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:06.625120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b54c5c90-f28d-4e5a-a28a-89bfd6bb4481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:06.639391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1185/2370] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:06.641862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d19522-1db7-468b-a236-869f50924d6b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:06.655443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d19522-1db7-468b-a236-869f50924d6b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:06.662177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895482-8d4a-40e0-b12e-cf101f9e8313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:06.662812 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895482-8d4a-40e0-b12e-cf101f9e8313 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:06.663205 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895482-8d4a-40e0-b12e-cf101f9e8313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:06.664462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895482-8d4a-40e0-b12e-cf101f9e8313 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:06.664695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf895482-8d4a-40e0-b12e-cf101f9e8313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:59:06.664913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf895482-8d4a-40e0-b12e-cf101f9e8313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:06.666691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf895482-8d4a-40e0-b12e-cf101f9e8313 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:06.687460 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1186/2371] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:59:06.690866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c5c90-f28d-4e5a-a28a-89bfd6bb4481 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:06.701690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c5c90-f28d-4e5a-a28a-89bfd6bb4481 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:06.708327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdff6c3-d176-4818-b0f5-878a69c8ead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:06.709145 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdff6c3-d176-4818-b0f5-878a69c8ead0 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:06.709425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdff6c3-d176-4818-b0f5-878a69c8ead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:06.709694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdff6c3-d176-4818-b0f5-878a69c8ead0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:06.710338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdff6c3-d176-4818-b0f5-878a69c8ead0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:06.712428 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdff6c3-d176-4818-b0f5-878a69c8ead0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:06.754172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1186/2372] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:59:06 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:59:06.756647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895482-8d4a-40e0-b12e-cf101f9e8313 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:06.779729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895482-8d4a-40e0-b12e-cf101f9e8313 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:06.875315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77386b-b820-4804-9d48-e2fcb013d0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:06.876787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77386b-b820-4804-9d48-e2fcb013d0ee admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:06.877260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77386b-b820-4804-9d48-e2fcb013d0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:06.877731 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77386b-b820-4804-9d48-e2fcb013d0ee admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:06.879444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77386b-b820-4804-9d48-e2fcb013d0ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:06.882224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77386b-b820-4804-9d48-e2fcb013d0ee admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:06.920273 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1187/2373] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:59:06 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:59:06.925497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdff6c3-d176-4818-b0f5-878a69c8ead0 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:06.940600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdff6c3-d176-4818-b0f5-878a69c8ead0 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:06.946159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeca7e5-8dc0-40a8-852c-4970c325e7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:06.947074 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeca7e5-8dc0-40a8-852c-4970c325e7db admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:06.947425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeca7e5-8dc0-40a8-852c-4970c325e7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:06.948001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeca7e5-8dc0-40a8-852c-4970c325e7db admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:06.948728 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeca7e5-8dc0-40a8-852c-4970c325e7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:06.950404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeca7e5-8dc0-40a8-852c-4970c325e7db admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:06.970045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:06.971533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77386b-b820-4804-9d48-e2fcb013d0ee admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:06.980373 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1187/2374] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:59:06.987641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77386b-b820-4804-9d48-e2fcb013d0ee admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:06.993404 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27466b-5cdf-476c-abe5-475e620d691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:06.994030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27466b-5cdf-476c-abe5-475e620d691f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:06.994577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27466b-5cdf-476c-abe5-475e620d691f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:06.994913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27466b-5cdf-476c-abe5-475e620d691f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:06.995573 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27466b-5cdf-476c-abe5-475e620d691f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:06.997338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27466b-5cdf-476c-abe5-475e620d691f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:07.015184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1188/2375] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:59:07.020243 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeca7e5-8dc0-40a8-852c-4970c325e7db admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:07.037122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeca7e5-8dc0-40a8-852c-4970c325e7db admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:07.044696 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce665c-c0c5-4679-9238-857790a6c14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:07.062515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce665c-c0c5-4679-9238-857790a6c14a admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:07.064851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce665c-c0c5-4679-9238-857790a6c14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:07.065224 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce665c-c0c5-4679-9238-857790a6c14a admin admin] PATH_INFO: `/v3/projects/8db14e2129424032b29f2424c2880bd6/users/9d26b3ab72ad41f0a28d7e025157401b/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:07.088237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce665c-c0c5-4679-9238-857790a6c14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db14e2129424032b29f2424c2880bd6, user_id=9d26b3ab72ad41f0a28d7e025157401b, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:07.092039 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce665c-c0c5-4679-9238-857790a6c14a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:07.134458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1188/2376] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:59:07 2022] PUT /identity/v3/projects/8db14e2129424032b29f2424c2880bd6/users/9d26b3ab72ad41f0a28d7e025157401b/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:07.146535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6125-b6cd-4bb0-8153-f245d37449f6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:07.148304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6125-b6cd-4bb0-8153-f245d37449f6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:07.148627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6125-b6cd-4bb0-8153-f245d37449f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:07.198034 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b03a6125-b6cd-4bb0-8153-f245d37449f6 None None] MFA Rules not processed for user `9d26b3ab72ad41f0a28d7e025157401b`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:07.199733 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b03a6125-b6cd-4bb0-8153-f245d37449f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:07.252644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:07.302765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1189/2377] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:07.332929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce665c-c0c5-4679-9238-857790a6c14a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:07.334882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-25ce665c-c0c5-4679-9238-857790a6c14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:07.429995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce665c-c0c5-4679-9238-857790a6c14a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:07.435845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3546832-edad-4069-8299-8aa57cdfa662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:07.436547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3546832-edad-4069-8299-8aa57cdfa662 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:07.436832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3546832-edad-4069-8299-8aa57cdfa662 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:07.437267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3546832-edad-4069-8299-8aa57cdfa662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:07.453079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3546832-edad-4069-8299-8aa57cdfa662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:07.455383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3546832-edad-4069-8299-8aa57cdfa662 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:07.483446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1189/2378] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:10.804024 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a6125-b6cd-4bb0-8153-f245d37449f6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:10.805801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b03a6125-b6cd-4bb0-8153-f245d37449f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:10.823488 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a6125-b6cd-4bb0-8153-f245d37449f6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:10.828554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d877ca7-08e9-4c4c-95db-2d9b065a1390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:10.829308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d877ca7-08e9-4c4c-95db-2d9b065a1390 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:10.829794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d877ca7-08e9-4c4c-95db-2d9b065a1390 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:10.830129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d877ca7-08e9-4c4c-95db-2d9b065a1390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:10.832174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0d877ca7-08e9-4c4c-95db-2d9b065a1390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:11.019164 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d877ca7-08e9-4c4c-95db-2d9b065a1390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:11.020771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d877ca7-08e9-4c4c-95db-2d9b065a1390 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:11.033552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1190/2379] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:17.463811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:19.087138 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3546832-edad-4069-8299-8aa57cdfa662 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:19.088884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e3546832-edad-4069-8299-8aa57cdfa662 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:19.222380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3546832-edad-4069-8299-8aa57cdfa662 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:19.229525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:19.230696 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:19.231210 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:19.231687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] PATH_INFO: `/v3/users/151edb585de746bfbab66d9f97372236` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:19.233494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=151edb585de746bfbab66d9f97372236)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:19.237578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:19.314949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151edb585de746bfbab66d9f97372236'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:19.316168 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151edb585de746bfbab66d9f97372236'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:19.329190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151edb585de746bfbab66d9f97372236'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:19.341135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151edb585de746bfbab66d9f97372236'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:19.364394 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151edb585de746bfbab66d9f97372236'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:19.374500 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1190/2380] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:59:19 2022] DELETE /identity/v3/users/151edb585de746bfbab66d9f97372236 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:19.380023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7c133-fc16-452d-8b30-73cd09815cd3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:19.381297 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7c133-fc16-452d-8b30-73cd09815cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:19.381913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7c133-fc16-452d-8b30-73cd09815cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:19.409040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-68c7c133-fc16-452d-8b30-73cd09815cd3 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:19.412446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-68c7c133-fc16-452d-8b30-73cd09815cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:19.615239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1191/2381] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:19.635489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:19.639938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:19.761174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a75cf-bcbf-40ff-b119-7fd72e3ad5bc admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:19.765489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf382f-1c84-4df4-b981-92cb725d77cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:19.767011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf382f-1c84-4df4-b981-92cb725d77cf service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:19.767369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf382f-1c84-4df4-b981-92cb725d77cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:19.767749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf382f-1c84-4df4-b981-92cb725d77cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:19.786234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf382f-1c84-4df4-b981-92cb725d77cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:19.789080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf382f-1c84-4df4-b981-92cb725d77cf service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:19.809813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1191/2382] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:20.500962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7c133-fc16-452d-8b30-73cd09815cd3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:20.502995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-68c7c133-fc16-452d-8b30-73cd09815cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:20.524157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7c133-fc16-452d-8b30-73cd09815cd3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:20.533985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999a73b-ae5c-40f0-aa96-03d27c8a7682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:20.534648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999a73b-ae5c-40f0-aa96-03d27c8a7682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:20.534974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999a73b-ae5c-40f0-aa96-03d27c8a7682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:20.535868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999a73b-ae5c-40f0-aa96-03d27c8a7682 admin admin] PATH_INFO: `/v3/projects/7da2649ceae940aa8d29156dce154539` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:20.537241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999a73b-ae5c-40f0-aa96-03d27c8a7682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da2649ceae940aa8d29156dce154539)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:20.540400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999a73b-ae5c-40f0-aa96-03d27c8a7682 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:20.618136 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b999a73b-ae5c-40f0-aa96-03d27c8a7682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da2649ceae940aa8d29156dce154539', 'request_id': 'req-b999a73b-ae5c-40f0-aa96-03d27c8a7682'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:20.629502 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b999a73b-ae5c-40f0-aa96-03d27c8a7682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da2649ceae940aa8d29156dce154539', 'request_id': 'req-b999a73b-ae5c-40f0-aa96-03d27c8a7682'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:20.645521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b999a73b-ae5c-40f0-aa96-03d27c8a7682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da2649ceae940aa8d29156dce154539', 'request_id': 'req-b999a73b-ae5c-40f0-aa96-03d27c8a7682'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:20.649207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:20.672104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b999a73b-ae5c-40f0-aa96-03d27c8a7682 admin admin] The token cache is being invalidate because project 7da2649ceae940aa8d29156dce154539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:59:20.673005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b999a73b-ae5c-40f0-aa96-03d27c8a7682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:20.679850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b999a73b-ae5c-40f0-aa96-03d27c8a7682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:20.695072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1192/2383] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:59:20 2022] DELETE /identity/v3/projects/7da2649ceae940aa8d29156dce154539 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:20.695229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45311c5c-312f-43e6-afe0-9cd8fecef4b8 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:20.695686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45311c5c-312f-43e6-afe0-9cd8fecef4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:20.695939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45311c5c-312f-43e6-afe0-9cd8fecef4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:20.736683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-45311c5c-312f-43e6-afe0-9cd8fecef4b8 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:20.737638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-45311c5c-312f-43e6-afe0-9cd8fecef4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:20.780581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:20.879208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1192/2384] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:20.881917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5f36b-bfe2-43dc-baa0-21506c633e16 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:20.882483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5f36b-bfe2-43dc-baa0-21506c633e16 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:20.882935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5f36b-bfe2-43dc-baa0-21506c633e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:20.910684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a1a5f36b-bfe2-43dc-baa0-21506c633e16 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:20.911947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a1a5f36b-bfe2-43dc-baa0-21506c633e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:20.931031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1193/2385] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:20.932132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45311c5c-312f-43e6-afe0-9cd8fecef4b8 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:20.947733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45311c5c-312f-43e6-afe0-9cd8fecef4b8 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:20.953889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe745-e7c6-43f2-9511-e41456bb7b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:20.954669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe745-e7c6-43f2-9511-e41456bb7b5a admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:20.955003 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe745-e7c6-43f2-9511-e41456bb7b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:20.955278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe745-e7c6-43f2-9511-e41456bb7b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:20.956090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe745-e7c6-43f2-9511-e41456bb7b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:59:20.956403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe745-e7c6-43f2-9511-e41456bb7b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:20.958020 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe745-e7c6-43f2-9511-e41456bb7b5a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:20.972332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1193/2386] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:59:20.977566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5f36b-bfe2-43dc-baa0-21506c633e16 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:20.995005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5f36b-bfe2-43dc-baa0-21506c633e16 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:21.005389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351800b9-0651-45a1-a79f-284f64e91008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:21.007157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351800b9-0651-45a1-a79f-284f64e91008 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:21.007544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351800b9-0651-45a1-a79f-284f64e91008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:21.007916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351800b9-0651-45a1-a79f-284f64e91008 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:21.008811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351800b9-0651-45a1-a79f-284f64e91008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:21.010992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351800b9-0651-45a1-a79f-284f64e91008 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:21.076276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1194/2387] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:59:20 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:59:21.085768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe745-e7c6-43f2-9511-e41456bb7b5a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:21.111743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe745-e7c6-43f2-9511-e41456bb7b5a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:21.225295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edec31e-36b6-428e-9c10-09357fdb487e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:21.225941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edec31e-36b6-428e-9c10-09357fdb487e admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:21.227420 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edec31e-36b6-428e-9c10-09357fdb487e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:21.227701 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edec31e-36b6-428e-9c10-09357fdb487e admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:21.229185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edec31e-36b6-428e-9c10-09357fdb487e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:21.232376 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edec31e-36b6-428e-9c10-09357fdb487e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:21.270493 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1194/2388] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:59:21 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:59:21.271702 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351800b9-0651-45a1-a79f-284f64e91008 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:21.284964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351800b9-0651-45a1-a79f-284f64e91008 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:21.290427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baa19b-7757-451b-86c1-cad6da517ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:21.291174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baa19b-7757-451b-86c1-cad6da517ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:21.291467 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baa19b-7757-451b-86c1-cad6da517ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:21.291635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baa19b-7757-451b-86c1-cad6da517ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:21.292453 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baa19b-7757-451b-86c1-cad6da517ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:21.294976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baa19b-7757-451b-86c1-cad6da517ee3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:21.307897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1195/2389] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:59:21.313221 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edec31e-36b6-428e-9c10-09357fdb487e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:21.326298 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edec31e-36b6-428e-9c10-09357fdb487e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:21.336379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266a775-b715-4b77-b4e8-ce06683e00cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:21.337380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266a775-b715-4b77-b4e8-ce06683e00cb admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:21.337738 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266a775-b715-4b77-b4e8-ce06683e00cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:21.338081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266a775-b715-4b77-b4e8-ce06683e00cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:21.338891 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266a775-b715-4b77-b4e8-ce06683e00cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:21.341632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266a775-b715-4b77-b4e8-ce06683e00cb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:21.363219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1195/2390] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:59:21.369106 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baa19b-7757-451b-86c1-cad6da517ee3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:21.386004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baa19b-7757-451b-86c1-cad6da517ee3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:21.397743 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d70cef-2dc3-4ad9-83b6-145b18d384a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:21.398656 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d70cef-2dc3-4ad9-83b6-145b18d384a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:21.399309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d70cef-2dc3-4ad9-83b6-145b18d384a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:21.399777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d70cef-2dc3-4ad9-83b6-145b18d384a5 admin admin] PATH_INFO: `/v3/projects/06a0e72179e3452ea830d7573037997a/users/728223d8a0d74e0ab940da6b043a0505/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:21.441881 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d70cef-2dc3-4ad9-83b6-145b18d384a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a0e72179e3452ea830d7573037997a, user_id=728223d8a0d74e0ab940da6b043a0505, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:21.444932 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d70cef-2dc3-4ad9-83b6-145b18d384a5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:21.474232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1196/2391] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:59:21 2022] PUT /identity/v3/projects/06a0e72179e3452ea830d7573037997a/users/728223d8a0d74e0ab940da6b043a0505/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:21.479553 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ca3d6-a072-418d-9fa8-03c3c64f3baa None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:21.479850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ca3d6-a072-418d-9fa8-03c3c64f3baa None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:21.480125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ca3d6-a072-418d-9fa8-03c3c64f3baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:21.533599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-766ca3d6-a072-418d-9fa8-03c3c64f3baa None None] MFA Rules not processed for user `728223d8a0d74e0ab940da6b043a0505`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:21.535665 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-766ca3d6-a072-418d-9fa8-03c3c64f3baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:21.566397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7c087-ca88-45e8-9726-6f2dfb456db6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:21.567233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7c087-ca88-45e8-9726-6f2dfb456db6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:21.567233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7c087-ca88-45e8-9726-6f2dfb456db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:21.622199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-55f7c087-ca88-45e8-9726-6f2dfb456db6 None None] MFA Rules not processed for user `b8b67a8814914e029479315bbd3858a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:21.623765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-55f7c087-ca88-45e8-9726-6f2dfb456db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:21.678545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1196/2392] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:21.786188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1197/2393] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:21.815993 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ca3d6-a072-418d-9fa8-03c3c64f3baa None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:21.818208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-766ca3d6-a072-418d-9fa8-03c3c64f3baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:21.868675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:21.933671 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ca3d6-a072-418d-9fa8-03c3c64f3baa None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:21.939986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce012e-5dd5-4160-a9d4-8c315f9ba493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:21.940924 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce012e-5dd5-4160-a9d4-8c315f9ba493 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:21.941794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce012e-5dd5-4160-a9d4-8c315f9ba493 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:21.942274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce012e-5dd5-4160-a9d4-8c315f9ba493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:21.955669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce012e-5dd5-4160-a9d4-8c315f9ba493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:21.959060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce012e-5dd5-4160-a9d4-8c315f9ba493 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:21.973989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1197/2394] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:23.110497 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7c087-ca88-45e8-9726-6f2dfb456db6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:23.112361 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-55f7c087-ca88-45e8-9726-6f2dfb456db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:23.132697 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7c087-ca88-45e8-9726-6f2dfb456db6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:23.144509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4240f-e04d-4906-aa7e-9ef08cd5762c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:23.145519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4240f-e04d-4906-aa7e-9ef08cd5762c service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:23.146044 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4240f-e04d-4906-aa7e-9ef08cd5762c service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:23.146549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4240f-e04d-4906-aa7e-9ef08cd5762c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:23.149658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-05b4240f-e04d-4906-aa7e-9ef08cd5762c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:23.172779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4240f-e04d-4906-aa7e-9ef08cd5762c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:23.182033 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4240f-e04d-4906-aa7e-9ef08cd5762c service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:23.205168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1198/2395] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:24.155449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce012e-5dd5-4160-a9d4-8c315f9ba493 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:24.157736 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e4ce012e-5dd5-4160-a9d4-8c315f9ba493 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:24.305218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce012e-5dd5-4160-a9d4-8c315f9ba493 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:24.319311 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ad15b-d2ae-48a3-95e2-53a8c0b6e7de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:24.319930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ad15b-d2ae-48a3-95e2-53a8c0b6e7de service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:24.321084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ad15b-d2ae-48a3-95e2-53a8c0b6e7de service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:24.321367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ad15b-d2ae-48a3-95e2-53a8c0b6e7de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:24.323783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e26ad15b-d2ae-48a3-95e2-53a8c0b6e7de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:24.351156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ad15b-d2ae-48a3-95e2-53a8c0b6e7de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:24.352764 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ad15b-d2ae-48a3-95e2-53a8c0b6e7de service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:24.372397 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1198/2396] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:27.989752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4240f-e04d-4906-aa7e-9ef08cd5762c service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:27.992028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-05b4240f-e04d-4906-aa7e-9ef08cd5762c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:28.108903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4240f-e04d-4906-aa7e-9ef08cd5762c service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:28.114633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:28.115519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:28.115802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:28.116074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] PATH_INFO: `/v3/users/9d26b3ab72ad41f0a28d7e025157401b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:28.117303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d26b3ab72ad41f0a28d7e025157401b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:28.119497 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:28.148336 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:28.204640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d26b3ab72ad41f0a28d7e025157401b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:28.222415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d26b3ab72ad41f0a28d7e025157401b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:28.237530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d26b3ab72ad41f0a28d7e025157401b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:28.254370 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d26b3ab72ad41f0a28d7e025157401b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:28.255461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d26b3ab72ad41f0a28d7e025157401b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:28.264999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1199/2397] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:59:27 2022] DELETE /identity/v3/users/9d26b3ab72ad41f0a28d7e025157401b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:28.270166 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6c948-57ec-42b9-9e44-cd8ac2b5ccef None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:28.271232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6c948-57ec-42b9-9e44-cd8ac2b5ccef None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:28.272541 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6c948-57ec-42b9-9e44-cd8ac2b5ccef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:28.297862 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-15a6c948-57ec-42b9-9e44-cd8ac2b5ccef None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:28.299731 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-15a6c948-57ec-42b9-9e44-cd8ac2b5ccef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:28.459450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1199/2398] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:28.479187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:28.480918 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:28.628005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e908f8-c894-4bff-83ac-c29c7b0a13c7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:28.633365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92ed88-62cb-4532-b091-60142dcc3df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:28.634179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92ed88-62cb-4532-b091-60142dcc3df7 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:28.634641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92ed88-62cb-4532-b091-60142dcc3df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:28.635076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92ed88-62cb-4532-b091-60142dcc3df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:28.653114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92ed88-62cb-4532-b091-60142dcc3df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:28.657537 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92ed88-62cb-4532-b091-60142dcc3df7 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:28.681567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1200/2399] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:29.762467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6c948-57ec-42b9-9e44-cd8ac2b5ccef None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:29.763998 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-15a6c948-57ec-42b9-9e44-cd8ac2b5ccef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:29.787887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6c948-57ec-42b9-9e44-cd8ac2b5ccef None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:29.795438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e4664-ffd3-4576-82dc-5c88116e0b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:29.796840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e4664-ffd3-4576-82dc-5c88116e0b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:29.802169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e4664-ffd3-4576-82dc-5c88116e0b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:29.802934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e4664-ffd3-4576-82dc-5c88116e0b38 admin admin] PATH_INFO: `/v3/projects/8db14e2129424032b29f2424c2880bd6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:29.806561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e4664-ffd3-4576-82dc-5c88116e0b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db14e2129424032b29f2424c2880bd6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:29.810200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e4664-ffd3-4576-82dc-5c88116e0b38 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:29.903127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:29.909962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5d5e4664-ffd3-4576-82dc-5c88116e0b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db14e2129424032b29f2424c2880bd6', 'request_id': 'req-5d5e4664-ffd3-4576-82dc-5c88116e0b38'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:29.920263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5d5e4664-ffd3-4576-82dc-5c88116e0b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db14e2129424032b29f2424c2880bd6', 'request_id': 'req-5d5e4664-ffd3-4576-82dc-5c88116e0b38'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:29.960123 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5d5e4664-ffd3-4576-82dc-5c88116e0b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db14e2129424032b29f2424c2880bd6', 'request_id': 'req-5d5e4664-ffd3-4576-82dc-5c88116e0b38'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:29.987640 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5d5e4664-ffd3-4576-82dc-5c88116e0b38 admin admin] The token cache is being invalidate because project 8db14e2129424032b29f2424c2880bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:59:29.989017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5d5e4664-ffd3-4576-82dc-5c88116e0b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:29.991996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5d5e4664-ffd3-4576-82dc-5c88116e0b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:29.996713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1200/2400] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:59:29 2022] DELETE /identity/v3/projects/8db14e2129424032b29f2424c2880bd6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:36.305067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92ed88-62cb-4532-b091-60142dcc3df7 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:36.306713 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-eb92ed88-62cb-4532-b091-60142dcc3df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:36.339685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92ed88-62cb-4532-b091-60142dcc3df7 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:36.499671 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:36.500549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:36.500918 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:36.501291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] PATH_INFO: `/v3/users/32343e6222da4aefa113308ded752126` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:36.503107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32343e6222da4aefa113308ded752126)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:36.505150 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:36.598500 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:36.602434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32343e6222da4aefa113308ded752126'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:36.633170 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32343e6222da4aefa113308ded752126'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:36.661565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32343e6222da4aefa113308ded752126'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:36.677171 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32343e6222da4aefa113308ded752126'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:36.678556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32343e6222da4aefa113308ded752126'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:36.696345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1201/2401] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:59:36 2022] DELETE /identity/v3/users/32343e6222da4aefa113308ded752126 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:36.697434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76871566-ccbc-4320-9024-22fd34d1e55d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:36.697929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76871566-ccbc-4320-9024-22fd34d1e55d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:36.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76871566-ccbc-4320-9024-22fd34d1e55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:36.740328 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-76871566-ccbc-4320-9024-22fd34d1e55d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:36.742675 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-76871566-ccbc-4320-9024-22fd34d1e55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:36.894650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1201/2402] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:59:36.930201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:36.931678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:37.104178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cda149-09f6-4ae7-88cb-3d3bf3bf2a44 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:37.113994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee52d5-d29f-42cf-9e05-771266c8b1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:37.114637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee52d5-d29f-42cf-9e05-771266c8b1da service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:37.115986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee52d5-d29f-42cf-9e05-771266c8b1da service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:37.116270 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee52d5-d29f-42cf-9e05-771266c8b1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:37.149929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee52d5-d29f-42cf-9e05-771266c8b1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:37.150550 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee52d5-d29f-42cf-9e05-771266c8b1da service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:37.177226 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1202/2403] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:38.283240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76871566-ccbc-4320-9024-22fd34d1e55d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:38.285449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-76871566-ccbc-4320-9024-22fd34d1e55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:38.309534 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76871566-ccbc-4320-9024-22fd34d1e55d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:38.318249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:38.319076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:38.319461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:38.319823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] PATH_INFO: `/v3/projects/ab815b9cd28c42319a3c068c9b5615fd` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:38.321223 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab815b9cd28c42319a3c068c9b5615fd)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:38.326100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:38.459670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab815b9cd28c42319a3c068c9b5615fd', 'request_id': 'req-711c50df-daad-4ae6-b8eb-ceb70f1072d9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:38.469550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab815b9cd28c42319a3c068c9b5615fd', 'request_id': 'req-711c50df-daad-4ae6-b8eb-ceb70f1072d9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:38.476400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab815b9cd28c42319a3c068c9b5615fd', 'request_id': 'req-711c50df-daad-4ae6-b8eb-ceb70f1072d9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:38.495546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] The token cache is being invalidate because project ab815b9cd28c42319a3c068c9b5615fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:59:38.496875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:38.498113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:38.500819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1202/2404] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:59:38 2022] DELETE /identity/v3/projects/ab815b9cd28c42319a3c068c9b5615fd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:38.504846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee52d5-d29f-42cf-9e05-771266c8b1da service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:38.514992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee52d5-d29f-42cf-9e05-771266c8b1da service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:38.588942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:38.590202 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:38.590583 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:38.591158 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] PATH_INFO: `/v3/users/4c382fbd9b5b4394a9a58785c2560c39` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:38.592415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c382fbd9b5b4394a9a58785c2560c39)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:38.595841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:38.700174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c382fbd9b5b4394a9a58785c2560c39'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:38.718043 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c382fbd9b5b4394a9a58785c2560c39'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:38.720477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:38.731933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c382fbd9b5b4394a9a58785c2560c39'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:38.752218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c382fbd9b5b4394a9a58785c2560c39'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:38.752925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c382fbd9b5b4394a9a58785c2560c39'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:38.761645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1203/2405] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:59:38 2022] DELETE /identity/v3/users/4c382fbd9b5b4394a9a58785c2560c39 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:39.611137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:39.613299 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:39.639660 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c50df-daad-4ae6-b8eb-ceb70f1072d9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:39.651752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:39.654027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:39.751116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:39.759994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5231ef5-753e-49db-b27f-7335428ba5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:39.761873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5231ef5-753e-49db-b27f-7335428ba5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:39.762785 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5231ef5-753e-49db-b27f-7335428ba5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:39.763325 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5231ef5-753e-49db-b27f-7335428ba5dd admin admin] PATH_INFO: `/v3/projects/2b078eb8ee454140abdaadf874b847f7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:39.764985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5231ef5-753e-49db-b27f-7335428ba5dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b078eb8ee454140abdaadf874b847f7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:39.768076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5231ef5-753e-49db-b27f-7335428ba5dd admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:39.819749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f74e07-e343-43a9-a9c2-d90f4cd27ea8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:39.827557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9056d-624b-405d-9461-2cf48c644978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:39.827557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9056d-624b-405d-9461-2cf48c644978 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:39.827557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9056d-624b-405d-9461-2cf48c644978 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:39.828052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9056d-624b-405d-9461-2cf48c644978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:39.830651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a5c9056d-624b-405d-9461-2cf48c644978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:39.865662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9056d-624b-405d-9461-2cf48c644978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:39.867664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9056d-624b-405d-9461-2cf48c644978 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:39.883128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b5231ef5-753e-49db-b27f-7335428ba5dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b078eb8ee454140abdaadf874b847f7', 'request_id': 'req-b5231ef5-753e-49db-b27f-7335428ba5dd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:39.888630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1204/2406] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:39.889558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9056d-624b-405d-9461-2cf48c644978 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:39.893881 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a5c9056d-624b-405d-9461-2cf48c644978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:39.902946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b5231ef5-753e-49db-b27f-7335428ba5dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b078eb8ee454140abdaadf874b847f7', 'request_id': 'req-b5231ef5-753e-49db-b27f-7335428ba5dd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:39.911335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9056d-624b-405d-9461-2cf48c644978 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:39.920289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b5231ef5-753e-49db-b27f-7335428ba5dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b078eb8ee454140abdaadf874b847f7', 'request_id': 'req-b5231ef5-753e-49db-b27f-7335428ba5dd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:39.944923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b5231ef5-753e-49db-b27f-7335428ba5dd admin admin] The token cache is being invalidate because project 2b078eb8ee454140abdaadf874b847f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:59:39.945299 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b5231ef5-753e-49db-b27f-7335428ba5dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:39.945981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b5231ef5-753e-49db-b27f-7335428ba5dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:39.951565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1203/2407] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:59:39 2022] DELETE /identity/v3/projects/2b078eb8ee454140abdaadf874b847f7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:39.963901 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881daa47-8a6d-4a40-ace3-2d1e3988a49e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:39.964843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881daa47-8a6d-4a40-ace3-2d1e3988a49e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:39.965370 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881daa47-8a6d-4a40-ace3-2d1e3988a49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:40.015986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-881daa47-8a6d-4a40-ace3-2d1e3988a49e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:40.018665 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-881daa47-8a6d-4a40-ace3-2d1e3988a49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:40.039595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0334b4-9d40-46ad-8185-628d8cbddcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:40.040247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0334b4-9d40-46ad-8185-628d8cbddcbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:40.040518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0334b4-9d40-46ad-8185-628d8cbddcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:40.040948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0334b4-9d40-46ad-8185-628d8cbddcbc admin admin] PATH_INFO: `/v3/users/0c14ce9bfb31412fa2220a5e8520ffc8` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:40.042705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0334b4-9d40-46ad-8185-628d8cbddcbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c14ce9bfb31412fa2220a5e8520ffc8)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:40.053364 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0334b4-9d40-46ad-8185-628d8cbddcbc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:40.135478 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1204/2408] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:40.143937 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f5f71-c23b-4527-ad59-49216072d1e1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:40.144233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f5f71-c23b-4527-ad59-49216072d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:40.144514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f5f71-c23b-4527-ad59-49216072d1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:40.192098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-036f5f71-c23b-4527-ad59-49216072d1e1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:40.193385 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-036f5f71-c23b-4527-ad59-49216072d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:40.205964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7c0334b4-9d40-46ad-8185-628d8cbddcbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c14ce9bfb31412fa2220a5e8520ffc8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:40.218588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1205/2409] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:40.222570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f5f71-c23b-4527-ad59-49216072d1e1 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:40.230449 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7c0334b4-9d40-46ad-8185-628d8cbddcbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c14ce9bfb31412fa2220a5e8520ffc8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:40.244176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f5f71-c23b-4527-ad59-49216072d1e1 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:40.247516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:INSERT=1,keystone:DELETE=10 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:40.253261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7c0334b4-9d40-46ad-8185-628d8cbddcbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c14ce9bfb31412fa2220a5e8520ffc8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:40.255423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf2eb4-4fa5-4838-9e88-e559f83dcfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:40.256063 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf2eb4-4fa5-4838-9e88-e559f83dcfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:40.256380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf2eb4-4fa5-4838-9e88-e559f83dcfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:40.256655 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf2eb4-4fa5-4838-9e88-e559f83dcfb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:40.257390 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf2eb4-4fa5-4838-9e88-e559f83dcfb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:59:40.257700 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf2eb4-4fa5-4838-9e88-e559f83dcfb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:40.259363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf2eb4-4fa5-4838-9e88-e559f83dcfb7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:40.269718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7c0334b4-9d40-46ad-8185-628d8cbddcbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c14ce9bfb31412fa2220a5e8520ffc8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:40.270684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7c0334b4-9d40-46ad-8185-628d8cbddcbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c14ce9bfb31412fa2220a5e8520ffc8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:40.298244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1206/2411] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:59:40.302200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf2eb4-4fa5-4838-9e88-e559f83dcfb7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:40.302200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d1cf2eb4-4fa5-4838-9e88-e559f83dcfb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:40.302786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1205/2411] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:59:39 2022] DELETE /identity/v3/users/0c14ce9bfb31412fa2220a5e8520ffc8 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:40.306118 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda977e5-087d-4539-b205-7225bd13e30c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:40.306629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda977e5-087d-4539-b205-7225bd13e30c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:40.307053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda977e5-087d-4539-b205-7225bd13e30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:40.321776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf2eb4-4fa5-4838-9e88-e559f83dcfb7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:40.369981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cda977e5-087d-4539-b205-7225bd13e30c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:40.372016 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cda977e5-087d-4539-b205-7225bd13e30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:40.495035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f6061-729c-4148-971a-c0942defd9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:40.495886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f6061-729c-4148-971a-c0942defd9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:40.496234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f6061-729c-4148-971a-c0942defd9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:40.496591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f6061-729c-4148-971a-c0942defd9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:40.498155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f6061-729c-4148-971a-c0942defd9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:40.500679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f6061-729c-4148-971a-c0942defd9e6 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:40.524200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:40.559945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1207/2412] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:59:40 2022] POST /identity/v3/projects => generated 373 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:59:40.560992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f6061-729c-4148-971a-c0942defd9e6 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:40.570647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1206/2413] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:40.629183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda977e5-087d-4539-b205-7225bd13e30c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:40.631406 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cda977e5-087d-4539-b205-7225bd13e30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:40.677167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f6061-729c-4148-971a-c0942defd9e6 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:40.689300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bce9b8-ce04-40a5-9621-f5ab2e754c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:40.689936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bce9b8-ce04-40a5-9621-f5ab2e754c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:40.690216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bce9b8-ce04-40a5-9621-f5ab2e754c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:40.690497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bce9b8-ce04-40a5-9621-f5ab2e754c2c admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:40.691175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bce9b8-ce04-40a5-9621-f5ab2e754c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:40.700835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bce9b8-ce04-40a5-9621-f5ab2e754c2c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:40.736690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda977e5-087d-4539-b205-7225bd13e30c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:40.748806 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1208/2414] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:59:40 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:59:40.753196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bce9b8-ce04-40a5-9621-f5ab2e754c2c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:40.769578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bce9b8-ce04-40a5-9621-f5ab2e754c2c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:40.775809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9820b7-2f4c-4210-807c-40b7cb9d73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:40.776691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9820b7-2f4c-4210-807c-40b7cb9d73da admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:40.777191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9820b7-2f4c-4210-807c-40b7cb9d73da admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:40.777707 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9820b7-2f4c-4210-807c-40b7cb9d73da admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:40.778742 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9820b7-2f4c-4210-807c-40b7cb9d73da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:40.780728 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9820b7-2f4c-4210-807c-40b7cb9d73da admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:40.793782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1209/2415] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:59:40.797957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9820b7-2f4c-4210-807c-40b7cb9d73da admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:40.812065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9820b7-2f4c-4210-807c-40b7cb9d73da admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:40.819574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf361a-25b2-415a-88ca-824505407c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:40.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf361a-25b2-415a-88ca-824505407c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:40.821202 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf361a-25b2-415a-88ca-824505407c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:40.821618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf361a-25b2-415a-88ca-824505407c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:40.822834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf361a-25b2-415a-88ca-824505407c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:40.824823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf361a-25b2-415a-88ca-824505407c6a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:40.827590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43756daf-2e8e-40b3-9982-6c6973df4366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:40.828251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43756daf-2e8e-40b3-9982-6c6973df4366 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:40.829380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43756daf-2e8e-40b3-9982-6c6973df4366 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:40.829657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43756daf-2e8e-40b3-9982-6c6973df4366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:40.843649 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43756daf-2e8e-40b3-9982-6c6973df4366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:40.846563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43756daf-2e8e-40b3-9982-6c6973df4366 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:40.856945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1210/2416] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:59:40.860099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf361a-25b2-415a-88ca-824505407c6a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:40.872753 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1207/2417] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:40.888138 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf361a-25b2-415a-88ca-824505407c6a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:40.901738 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8759aef-47f3-4ced-8994-1ff0506c0726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:40.902425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8759aef-47f3-4ced-8994-1ff0506c0726 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:40.902698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8759aef-47f3-4ced-8994-1ff0506c0726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:40.902995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8759aef-47f3-4ced-8994-1ff0506c0726 admin admin] PATH_INFO: `/v3/projects/bef84e6d6ea14c248d631b32a2a76425/users/bd042996881e47848960151aa8992d07/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:40.939088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8759aef-47f3-4ced-8994-1ff0506c0726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef84e6d6ea14c248d631b32a2a76425, user_id=bd042996881e47848960151aa8992d07, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:40.942559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8759aef-47f3-4ced-8994-1ff0506c0726 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:40.961625 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1211/2418] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:59:40 2022] PUT /identity/v3/projects/bef84e6d6ea14c248d631b32a2a76425/users/bd042996881e47848960151aa8992d07/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:40.975308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0c135-a14b-439e-bf21-fad4f0c3289f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:40.975597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0c135-a14b-439e-bf21-fad4f0c3289f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:40.975853 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0c135-a14b-439e-bf21-fad4f0c3289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:41.006983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-55b0c135-a14b-439e-bf21-fad4f0c3289f None None] MFA Rules not processed for user `bd042996881e47848960151aa8992d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:41.008473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-55b0c135-a14b-439e-bf21-fad4f0c3289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:41.053251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:41.103215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1208/2419] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:41.103869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8759aef-47f3-4ced-8994-1ff0506c0726 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:41.105805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d8759aef-47f3-4ced-8994-1ff0506c0726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:41.115770 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0c135-a14b-439e-bf21-fad4f0c3289f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:41.237431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8759aef-47f3-4ced-8994-1ff0506c0726 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:41.238916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0c135-a14b-439e-bf21-fad4f0c3289f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:41.243254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36231a-3066-4927-a6f5-79dfd985e991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:41.243930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b536537-e85c-4cde-9f28-f837738f0d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:41.244311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36231a-3066-4927-a6f5-79dfd985e991 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:41.244570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536537-e85c-4cde-9f28-f837738f0d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:41.244989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36231a-3066-4927-a6f5-79dfd985e991 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:41.245122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536537-e85c-4cde-9f28-f837738f0d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:41.245287 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536537-e85c-4cde-9f28-f837738f0d2d admin admin] PATH_INFO: `/v3/projects/dab6d1f8c6834031b111f9bc1fc69d34` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:41.245730 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36231a-3066-4927-a6f5-79dfd985e991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:41.246674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b536537-e85c-4cde-9f28-f837738f0d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab6d1f8c6834031b111f9bc1fc69d34)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:41.248960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b536537-e85c-4cde-9f28-f837738f0d2d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:41.260323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36231a-3066-4927-a6f5-79dfd985e991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:41.262210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36231a-3066-4927-a6f5-79dfd985e991 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:41.282325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1209/2420] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:59:41.327129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=5,keystone:SELECT=92,keystone:DELETE=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:41.336424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0b536537-e85c-4cde-9f28-f837738f0d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab6d1f8c6834031b111f9bc1fc69d34', 'request_id': 'req-0b536537-e85c-4cde-9f28-f837738f0d2d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:41.343807 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0b536537-e85c-4cde-9f28-f837738f0d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab6d1f8c6834031b111f9bc1fc69d34', 'request_id': 'req-0b536537-e85c-4cde-9f28-f837738f0d2d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:41.351939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0b536537-e85c-4cde-9f28-f837738f0d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab6d1f8c6834031b111f9bc1fc69d34', 'request_id': 'req-0b536537-e85c-4cde-9f28-f837738f0d2d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:41.368636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0b536537-e85c-4cde-9f28-f837738f0d2d admin admin] The token cache is being invalidate because project dab6d1f8c6834031b111f9bc1fc69d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:59:41.372820 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0b536537-e85c-4cde-9f28-f837738f0d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:41.373863 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0b536537-e85c-4cde-9f28-f837738f0d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:41.377112 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1212/2421] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:59:41 2022] DELETE /identity/v3/projects/dab6d1f8c6834031b111f9bc1fc69d34 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:42.096260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36231a-3066-4927-a6f5-79dfd985e991 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:42.112668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36231a-3066-4927-a6f5-79dfd985e991 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:42.220186 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:42.220990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:42.221265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:42.221530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] PATH_INFO: `/v3/users/bd042996881e47848960151aa8992d07` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:42.222686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd042996881e47848960151aa8992d07)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:42.225002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:42.315169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd042996881e47848960151aa8992d07'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:42.352845 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd042996881e47848960151aa8992d07'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:42.361573 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd042996881e47848960151aa8992d07'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:42.372789 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd042996881e47848960151aa8992d07'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:42.374612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd042996881e47848960151aa8992d07'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:42.376777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:42.385626 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1210/2422] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:59:42 2022] DELETE /identity/v3/users/bd042996881e47848960151aa8992d07 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:42.392430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf52e5e-3e5f-4039-8fff-56b60eb1d194 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:42.392998 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf52e5e-3e5f-4039-8fff-56b60eb1d194 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:42.394617 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf52e5e-3e5f-4039-8fff-56b60eb1d194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:42.426642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-faf52e5e-3e5f-4039-8fff-56b60eb1d194 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:42.428487 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-faf52e5e-3e5f-4039-8fff-56b60eb1d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:42.494620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1213/2423] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:59:42.505642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:42.510524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:42.579639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969ee16-0349-4087-b8f0-549135889b10 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:42.586115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8031db1-eede-4530-9eca-ad3967886795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:42.587308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8031db1-eede-4530-9eca-ad3967886795 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:42.588090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8031db1-eede-4530-9eca-ad3967886795 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:42.588586 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8031db1-eede-4530-9eca-ad3967886795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:42.601767 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8031db1-eede-4530-9eca-ad3967886795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:42.603419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8031db1-eede-4530-9eca-ad3967886795 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:42.615604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1211/2424] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:43.041184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf52e5e-3e5f-4039-8fff-56b60eb1d194 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:43.052909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-faf52e5e-3e5f-4039-8fff-56b60eb1d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:43.114905 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf52e5e-3e5f-4039-8fff-56b60eb1d194 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:43.145460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708e8e8-86b5-46f7-980b-6c0772394218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:43.147319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708e8e8-86b5-46f7-980b-6c0772394218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:43.148934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708e8e8-86b5-46f7-980b-6c0772394218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:43.149209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708e8e8-86b5-46f7-980b-6c0772394218 admin admin] PATH_INFO: `/v3/projects/bef84e6d6ea14c248d631b32a2a76425` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:43.155750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708e8e8-86b5-46f7-980b-6c0772394218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef84e6d6ea14c248d631b32a2a76425)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:43.162481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708e8e8-86b5-46f7-980b-6c0772394218 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:43.255964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b708e8e8-86b5-46f7-980b-6c0772394218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef84e6d6ea14c248d631b32a2a76425', 'request_id': 'req-b708e8e8-86b5-46f7-980b-6c0772394218'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:43.264741 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b708e8e8-86b5-46f7-980b-6c0772394218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef84e6d6ea14c248d631b32a2a76425', 'request_id': 'req-b708e8e8-86b5-46f7-980b-6c0772394218'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:43.275046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b708e8e8-86b5-46f7-980b-6c0772394218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef84e6d6ea14c248d631b32a2a76425', 'request_id': 'req-b708e8e8-86b5-46f7-980b-6c0772394218'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:43.308811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b708e8e8-86b5-46f7-980b-6c0772394218 admin admin] The token cache is being invalidate because project bef84e6d6ea14c248d631b32a2a76425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:59:43.310421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b708e8e8-86b5-46f7-980b-6c0772394218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:43.311783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b708e8e8-86b5-46f7-980b-6c0772394218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:43.315835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1214/2425] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:59:43 2022] DELETE /identity/v3/projects/bef84e6d6ea14c248d631b32a2a76425 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:43.321762 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60fc2d-f67a-4409-a805-40304775a409 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:43.322711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60fc2d-f67a-4409-a805-40304775a409 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:43.323209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60fc2d-f67a-4409-a805-40304775a409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:43.378283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4f60fc2d-f67a-4409-a805-40304775a409 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:43.379910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4f60fc2d-f67a-4409-a805-40304775a409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:43.504187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1212/2426] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:43.512723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eceb0e-262d-4e93-9ca6-8ab9c0098fe0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:43.513612 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eceb0e-262d-4e93-9ca6-8ab9c0098fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:43.514153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eceb0e-262d-4e93-9ca6-8ab9c0098fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:43.540614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-62eceb0e-262d-4e93-9ca6-8ab9c0098fe0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:43.542269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-62eceb0e-262d-4e93-9ca6-8ab9c0098fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:43.552898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1215/2427] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:43.557553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60fc2d-f67a-4409-a805-40304775a409 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:43.591921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60fc2d-f67a-4409-a805-40304775a409 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:43.611004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb5e9-36e5-4219-8ed3-9137d03af8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:43.611783 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb5e9-36e5-4219-8ed3-9137d03af8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:43.612065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb5e9-36e5-4219-8ed3-9137d03af8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:43.612330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb5e9-36e5-4219-8ed3-9137d03af8c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:43.613042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bb5e9-36e5-4219-8ed3-9137d03af8c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:59:43.613343 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bb5e9-36e5-4219-8ed3-9137d03af8c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:43.615243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bb5e9-36e5-4219-8ed3-9137d03af8c3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:43.633491 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1213/2428] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:59:43.637795 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eceb0e-262d-4e93-9ca6-8ab9c0098fe0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:43.650772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eceb0e-262d-4e93-9ca6-8ab9c0098fe0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:43.663009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c524c-73c8-4528-b3d5-ba6c52f2d91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:43.664090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c524c-73c8-4528-b3d5-ba6c52f2d91b admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:43.664090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c524c-73c8-4528-b3d5-ba6c52f2d91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:43.664251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c524c-73c8-4528-b3d5-ba6c52f2d91b admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:43.665461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c524c-73c8-4528-b3d5-ba6c52f2d91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:43.671628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c524c-73c8-4528-b3d5-ba6c52f2d91b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:43.712727 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1216/2429] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:59:43 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:59:43.717094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb5e9-36e5-4219-8ed3-9137d03af8c3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:43.732026 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb5e9-36e5-4219-8ed3-9137d03af8c3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:43.830095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63564d3f-cf0e-4311-b575-34a5b7f7346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:43.831107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63564d3f-cf0e-4311-b575-34a5b7f7346b admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:43.831231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63564d3f-cf0e-4311-b575-34a5b7f7346b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:43.831468 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63564d3f-cf0e-4311-b575-34a5b7f7346b admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:43.832174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63564d3f-cf0e-4311-b575-34a5b7f7346b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:43.835209 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63564d3f-cf0e-4311-b575-34a5b7f7346b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:43.870145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1214/2430] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:59:43 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:59:43.873478 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c524c-73c8-4528-b3d5-ba6c52f2d91b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:43.888600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c524c-73c8-4528-b3d5-ba6c52f2d91b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:43.897317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d7a26-15fa-477a-a3b5-b830042f28dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:43.899694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d7a26-15fa-477a-a3b5-b830042f28dc admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:43.900165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d7a26-15fa-477a-a3b5-b830042f28dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:43.900502 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d7a26-15fa-477a-a3b5-b830042f28dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:43.901267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d7a26-15fa-477a-a3b5-b830042f28dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:43.903501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d7a26-15fa-477a-a3b5-b830042f28dc admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:43.927591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1217/2431] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:59:43.931377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63564d3f-cf0e-4311-b575-34a5b7f7346b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:43.948315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63564d3f-cf0e-4311-b575-34a5b7f7346b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:43.956463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657d394-aa42-4fdb-a334-1623c02a8968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:43.957082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657d394-aa42-4fdb-a334-1623c02a8968 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:43.957365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657d394-aa42-4fdb-a334-1623c02a8968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:43.957771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657d394-aa42-4fdb-a334-1623c02a8968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:43.959360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657d394-aa42-4fdb-a334-1623c02a8968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:43.961651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657d394-aa42-4fdb-a334-1623c02a8968 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:43.981726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1215/2432] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:59:43.987897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d7a26-15fa-477a-a3b5-b830042f28dc admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:44.009521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d7a26-15fa-477a-a3b5-b830042f28dc admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:44.021688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4dd5d-5908-41c7-9ef8-0635570da884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:44.022562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4dd5d-5908-41c7-9ef8-0635570da884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:44.022867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4dd5d-5908-41c7-9ef8-0635570da884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:44.023138 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4dd5d-5908-41c7-9ef8-0635570da884 admin admin] PATH_INFO: `/v3/projects/08801c1d3e014f3b83c58917493fbd12/users/2d1c6efefcd647f2b2110059a897c427/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:44.040513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:44.062945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4dd5d-5908-41c7-9ef8-0635570da884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08801c1d3e014f3b83c58917493fbd12, user_id=2d1c6efefcd647f2b2110059a897c427, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:44.067903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4dd5d-5908-41c7-9ef8-0635570da884 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:44.101068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1218/2433] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:59:43 2022] PUT /identity/v3/projects/08801c1d3e014f3b83c58917493fbd12/users/2d1c6efefcd647f2b2110059a897c427/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:44.115476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd482aad-7e63-4f22-acf4-54b17967ace0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:44.116339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd482aad-7e63-4f22-acf4-54b17967ace0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:44.116631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd482aad-7e63-4f22-acf4-54b17967ace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:44.133386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:44.156089 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bd482aad-7e63-4f22-acf4-54b17967ace0 None None] MFA Rules not processed for user `2d1c6efefcd647f2b2110059a897c427`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:44.157687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bd482aad-7e63-4f22-acf4-54b17967ace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:44.260270 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1216/2434] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:44.279655 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4dd5d-5908-41c7-9ef8-0635570da884 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:44.283298 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-29a4dd5d-5908-41c7-9ef8-0635570da884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:44.451215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4dd5d-5908-41c7-9ef8-0635570da884 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:44.461469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577c61f-e7fd-4665-b49c-a080286eb880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:44.462125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577c61f-e7fd-4665-b49c-a080286eb880 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:44.462411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577c61f-e7fd-4665-b49c-a080286eb880 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:44.462672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577c61f-e7fd-4665-b49c-a080286eb880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:44.485472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577c61f-e7fd-4665-b49c-a080286eb880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:44.488460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577c61f-e7fd-4665-b49c-a080286eb880 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:44.503430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1219/2435] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:54.257071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=29 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:54.496011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:54.825678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd482aad-7e63-4f22-acf4-54b17967ace0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:54.830216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bd482aad-7e63-4f22-acf4-54b17967ace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:55.010605 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd482aad-7e63-4f22-acf4-54b17967ace0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:55.020653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:55.021794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:55.022630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:55.023236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] PATH_INFO: `/v3/users/728223d8a0d74e0ab940da6b043a0505` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:55.024819 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] RBAC: Authorizing `identity:delete_user(user_id=728223d8a0d74e0ab940da6b043a0505)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:55.034408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:55.124339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728223d8a0d74e0ab940da6b043a0505'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:55.146675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728223d8a0d74e0ab940da6b043a0505'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:55.155947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728223d8a0d74e0ab940da6b043a0505'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:55.167332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728223d8a0d74e0ab940da6b043a0505'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:55.168447 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728223d8a0d74e0ab940da6b043a0505'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:55.185017 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1217/2436] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 00:59:54 2022] DELETE /identity/v3/users/728223d8a0d74e0ab940da6b043a0505 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:55.186944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e5929-eb19-435c-82b4-96eeac8c470a None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:55.187349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e5929-eb19-435c-82b4-96eeac8c470a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:55.188318 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e5929-eb19-435c-82b4-96eeac8c470a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:55.224212 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9a5e5929-eb19-435c-82b4-96eeac8c470a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:55.225593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9a5e5929-eb19-435c-82b4-96eeac8c470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:55.324524 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1220/2437] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:55.337750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:55.339318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:55.460709 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95aa74-45a0-47b3-9cb5-1644f6a149de admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:55.465144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810f9aa-55b4-467c-8415-12d601646411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:55.465776 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810f9aa-55b4-467c-8415-12d601646411 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:55.466810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810f9aa-55b4-467c-8415-12d601646411 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:55.466810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810f9aa-55b4-467c-8415-12d601646411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:55.477665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810f9aa-55b4-467c-8415-12d601646411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:55.479329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810f9aa-55b4-467c-8415-12d601646411 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:55.499601 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1218/2438] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:55.709758 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e5929-eb19-435c-82b4-96eeac8c470a None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:55.711382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9a5e5929-eb19-435c-82b4-96eeac8c470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:55.727763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e5929-eb19-435c-82b4-96eeac8c470a None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:55.733650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faad940-a770-488a-83a0-df71cea57bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:55.734764 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faad940-a770-488a-83a0-df71cea57bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:55.735105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faad940-a770-488a-83a0-df71cea57bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:55.735601 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faad940-a770-488a-83a0-df71cea57bbc admin admin] PATH_INFO: `/v3/projects/06a0e72179e3452ea830d7573037997a` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:55.736811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faad940-a770-488a-83a0-df71cea57bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a0e72179e3452ea830d7573037997a)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:55.739677 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faad940-a770-488a-83a0-df71cea57bbc admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:55.823534 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4faad940-a770-488a-83a0-df71cea57bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a0e72179e3452ea830d7573037997a', 'request_id': 'req-4faad940-a770-488a-83a0-df71cea57bbc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:55.831336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4faad940-a770-488a-83a0-df71cea57bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a0e72179e3452ea830d7573037997a', 'request_id': 'req-4faad940-a770-488a-83a0-df71cea57bbc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:55.839339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4faad940-a770-488a-83a0-df71cea57bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a0e72179e3452ea830d7573037997a', 'request_id': 'req-4faad940-a770-488a-83a0-df71cea57bbc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:55.856574 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4faad940-a770-488a-83a0-df71cea57bbc admin admin] The token cache is being invalidate because project 06a0e72179e3452ea830d7573037997a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:59:55.856994 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4faad940-a770-488a-83a0-df71cea57bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:55.858176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4faad940-a770-488a-83a0-df71cea57bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:59:55.860969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1221/2439] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 00:59:55 2022] DELETE /identity/v3/projects/06a0e72179e3452ea830d7573037997a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:55.866819 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820ab7c-d9d2-434a-9bb2-03ab7c801215 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:55.867330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820ab7c-d9d2-434a-9bb2-03ab7c801215 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:55.867819 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820ab7c-d9d2-434a-9bb2-03ab7c801215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:55.890797 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4820ab7c-d9d2-434a-9bb2-03ab7c801215 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:55.892941 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4820ab7c-d9d2-434a-9bb2-03ab7c801215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:55.912879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:55.983719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1219/2440] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:55.987592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06fd6e-8f96-4845-9f3c-97682e084272 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:55.988554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06fd6e-8f96-4845-9f3c-97682e084272 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:55.989050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06fd6e-8f96-4845-9f3c-97682e084272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:56.017502 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-1b06fd6e-8f96-4845-9f3c-97682e084272 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:56.019199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1b06fd6e-8f96-4845-9f3c-97682e084272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:56.039133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1222/2441] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:56.039917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820ab7c-d9d2-434a-9bb2-03ab7c801215 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:56.053621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820ab7c-d9d2-434a-9bb2-03ab7c801215 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:56.065952 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce5062-2975-4a93-97cf-47ece316e1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:56.066598 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce5062-2975-4a93-97cf-47ece316e1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:56.066899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce5062-2975-4a93-97cf-47ece316e1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:56.067439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce5062-2975-4a93-97cf-47ece316e1a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:56.068105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce5062-2975-4a93-97cf-47ece316e1a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:59:56.068406 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce5062-2975-4a93-97cf-47ece316e1a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:56.072577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce5062-2975-4a93-97cf-47ece316e1a9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:56.092732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1220/2442] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 00:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:59:56.097498 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06fd6e-8f96-4845-9f3c-97682e084272 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:56.109950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06fd6e-8f96-4845-9f3c-97682e084272 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:56.115897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3c45c-6686-438f-9238-9f39fef9031b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:56.116649 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3c45c-6686-438f-9238-9f39fef9031b admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:56.116999 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3c45c-6686-438f-9238-9f39fef9031b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:56.117333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3c45c-6686-438f-9238-9f39fef9031b admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:56.118042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3c45c-6686-438f-9238-9f39fef9031b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:56.120095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3c45c-6686-438f-9238-9f39fef9031b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:56.161964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce5062-2975-4a93-97cf-47ece316e1a9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:56.173480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1223/2443] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 00:59:56 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:59:56.175004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce5062-2975-4a93-97cf-47ece316e1a9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:56.323385 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714e446-cbd7-4ba6-aed0-021873c40e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:56.324523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e446-cbd7-4ba6-aed0-021873c40e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:56.324962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e446-cbd7-4ba6-aed0-021873c40e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:56.325417 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e446-cbd7-4ba6-aed0-021873c40e47 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:56.326663 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714e446-cbd7-4ba6-aed0-021873c40e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:56.329480 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714e446-cbd7-4ba6-aed0-021873c40e47 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:56.396217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1221/2444] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 00:59:56 2022] POST /identity/v3/users => generated 284 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:59:56.398264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3c45c-6686-438f-9238-9f39fef9031b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:56.418021 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3c45c-6686-438f-9238-9f39fef9031b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:56.433243 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d41d10-17fd-4532-be21-3221a1b432b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:56.433878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d41d10-17fd-4532-be21-3221a1b432b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:56.434340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d41d10-17fd-4532-be21-3221a1b432b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:56.434633 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d41d10-17fd-4532-be21-3221a1b432b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:56.435426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d41d10-17fd-4532-be21-3221a1b432b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:56.437219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d41d10-17fd-4532-be21-3221a1b432b8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:56.459118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1224/2445] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:59:56.462839 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714e446-cbd7-4ba6-aed0-021873c40e47 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:56.476289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714e446-cbd7-4ba6-aed0-021873c40e47 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:56.483884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dbb87-52b6-4f24-a183-69f3c4603081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:56.495510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dbb87-52b6-4f24-a183-69f3c4603081 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:56.496063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dbb87-52b6-4f24-a183-69f3c4603081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:56.496629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dbb87-52b6-4f24-a183-69f3c4603081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:56.497643 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dbb87-52b6-4f24-a183-69f3c4603081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:56.505647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dbb87-52b6-4f24-a183-69f3c4603081 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:56.525740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1222/2446] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 00:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:59:56.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d41d10-17fd-4532-be21-3221a1b432b8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:56.546677 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d41d10-17fd-4532-be21-3221a1b432b8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:56.556890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25a1cf-6764-4024-8b19-8bb553166709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:56.557939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25a1cf-6764-4024-8b19-8bb553166709 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:56.558525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25a1cf-6764-4024-8b19-8bb553166709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:56.559400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25a1cf-6764-4024-8b19-8bb553166709 admin admin] PATH_INFO: `/v3/projects/e0218665fcb64e308747aa811e152634/users/db0dff7edf5f4e7f962b6ef8b27fd9d3/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:56.581119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25a1cf-6764-4024-8b19-8bb553166709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0218665fcb64e308747aa811e152634, user_id=db0dff7edf5f4e7f962b6ef8b27fd9d3, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:56.584364 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25a1cf-6764-4024-8b19-8bb553166709 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:56.607185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1225/2447] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 00:59:56 2022] PUT /identity/v3/projects/e0218665fcb64e308747aa811e152634/users/db0dff7edf5f4e7f962b6ef8b27fd9d3/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:59:56.617917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fee06-843b-4b65-8bf4-b297404817bf None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:56.618481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fee06-843b-4b65-8bf4-b297404817bf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:56.618840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fee06-843b-4b65-8bf4-b297404817bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:56.664049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2f0fee06-843b-4b65-8bf4-b297404817bf None None] MFA Rules not processed for user `db0dff7edf5f4e7f962b6ef8b27fd9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:56.665153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2f0fee06-843b-4b65-8bf4-b297404817bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:56.752739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1223/2448] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:56.765437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25a1cf-6764-4024-8b19-8bb553166709 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:56.768425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7e25a1cf-6764-4024-8b19-8bb553166709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:56.798848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:56.856793 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25a1cf-6764-4024-8b19-8bb553166709 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:56.864342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6cb5e-9b78-453c-9adc-eb6aa73d85d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:56.865592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6cb5e-9b78-453c-9adc-eb6aa73d85d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:56.866883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6cb5e-9b78-453c-9adc-eb6aa73d85d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:56.867348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6cb5e-9b78-453c-9adc-eb6aa73d85d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:56.915471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6cb5e-9b78-453c-9adc-eb6aa73d85d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:56.917116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6cb5e-9b78-453c-9adc-eb6aa73d85d9 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:56.935697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1226/2449] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:00:06.749038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:06.930956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=17 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:12.214036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fee06-843b-4b65-8bf4-b297404817bf None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:12.282816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fee06-843b-4b65-8bf4-b297404817bf None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:12.287545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:12.288278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:12.288562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:12.288833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] PATH_INFO: `/v3/users/db0dff7edf5f4e7f962b6ef8b27fd9d3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:12.289961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0dff7edf5f4e7f962b6ef8b27fd9d3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:12.291987 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:12.351710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0dff7edf5f4e7f962b6ef8b27fd9d3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:12.369862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0dff7edf5f4e7f962b6ef8b27fd9d3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:12.378010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0dff7edf5f4e7f962b6ef8b27fd9d3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:12.387678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0dff7edf5f4e7f962b6ef8b27fd9d3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:12.388479 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0dff7edf5f4e7f962b6ef8b27fd9d3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:12.395758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1224/2450] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:00:12 2022] DELETE /identity/v3/users/db0dff7edf5f4e7f962b6ef8b27fd9d3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:00:12.400602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7ee56-d3f7-49fb-9bd2-e0c9650e4315 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:12.401064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7ee56-d3f7-49fb-9bd2-e0c9650e4315 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:12.401300 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7ee56-d3f7-49fb-9bd2-e0c9650e4315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:12.420506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f4e7ee56-d3f7-49fb-9bd2-e0c9650e4315 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:12.422402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f4e7ee56-d3f7-49fb-9bd2-e0c9650e4315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:12.495459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1227/2451] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:12.512460 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:12.514053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:12.584760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f36f15-1f86-4338-bda6-b02a462d4342 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:12.588903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d84bc8-009f-4545-b630-e9e033120981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:12.589609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84bc8-009f-4545-b630-e9e033120981 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:12.589784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84bc8-009f-4545-b630-e9e033120981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:12.590054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84bc8-009f-4545-b630-e9e033120981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:12.600668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d84bc8-009f-4545-b630-e9e033120981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:12.602104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d84bc8-009f-4545-b630-e9e033120981 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:12.613214 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1225/2452] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:00:12.737317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7ee56-d3f7-49fb-9bd2-e0c9650e4315 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:12.738770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f4e7ee56-d3f7-49fb-9bd2-e0c9650e4315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:12.750530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7ee56-d3f7-49fb-9bd2-e0c9650e4315 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:12.756266 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:12.762503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:12.763053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:12.763511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] PATH_INFO: `/v3/users/2d1c6efefcd647f2b2110059a897c427` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:12.765008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d1c6efefcd647f2b2110059a897c427)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:12.767101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:12.824126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d1c6efefcd647f2b2110059a897c427'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:12.824920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d1c6efefcd647f2b2110059a897c427'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:12.835596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d1c6efefcd647f2b2110059a897c427'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:12.846008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d1c6efefcd647f2b2110059a897c427'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:12.861788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d1c6efefcd647f2b2110059a897c427'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:12.868385 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1228/2453] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:00:12 2022] DELETE /identity/v3/users/2d1c6efefcd647f2b2110059a897c427 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:00:12.873058 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa47f0-dc53-4768-b320-88db2f1d468c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:12.873352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa47f0-dc53-4768-b320-88db2f1d468c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:12.873643 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa47f0-dc53-4768-b320-88db2f1d468c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:12.922699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-32fa47f0-dc53-4768-b320-88db2f1d468c None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:12.925379 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-32fa47f0-dc53-4768-b320-88db2f1d468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:12.957230 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:13.020961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1226/2454] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:13.027987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:13.029739 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:13.044957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa47f0-dc53-4768-b320-88db2f1d468c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:13.046386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-32fa47f0-dc53-4768-b320-88db2f1d468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:13.063908 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa47f0-dc53-4768-b320-88db2f1d468c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:13.071813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27deaa7c-a25f-4f51-a88b-a25db68082da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:13.072458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27deaa7c-a25f-4f51-a88b-a25db68082da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:13.072740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27deaa7c-a25f-4f51-a88b-a25db68082da admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:13.073011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27deaa7c-a25f-4f51-a88b-a25db68082da admin admin] PATH_INFO: `/v3/projects/e0218665fcb64e308747aa811e152634` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:13.074707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27deaa7c-a25f-4f51-a88b-a25db68082da admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0218665fcb64e308747aa811e152634)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:13.076708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27deaa7c-a25f-4f51-a88b-a25db68082da admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:13.146787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db8a4e-5c2f-4689-a631-f4c8e2925368 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:13.158814 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd76203-f1ad-4c4f-9dc2-6b2e28ec6874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:13.161579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd76203-f1ad-4c4f-9dc2-6b2e28ec6874 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:13.161890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd76203-f1ad-4c4f-9dc2-6b2e28ec6874 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:13.162243 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd76203-f1ad-4c4f-9dc2-6b2e28ec6874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:13.176040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27deaa7c-a25f-4f51-a88b-a25db68082da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0218665fcb64e308747aa811e152634', 'request_id': 'req-27deaa7c-a25f-4f51-a88b-a25db68082da'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:13.188326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd76203-f1ad-4c4f-9dc2-6b2e28ec6874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:13.191718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27deaa7c-a25f-4f51-a88b-a25db68082da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0218665fcb64e308747aa811e152634', 'request_id': 'req-27deaa7c-a25f-4f51-a88b-a25db68082da'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:13.193609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd76203-f1ad-4c4f-9dc2-6b2e28ec6874 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:13.203458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27deaa7c-a25f-4f51-a88b-a25db68082da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0218665fcb64e308747aa811e152634', 'request_id': 'req-27deaa7c-a25f-4f51-a88b-a25db68082da'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:13.231051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1229/2455] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:00:13.246468 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27deaa7c-a25f-4f51-a88b-a25db68082da admin admin] The token cache is being invalidate because project e0218665fcb64e308747aa811e152634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:00:13.247388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27deaa7c-a25f-4f51-a88b-a25db68082da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:13.249260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27deaa7c-a25f-4f51-a88b-a25db68082da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:13.274756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1227/2456] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:00:13 2022] DELETE /identity/v3/projects/e0218665fcb64e308747aa811e152634 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:00:13.830792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd76203-f1ad-4c4f-9dc2-6b2e28ec6874 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:13.832327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7bd76203-f1ad-4c4f-9dc2-6b2e28ec6874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:13.857459 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd76203-f1ad-4c4f-9dc2-6b2e28ec6874 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:13.870125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:13.933570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221154e5-2eb7-4dc5-b574-9102e69fc455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:13.934119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221154e5-2eb7-4dc5-b574-9102e69fc455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:13.934399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221154e5-2eb7-4dc5-b574-9102e69fc455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:13.934827 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221154e5-2eb7-4dc5-b574-9102e69fc455 admin admin] PATH_INFO: `/v3/projects/08801c1d3e014f3b83c58917493fbd12` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:13.935958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221154e5-2eb7-4dc5-b574-9102e69fc455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08801c1d3e014f3b83c58917493fbd12)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:13.937890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221154e5-2eb7-4dc5-b574-9102e69fc455 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:13.986535 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-221154e5-2eb7-4dc5-b574-9102e69fc455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08801c1d3e014f3b83c58917493fbd12', 'request_id': 'req-221154e5-2eb7-4dc5-b574-9102e69fc455'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:13.992664 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-221154e5-2eb7-4dc5-b574-9102e69fc455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08801c1d3e014f3b83c58917493fbd12', 'request_id': 'req-221154e5-2eb7-4dc5-b574-9102e69fc455'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:13.998431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-221154e5-2eb7-4dc5-b574-9102e69fc455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08801c1d3e014f3b83c58917493fbd12', 'request_id': 'req-221154e5-2eb7-4dc5-b574-9102e69fc455'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:14.011270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-221154e5-2eb7-4dc5-b574-9102e69fc455 admin admin] The token cache is being invalidate because project 08801c1d3e014f3b83c58917493fbd12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:00:14.011886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-221154e5-2eb7-4dc5-b574-9102e69fc455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:14.012514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-221154e5-2eb7-4dc5-b574-9102e69fc455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:14.014319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1230/2457] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:00:13 2022] DELETE /identity/v3/projects/08801c1d3e014f3b83c58917493fbd12 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:00:14.019518 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319be11-9151-495f-994a-96895a8d6f59 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:14.019852 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319be11-9151-495f-994a-96895a8d6f59 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:14.020066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319be11-9151-495f-994a-96895a8d6f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:14.040236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1319be11-9151-495f-994a-96895a8d6f59 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:14.041445 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1319be11-9151-495f-994a-96895a8d6f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:14.110083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1228/2458] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:14.118483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8300b-9784-4b54-bbd0-93271b382da1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:14.118798 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8300b-9784-4b54-bbd0-93271b382da1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:14.119326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8300b-9784-4b54-bbd0-93271b382da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:14.140481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f6c8300b-9784-4b54-bbd0-93271b382da1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:14.141738 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f6c8300b-9784-4b54-bbd0-93271b382da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:14.149564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1231/2459] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:14.153841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319be11-9151-495f-994a-96895a8d6f59 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:14.164369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319be11-9151-495f-994a-96895a8d6f59 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:14.169086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c373-2b6a-47c7-9cf1-1dcbd0e5d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:14.169681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c373-2b6a-47c7-9cf1-1dcbd0e5d37b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:14.169960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c373-2b6a-47c7-9cf1-1dcbd0e5d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:14.170231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c373-2b6a-47c7-9cf1-1dcbd0e5d37b admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:14.170938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55c373-2b6a-47c7-9cf1-1dcbd0e5d37b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:00:14.171243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55c373-2b6a-47c7-9cf1-1dcbd0e5d37b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:14.173487 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55c373-2b6a-47c7-9cf1-1dcbd0e5d37b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:14.191033 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1229/2460] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:00:14.192172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8300b-9784-4b54-bbd0-93271b382da1 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:14.201624 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8300b-9784-4b54-bbd0-93271b382da1 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:14.206381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475a73d-ae51-41d4-800a-73bd1b899c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:14.207007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475a73d-ae51-41d4-800a-73bd1b899c67 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:14.207288 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475a73d-ae51-41d4-800a-73bd1b899c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:14.207557 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475a73d-ae51-41d4-800a-73bd1b899c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:14.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475a73d-ae51-41d4-800a-73bd1b899c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:14.210079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475a73d-ae51-41d4-800a-73bd1b899c67 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:14.243438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1232/2461] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:00:14 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:00:14.247896 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c373-2b6a-47c7-9cf1-1dcbd0e5d37b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:14.259271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c373-2b6a-47c7-9cf1-1dcbd0e5d37b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:14.292174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:14.332882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a13c9-a502-4ee4-bb59-02c591296611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:14.333424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a13c9-a502-4ee4-bb59-02c591296611 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:14.333918 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a13c9-a502-4ee4-bb59-02c591296611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:14.334331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a13c9-a502-4ee4-bb59-02c591296611 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:14.335060 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a13c9-a502-4ee4-bb59-02c591296611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:14.337394 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a13c9-a502-4ee4-bb59-02c591296611 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:14.363985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1230/2462] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:00:14 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:00:14.367914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475a73d-ae51-41d4-800a-73bd1b899c67 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:14.378667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475a73d-ae51-41d4-800a-73bd1b899c67 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:14.383460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c4cce-6dba-49f0-a27f-958be8519dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:14.384098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c4cce-6dba-49f0-a27f-958be8519dff admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:14.384379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c4cce-6dba-49f0-a27f-958be8519dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:14.384645 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c4cce-6dba-49f0-a27f-958be8519dff admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:14.385274 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c4cce-6dba-49f0-a27f-958be8519dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:14.386881 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c4cce-6dba-49f0-a27f-958be8519dff admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:14.397103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1233/2463] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:00:14.401559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a13c9-a502-4ee4-bb59-02c591296611 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:14.425447 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a13c9-a502-4ee4-bb59-02c591296611 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:14.432107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c585a7-0032-464e-b51e-fba5b16d9cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:14.433010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c585a7-0032-464e-b51e-fba5b16d9cbd admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:14.433380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c585a7-0032-464e-b51e-fba5b16d9cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:14.433841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c585a7-0032-464e-b51e-fba5b16d9cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:14.434591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c585a7-0032-464e-b51e-fba5b16d9cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:14.436321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c585a7-0032-464e-b51e-fba5b16d9cbd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:14.454235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1231/2464] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:00:14.455815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c4cce-6dba-49f0-a27f-958be8519dff admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:14.465844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c4cce-6dba-49f0-a27f-958be8519dff admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:14.471249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c112e9-7d5f-4634-bef0-f43e8988045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:14.471900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c112e9-7d5f-4634-bef0-f43e8988045c admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:14.472172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c112e9-7d5f-4634-bef0-f43e8988045c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:14.472438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c112e9-7d5f-4634-bef0-f43e8988045c admin admin] PATH_INFO: `/v3/projects/a165af1f972d4661a72c0009561f590c/users/3b14d7593c3944c19a97f0327d84a0f8/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:14.489734 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c112e9-7d5f-4634-bef0-f43e8988045c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a165af1f972d4661a72c0009561f590c, user_id=3b14d7593c3944c19a97f0327d84a0f8, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:14.491563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c112e9-7d5f-4634-bef0-f43e8988045c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:14.508159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1234/2465] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:00:14 2022] PUT /identity/v3/projects/a165af1f972d4661a72c0009561f590c/users/3b14d7593c3944c19a97f0327d84a0f8/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:00:14.519635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e803b8-efee-47e2-89de-100ced722416 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:14.519921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e803b8-efee-47e2-89de-100ced722416 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:14.520188 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e803b8-efee-47e2-89de-100ced722416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:14.548771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-53e803b8-efee-47e2-89de-100ced722416 None None] MFA Rules not processed for user `3b14d7593c3944c19a97f0327d84a0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:14.549983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-53e803b8-efee-47e2-89de-100ced722416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:14.621795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1232/2466] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:14.639456 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c112e9-7d5f-4634-bef0-f43e8988045c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:14.642165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b1c112e9-7d5f-4634-bef0-f43e8988045c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:14.699305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:14.709984 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c112e9-7d5f-4634-bef0-f43e8988045c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:14.719409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806087b-c5f9-44e0-9abb-0bdefa54943a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:14.720029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806087b-c5f9-44e0-9abb-0bdefa54943a service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:14.720308 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806087b-c5f9-44e0-9abb-0bdefa54943a service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:14.720578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806087b-c5f9-44e0-9abb-0bdefa54943a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:14.737058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806087b-c5f9-44e0-9abb-0bdefa54943a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:14.738597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806087b-c5f9-44e0-9abb-0bdefa54943a service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:14.749101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1235/2467] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:00:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:00:14.765805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e803b8-efee-47e2-89de-100ced722416 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:14.859092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e803b8-efee-47e2-89de-100ced722416 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:14.864673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:14.865595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:14.865970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:14.866397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] PATH_INFO: `/v3/users/3b14d7593c3944c19a97f0327d84a0f8` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:14.867668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b14d7593c3944c19a97f0327d84a0f8)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:14.869895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:14.918965 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:14.922498 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b14d7593c3944c19a97f0327d84a0f8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:14.941726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b14d7593c3944c19a97f0327d84a0f8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:14.950712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b14d7593c3944c19a97f0327d84a0f8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:14.960183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b14d7593c3944c19a97f0327d84a0f8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:14.960897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b14d7593c3944c19a97f0327d84a0f8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:14.970079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1233/2468] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:00:14 2022] DELETE /identity/v3/users/3b14d7593c3944c19a97f0327d84a0f8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:00:14.974815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d2354-5221-47fb-a291-2c3b18192cee None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:14.975280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d2354-5221-47fb-a291-2c3b18192cee None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:14.975471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d2354-5221-47fb-a291-2c3b18192cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:14.997231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-502d2354-5221-47fb-a291-2c3b18192cee None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:14.998685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-502d2354-5221-47fb-a291-2c3b18192cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:15.056755 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1236/2469] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:15.066962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:15.068907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:15.134448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6bd6c-bf7a-4a69-8852-1f9a70049d40 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:15.138054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde8d53-4432-4e0b-b6cc-9a7d5f052b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:15.138657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde8d53-4432-4e0b-b6cc-9a7d5f052b04 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:15.139038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde8d53-4432-4e0b-b6cc-9a7d5f052b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:15.139366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde8d53-4432-4e0b-b6cc-9a7d5f052b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:15.148806 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde8d53-4432-4e0b-b6cc-9a7d5f052b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:15.150232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde8d53-4432-4e0b-b6cc-9a7d5f052b04 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:15.160644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1234/2470] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:00:15.461124 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d2354-5221-47fb-a291-2c3b18192cee None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:15.462851 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-502d2354-5221-47fb-a291-2c3b18192cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:15.476910 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d2354-5221-47fb-a291-2c3b18192cee None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:15.488932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad7941-a0fb-41c7-bc37-16b68bf3685a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:15.489590 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad7941-a0fb-41c7-bc37-16b68bf3685a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:15.489875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad7941-a0fb-41c7-bc37-16b68bf3685a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:15.490168 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad7941-a0fb-41c7-bc37-16b68bf3685a admin admin] PATH_INFO: `/v3/projects/a165af1f972d4661a72c0009561f590c` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:15.491520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad7941-a0fb-41c7-bc37-16b68bf3685a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a165af1f972d4661a72c0009561f590c)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:15.493449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad7941-a0fb-41c7-bc37-16b68bf3685a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:15.546987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-37ad7941-a0fb-41c7-bc37-16b68bf3685a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a165af1f972d4661a72c0009561f590c', 'request_id': 'req-37ad7941-a0fb-41c7-bc37-16b68bf3685a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:15.553550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-37ad7941-a0fb-41c7-bc37-16b68bf3685a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a165af1f972d4661a72c0009561f590c', 'request_id': 'req-37ad7941-a0fb-41c7-bc37-16b68bf3685a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:15.560113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-37ad7941-a0fb-41c7-bc37-16b68bf3685a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a165af1f972d4661a72c0009561f590c', 'request_id': 'req-37ad7941-a0fb-41c7-bc37-16b68bf3685a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:15.576953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-37ad7941-a0fb-41c7-bc37-16b68bf3685a admin admin] The token cache is being invalidate because project a165af1f972d4661a72c0009561f590c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:00:15.577246 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-37ad7941-a0fb-41c7-bc37-16b68bf3685a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:15.578453 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-37ad7941-a0fb-41c7-bc37-16b68bf3685a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:15.580033 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1237/2471] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:00:15 2022] DELETE /identity/v3/projects/a165af1f972d4661a72c0009561f590c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:00:15.944469 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde8d53-4432-4e0b-b6cc-9a7d5f052b04 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:15.945867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fcde8d53-4432-4e0b-b6cc-9a7d5f052b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:15.959028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde8d53-4432-4e0b-b6cc-9a7d5f052b04 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:16.014167 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:16.014825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:16.015131 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:16.015402 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] PATH_INFO: `/v3/users/48225d6993a84a399edb2f87e6dd3213` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:16.017076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48225d6993a84a399edb2f87e6dd3213)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:16.019001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:16.066620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48225d6993a84a399edb2f87e6dd3213'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:16.080580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48225d6993a84a399edb2f87e6dd3213'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:16.081904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:16.091087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48225d6993a84a399edb2f87e6dd3213'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:16.099765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48225d6993a84a399edb2f87e6dd3213'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:16.100399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48225d6993a84a399edb2f87e6dd3213'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:16.106464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1235/2472] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:00:15 2022] DELETE /identity/v3/users/48225d6993a84a399edb2f87e6dd3213 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:00:16.112290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cf24-4065-47cf-bd7f-5c0817d9cab4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:16.112810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cf24-4065-47cf-bd7f-5c0817d9cab4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:16.113348 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cf24-4065-47cf-bd7f-5c0817d9cab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:16.133246 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-bba3cf24-4065-47cf-bd7f-5c0817d9cab4 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:16.134438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bba3cf24-4065-47cf-bd7f-5c0817d9cab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:16.198643 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1238/2473] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:16.207992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:16.209459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:16.281193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c84f4-86de-4908-9b79-35856cb5ef07 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:16.284710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48b8b1-7d50-4f5b-aef3-a65b7a51defc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:16.285303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b8b1-7d50-4f5b-aef3-a65b7a51defc service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:16.285575 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b8b1-7d50-4f5b-aef3-a65b7a51defc service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:16.285842 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b8b1-7d50-4f5b-aef3-a65b7a51defc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:16.294624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48b8b1-7d50-4f5b-aef3-a65b7a51defc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:16.296066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48b8b1-7d50-4f5b-aef3-a65b7a51defc service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:16.305932 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1236/2474] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:00:16.473879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3cf24-4065-47cf-bd7f-5c0817d9cab4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:16.475562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bba3cf24-4065-47cf-bd7f-5c0817d9cab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:16.487726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3cf24-4065-47cf-bd7f-5c0817d9cab4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:16.492386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e46b0e-c204-49af-94ef-b7240a0a7763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:16.493010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e46b0e-c204-49af-94ef-b7240a0a7763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:16.493288 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e46b0e-c204-49af-94ef-b7240a0a7763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:16.493558 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e46b0e-c204-49af-94ef-b7240a0a7763 admin admin] PATH_INFO: `/v3/projects/01a284804f1c43dcbee087e0bd8a58ea` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:16.494695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e46b0e-c204-49af-94ef-b7240a0a7763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a284804f1c43dcbee087e0bd8a58ea)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:16.496606 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e46b0e-c204-49af-94ef-b7240a0a7763 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:16.499251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:16.544093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-67e46b0e-c204-49af-94ef-b7240a0a7763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a284804f1c43dcbee087e0bd8a58ea', 'request_id': 'req-67e46b0e-c204-49af-94ef-b7240a0a7763'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:16.550009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-67e46b0e-c204-49af-94ef-b7240a0a7763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a284804f1c43dcbee087e0bd8a58ea', 'request_id': 'req-67e46b0e-c204-49af-94ef-b7240a0a7763'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:16.555939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-67e46b0e-c204-49af-94ef-b7240a0a7763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a284804f1c43dcbee087e0bd8a58ea', 'request_id': 'req-67e46b0e-c204-49af-94ef-b7240a0a7763'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:16.568873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-67e46b0e-c204-49af-94ef-b7240a0a7763 admin admin] The token cache is being invalidate because project 01a284804f1c43dcbee087e0bd8a58ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:00:16.569157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-67e46b0e-c204-49af-94ef-b7240a0a7763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:16.569786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-67e46b0e-c204-49af-94ef-b7240a0a7763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:16.571379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1239/2475] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:00:16 2022] DELETE /identity/v3/projects/01a284804f1c43dcbee087e0bd8a58ea => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:00:16.576063 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa614644-4fab-4cac-ac78-7b3bcb0254b6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:16.576350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa614644-4fab-4cac-ac78-7b3bcb0254b6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:16.576621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa614644-4fab-4cac-ac78-7b3bcb0254b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:16.596409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-aa614644-4fab-4cac-ac78-7b3bcb0254b6 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:16.597601 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-aa614644-4fab-4cac-ac78-7b3bcb0254b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:16.654493 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1237/2476] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:16.663398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d9ea7-7607-434b-9ec7-4c794a375a4f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:16.663681 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d9ea7-7607-434b-9ec7-4c794a375a4f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:16.663953 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d9ea7-7607-434b-9ec7-4c794a375a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:16.683395 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e35d9ea7-7607-434b-9ec7-4c794a375a4f None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:16.684579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e35d9ea7-7607-434b-9ec7-4c794a375a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:16.693161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1240/2477] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:16.697369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa614644-4fab-4cac-ac78-7b3bcb0254b6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:16.707636 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa614644-4fab-4cac-ac78-7b3bcb0254b6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:16.712084 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47cd48-0b6f-4968-8993-042c257385e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:16.712674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47cd48-0b6f-4968-8993-042c257385e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:16.712953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47cd48-0b6f-4968-8993-042c257385e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:16.713219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47cd48-0b6f-4968-8993-042c257385e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:16.713855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47cd48-0b6f-4968-8993-042c257385e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:00:16.714173 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47cd48-0b6f-4968-8993-042c257385e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:16.715783 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47cd48-0b6f-4968-8993-042c257385e4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:16.727149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1238/2478] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:00:16.731451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d9ea7-7607-434b-9ec7-4c794a375a4f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:16.740656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d9ea7-7607-434b-9ec7-4c794a375a4f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:16.745276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb8203-69c9-4571-a4c2-3803e02bfe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:16.745861 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb8203-69c9-4571-a4c2-3803e02bfe32 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:16.746136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb8203-69c9-4571-a4c2-3803e02bfe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:16.746401 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb8203-69c9-4571-a4c2-3803e02bfe32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:16.747066 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb8203-69c9-4571-a4c2-3803e02bfe32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:16.748959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb8203-69c9-4571-a4c2-3803e02bfe32 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:16.777064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1241/2479] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:00:16 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:00:16.781233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47cd48-0b6f-4968-8993-042c257385e4 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:16.791154 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47cd48-0b6f-4968-8993-042c257385e4 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:16.846830 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e26e0-8a63-4403-bb20-7d18d58593b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:16.848045 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e26e0-8a63-4403-bb20-7d18d58593b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:16.848045 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e26e0-8a63-4403-bb20-7d18d58593b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:16.848045 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e26e0-8a63-4403-bb20-7d18d58593b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:16.848552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e26e0-8a63-4403-bb20-7d18d58593b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:16.850388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e26e0-8a63-4403-bb20-7d18d58593b2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:16.875928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1239/2480] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:00:16 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:00:16.877107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb8203-69c9-4571-a4c2-3803e02bfe32 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:16.887472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb8203-69c9-4571-a4c2-3803e02bfe32 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:16.893014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02134b4-ec13-492a-ad83-c7500528f028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:16.893659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02134b4-ec13-492a-ad83-c7500528f028 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:16.893976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02134b4-ec13-492a-ad83-c7500528f028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:16.894282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02134b4-ec13-492a-ad83-c7500528f028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:16.895041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02134b4-ec13-492a-ad83-c7500528f028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:16.896702 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02134b4-ec13-492a-ad83-c7500528f028 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:16.907362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1242/2481] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:00:16.911539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e26e0-8a63-4403-bb20-7d18d58593b2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:16.916632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:16.923607 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e26e0-8a63-4403-bb20-7d18d58593b2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:16.929565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fffc9-fbd9-42ef-99ac-40cdc90a9606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:16.930185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fffc9-fbd9-42ef-99ac-40cdc90a9606 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:16.930460 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fffc9-fbd9-42ef-99ac-40cdc90a9606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:16.930809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fffc9-fbd9-42ef-99ac-40cdc90a9606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:16.931384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fffc9-fbd9-42ef-99ac-40cdc90a9606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:16.932981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fffc9-fbd9-42ef-99ac-40cdc90a9606 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:16.945329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1240/2482] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:00:16.949332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02134b4-ec13-492a-ad83-c7500528f028 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:16.959358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02134b4-ec13-492a-ad83-c7500528f028 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:16.964374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c9cd9-9095-4a02-bc74-e4fbd876d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:16.965022 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c9cd9-9095-4a02-bc74-e4fbd876d4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:16.965307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c9cd9-9095-4a02-bc74-e4fbd876d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:16.965592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c9cd9-9095-4a02-bc74-e4fbd876d4ad admin admin] PATH_INFO: `/v3/projects/c57c4faa35b84a1199ef86edb0ea3fc5/users/4d333b70e7bd4eb19da26c656c2e58a3/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:16.980259 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c9cd9-9095-4a02-bc74-e4fbd876d4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57c4faa35b84a1199ef86edb0ea3fc5, user_id=4d333b70e7bd4eb19da26c656c2e58a3, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:16.982931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c9cd9-9095-4a02-bc74-e4fbd876d4ad admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:16.996037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1243/2483] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:00:16 2022] PUT /identity/v3/projects/c57c4faa35b84a1199ef86edb0ea3fc5/users/4d333b70e7bd4eb19da26c656c2e58a3/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:00:17.006886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca95d4-6323-4912-9da9-ea9759c64fea None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:17.007175 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca95d4-6323-4912-9da9-ea9759c64fea None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:17.007442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca95d4-6323-4912-9da9-ea9759c64fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:17.034400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c7ca95d4-6323-4912-9da9-ea9759c64fea None None] MFA Rules not processed for user `4d333b70e7bd4eb19da26c656c2e58a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:17.035644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c7ca95d4-6323-4912-9da9-ea9759c64fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:17.099940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1241/2484] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:17.110985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c9cd9-9095-4a02-bc74-e4fbd876d4ad admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:17.112807 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f45c9cd9-9095-4a02-bc74-e4fbd876d4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:17.168746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c9cd9-9095-4a02-bc74-e4fbd876d4ad admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:17.173048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401c39d-4566-4f30-82f1-47073018ade3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:17.173650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401c39d-4566-4f30-82f1-47073018ade3 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:17.173927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401c39d-4566-4f30-82f1-47073018ade3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:17.174215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401c39d-4566-4f30-82f1-47073018ade3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:17.182656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401c39d-4566-4f30-82f1-47073018ade3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:17.184081 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401c39d-4566-4f30-82f1-47073018ade3 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:17.193623 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1244/2485] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:00:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:00:17.209522 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca95d4-6323-4912-9da9-ea9759c64fea None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:17.272129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca95d4-6323-4912-9da9-ea9759c64fea None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:17.276797 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:17.277429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:17.277707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:17.277978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] PATH_INFO: `/v3/users/4d333b70e7bd4eb19da26c656c2e58a3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:17.279555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d333b70e7bd4eb19da26c656c2e58a3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:17.281078 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:17.331004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d333b70e7bd4eb19da26c656c2e58a3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:17.343620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d333b70e7bd4eb19da26c656c2e58a3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:17.350945 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d333b70e7bd4eb19da26c656c2e58a3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:17.359011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d333b70e7bd4eb19da26c656c2e58a3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:17.359675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d333b70e7bd4eb19da26c656c2e58a3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:17.361854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:17.366777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1242/2486] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:00:17 2022] DELETE /identity/v3/users/4d333b70e7bd4eb19da26c656c2e58a3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:00:17.371215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4335-9699-4204-8d57-c21bf2ee1d27 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:17.371577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4335-9699-4204-8d57-c21bf2ee1d27 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:17.371852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4335-9699-4204-8d57-c21bf2ee1d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:17.391794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-94ec4335-9699-4204-8d57-c21bf2ee1d27 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:17.392991 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-94ec4335-9699-4204-8d57-c21bf2ee1d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:17.417705 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:17.454136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1245/2487] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:00:17.467438 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:17.468849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:17.524374 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216494ac-ddfe-436a-9b79-a01c127e5637 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:17.527937 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37997718-ab39-46b5-9fe0-ec28bedcc216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:17.528530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37997718-ab39-46b5-9fe0-ec28bedcc216 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:17.528804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37997718-ab39-46b5-9fe0-ec28bedcc216 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:17.529070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37997718-ab39-46b5-9fe0-ec28bedcc216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:17.537862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37997718-ab39-46b5-9fe0-ec28bedcc216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:17.539335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37997718-ab39-46b5-9fe0-ec28bedcc216 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:17.549524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1243/2488] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:00:17.817775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec4335-9699-4204-8d57-c21bf2ee1d27 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:17.819305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-94ec4335-9699-4204-8d57-c21bf2ee1d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:17.835067 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec4335-9699-4204-8d57-c21bf2ee1d27 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:17.839988 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bcc86-2c38-47a3-99e7-4cb377f9858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:17.841218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bcc86-2c38-47a3-99e7-4cb377f9858e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:17.841528 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bcc86-2c38-47a3-99e7-4cb377f9858e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:17.841886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bcc86-2c38-47a3-99e7-4cb377f9858e admin admin] PATH_INFO: `/v3/projects/c57c4faa35b84a1199ef86edb0ea3fc5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:17.843203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bcc86-2c38-47a3-99e7-4cb377f9858e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57c4faa35b84a1199ef86edb0ea3fc5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:17.845149 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bcc86-2c38-47a3-99e7-4cb377f9858e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:17.897850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e09bcc86-2c38-47a3-99e7-4cb377f9858e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57c4faa35b84a1199ef86edb0ea3fc5', 'request_id': 'req-e09bcc86-2c38-47a3-99e7-4cb377f9858e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:17.906604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e09bcc86-2c38-47a3-99e7-4cb377f9858e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57c4faa35b84a1199ef86edb0ea3fc5', 'request_id': 'req-e09bcc86-2c38-47a3-99e7-4cb377f9858e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:17.913664 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e09bcc86-2c38-47a3-99e7-4cb377f9858e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57c4faa35b84a1199ef86edb0ea3fc5', 'request_id': 'req-e09bcc86-2c38-47a3-99e7-4cb377f9858e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:17.927893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e09bcc86-2c38-47a3-99e7-4cb377f9858e admin admin] The token cache is being invalidate because project c57c4faa35b84a1199ef86edb0ea3fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:00:17.928357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e09bcc86-2c38-47a3-99e7-4cb377f9858e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:17.929353 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e09bcc86-2c38-47a3-99e7-4cb377f9858e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:17.931952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1246/2489] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:00:17 2022] DELETE /identity/v3/projects/c57c4faa35b84a1199ef86edb0ea3fc5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:00:17.937421 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ebc82-5ad1-4c71-996f-d59de7859fd9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:17.937421 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ebc82-5ad1-4c71-996f-d59de7859fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:17.937421 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ebc82-5ad1-4c71-996f-d59de7859fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:17.957146 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-013ebc82-5ad1-4c71-996f-d59de7859fd9 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:17.958347 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-013ebc82-5ad1-4c71-996f-d59de7859fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:18.022431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1244/2490] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:18.030205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd97fe-dabc-4e19-a1f4-50f725ce5544 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:18.030490 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd97fe-dabc-4e19-a1f4-50f725ce5544 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:18.030797 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd97fe-dabc-4e19-a1f4-50f725ce5544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:18.051561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-80bd97fe-dabc-4e19-a1f4-50f725ce5544 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:18.052800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-80bd97fe-dabc-4e19-a1f4-50f725ce5544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:18.060668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1247/2491] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:18.064891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ebc82-5ad1-4c71-996f-d59de7859fd9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:18.075262 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ebc82-5ad1-4c71-996f-d59de7859fd9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:18.079837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1146f5-2225-4d8c-995e-1e7feeca03f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:18.080431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1146f5-2225-4d8c-995e-1e7feeca03f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:18.080705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1146f5-2225-4d8c-995e-1e7feeca03f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:18.080972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1146f5-2225-4d8c-995e-1e7feeca03f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:18.081608 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1146f5-2225-4d8c-995e-1e7feeca03f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:00:18.081906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1146f5-2225-4d8c-995e-1e7feeca03f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:18.083532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1146f5-2225-4d8c-995e-1e7feeca03f1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:18.096129 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1245/2492] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:00:18.100466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd97fe-dabc-4e19-a1f4-50f725ce5544 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:18.110084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd97fe-dabc-4e19-a1f4-50f725ce5544 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:18.116546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4337034-a3bf-4edf-88f2-7615982248fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:18.117152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4337034-a3bf-4edf-88f2-7615982248fe admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:18.117432 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4337034-a3bf-4edf-88f2-7615982248fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:18.117701 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4337034-a3bf-4edf-88f2-7615982248fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:18.119736 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4337034-a3bf-4edf-88f2-7615982248fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:18.121636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4337034-a3bf-4edf-88f2-7615982248fe admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:18.151632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1248/2493] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:00:18 2022] POST /identity/v3/projects => generated 359 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:00:18.155602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1146f5-2225-4d8c-995e-1e7feeca03f1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:18.166217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1146f5-2225-4d8c-995e-1e7feeca03f1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:18.228135 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021a82e-e9e7-4839-a83d-3b2f19984bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:18.228745 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a82e-e9e7-4839-a83d-3b2f19984bcc admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:18.229223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a82e-e9e7-4839-a83d-3b2f19984bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:18.229693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a82e-e9e7-4839-a83d-3b2f19984bcc admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:18.230844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021a82e-e9e7-4839-a83d-3b2f19984bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:18.233399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021a82e-e9e7-4839-a83d-3b2f19984bcc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:18.254927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1246/2494] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:00:18 2022] POST /identity/v3/users => generated 280 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:00:18.259153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4337034-a3bf-4edf-88f2-7615982248fe admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:18.269983 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4337034-a3bf-4edf-88f2-7615982248fe admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:18.274561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771dda3-ca84-4b09-bf62-649b7228a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:18.275182 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771dda3-ca84-4b09-bf62-649b7228a1db admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:18.275461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771dda3-ca84-4b09-bf62-649b7228a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:18.275735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771dda3-ca84-4b09-bf62-649b7228a1db admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:18.276369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771dda3-ca84-4b09-bf62-649b7228a1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:18.277973 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771dda3-ca84-4b09-bf62-649b7228a1db admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:18.291043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1249/2495] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:00:18.292157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021a82e-e9e7-4839-a83d-3b2f19984bcc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:18.301963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021a82e-e9e7-4839-a83d-3b2f19984bcc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:18.306612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a088e-7fa8-442f-a2a9-b6fa25658858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:18.307239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a088e-7fa8-442f-a2a9-b6fa25658858 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:18.307520 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a088e-7fa8-442f-a2a9-b6fa25658858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:18.307788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a088e-7fa8-442f-a2a9-b6fa25658858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:18.308420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a088e-7fa8-442f-a2a9-b6fa25658858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:18.310008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a088e-7fa8-442f-a2a9-b6fa25658858 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:18.320948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1247/2496] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:00:18.324952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771dda3-ca84-4b09-bf62-649b7228a1db admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:18.335141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771dda3-ca84-4b09-bf62-649b7228a1db admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:18.339970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235c76e-9234-4aad-80d3-9a34e2db2e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:18.340596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235c76e-9234-4aad-80d3-9a34e2db2e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:18.340869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235c76e-9234-4aad-80d3-9a34e2db2e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:18.341137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235c76e-9234-4aad-80d3-9a34e2db2e4a admin admin] PATH_INFO: `/v3/projects/aee960ad0b0441c5a4ef371e7abc78bf/users/667e1f71d49b49f79e76378e93b802e2/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:18.355821 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235c76e-9234-4aad-80d3-9a34e2db2e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee960ad0b0441c5a4ef371e7abc78bf, user_id=667e1f71d49b49f79e76378e93b802e2, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:18.358416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235c76e-9234-4aad-80d3-9a34e2db2e4a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:18.381881 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1250/2497] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:00:18 2022] PUT /identity/v3/projects/aee960ad0b0441c5a4ef371e7abc78bf/users/667e1f71d49b49f79e76378e93b802e2/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:00:18.384674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8264-b731-4897-aec7-98b426fca722 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:18.384965 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8264-b731-4897-aec7-98b426fca722 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:18.385243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8264-b731-4897-aec7-98b426fca722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:18.407262 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:18.419212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-173e8264-b731-4897-aec7-98b426fca722 None None] MFA Rules not processed for user `667e1f71d49b49f79e76378e93b802e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:18.420602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-173e8264-b731-4897-aec7-98b426fca722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:18.492514 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1248/2498] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:00:18.503463 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235c76e-9234-4aad-80d3-9a34e2db2e4a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:18.505293 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f235c76e-9234-4aad-80d3-9a34e2db2e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:18.563660 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235c76e-9234-4aad-80d3-9a34e2db2e4a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:18.567277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafe797-b867-4dfa-a427-22dd1af6f189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:18.568139 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafe797-b867-4dfa-a427-22dd1af6f189 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:18.568416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafe797-b867-4dfa-a427-22dd1af6f189 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:18.568688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafe797-b867-4dfa-a427-22dd1af6f189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:18.573766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:18.579041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafe797-b867-4dfa-a427-22dd1af6f189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:18.581173 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafe797-b867-4dfa-a427-22dd1af6f189 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:18.590492 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1251/2499] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:00:18 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:00:25.553385 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e8264-b731-4897-aec7-98b426fca722 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:25.619745 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e8264-b731-4897-aec7-98b426fca722 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:25.624339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:25.624999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:25.625274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:25.625549 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] PATH_INFO: `/v3/users/667e1f71d49b49f79e76378e93b802e2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:25.626672 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=667e1f71d49b49f79e76378e93b802e2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:25.628603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:25.676732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '667e1f71d49b49f79e76378e93b802e2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:25.690323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '667e1f71d49b49f79e76378e93b802e2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:25.697988 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '667e1f71d49b49f79e76378e93b802e2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:25.707384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '667e1f71d49b49f79e76378e93b802e2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:25.708017 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '667e1f71d49b49f79e76378e93b802e2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:25.714320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1249/2500] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:00:25 2022] DELETE /identity/v3/users/667e1f71d49b49f79e76378e93b802e2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:00:25.718825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40e9e8-5df8-4116-821b-a9daf9317416 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:25.719288 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40e9e8-5df8-4116-821b-a9daf9317416 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:25.719523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40e9e8-5df8-4116-821b-a9daf9317416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:25.743386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-cd40e9e8-5df8-4116-821b-a9daf9317416 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:25.744641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cd40e9e8-5df8-4116-821b-a9daf9317416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:25.805392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1252/2501] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:25.816338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:25.818468 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:25.839146 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:25.877243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b593e0b-46b7-4965-a4b0-95dde1dd6442 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:25.880815 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f64c2-bf90-477c-82f6-a03c63038ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:25.881407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f64c2-bf90-477c-82f6-a03c63038ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:25.881681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f64c2-bf90-477c-82f6-a03c63038ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:25.881947 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f64c2-bf90-477c-82f6-a03c63038ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:25.890765 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f64c2-bf90-477c-82f6-a03c63038ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:25.892165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f64c2-bf90-477c-82f6-a03c63038ef8 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:25.901422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1250/2502] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:00:26.076900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40e9e8-5df8-4116-821b-a9daf9317416 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:26.078966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cd40e9e8-5df8-4116-821b-a9daf9317416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:26.090963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40e9e8-5df8-4116-821b-a9daf9317416 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:26.095642 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:26.096286 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:26.096567 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:26.096840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] PATH_INFO: `/v3/projects/aee960ad0b0441c5a4ef371e7abc78bf` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:26.097972 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee960ad0b0441c5a4ef371e7abc78bf)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:26.099906 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:26.148663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee960ad0b0441c5a4ef371e7abc78bf', 'request_id': 'req-7b5fc185-cd68-427b-919b-99475706a54b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:26.154709 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee960ad0b0441c5a4ef371e7abc78bf', 'request_id': 'req-7b5fc185-cd68-427b-919b-99475706a54b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:26.161007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee960ad0b0441c5a4ef371e7abc78bf', 'request_id': 'req-7b5fc185-cd68-427b-919b-99475706a54b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:26.174679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] The token cache is being invalidate because project aee960ad0b0441c5a4ef371e7abc78bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:00:26.175002 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:26.175626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:00:26.177353 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1253/2503] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:00:26 2022] DELETE /identity/v3/projects/aee960ad0b0441c5a4ef371e7abc78bf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:00:35.897300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=18 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:36.170960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:44.237671 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca4e82-2b2d-4fa1-b1fe-241cf7722194 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:44.238152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca4e82-2b2d-4fa1-b1fe-241cf7722194 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:44.238261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca4e82-2b2d-4fa1-b1fe-241cf7722194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:44.257235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-72ca4e82-2b2d-4fa1-b1fe-241cf7722194 None None] MFA Rules not processed for user `ab779a170d56400295f77401f847ab66`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:44.258404 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-72ca4e82-2b2d-4fa1-b1fe-241cf7722194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:44.310496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1251/2504] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:54.304192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=25 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:06.052638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:06.055308 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:06.133152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fc185-cd68-427b-919b-99475706a54b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:06.138860 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a8d69-e3cc-45e5-a6ff-1378aaea6927 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:06.139472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a8d69-e3cc-45e5-a6ff-1378aaea6927 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:06.139752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a8d69-e3cc-45e5-a6ff-1378aaea6927 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:06.140025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a8d69-e3cc-45e5-a6ff-1378aaea6927 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:06.141839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-eb6a8d69-e3cc-45e5-a6ff-1378aaea6927 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:06.155277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a8d69-e3cc-45e5-a6ff-1378aaea6927 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:06.156580 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a8d69-e3cc-45e5-a6ff-1378aaea6927 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:06.168358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1254/2505] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:12.761669 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca4e82-2b2d-4fa1-b1fe-241cf7722194 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:12.763131 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-72ca4e82-2b2d-4fa1-b1fe-241cf7722194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:12.827389 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca4e82-2b2d-4fa1-b1fe-241cf7722194 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:12.831921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:12.832552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:12.832822 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:12.833095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] PATH_INFO: `/v3/users/b8b67a8814914e029479315bbd3858a7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:12.834198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b67a8814914e029479315bbd3858a7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:12.836239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:12.880953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b67a8814914e029479315bbd3858a7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:12.893259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b67a8814914e029479315bbd3858a7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:12.900060 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b67a8814914e029479315bbd3858a7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:12.906982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b67a8814914e029479315bbd3858a7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:12.907593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b67a8814914e029479315bbd3858a7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:12.916721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1252/2506] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:01:12 2022] DELETE /identity/v3/users/b8b67a8814914e029479315bbd3858a7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:01:12.918443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f192550-7792-47be-94c3-9629e082726d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:12.918951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f192550-7792-47be-94c3-9629e082726d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:12.919122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f192550-7792-47be-94c3-9629e082726d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:12.977861 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7f192550-7792-47be-94c3-9629e082726d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:12.979010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7f192550-7792-47be-94c3-9629e082726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:13.086399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1255/2507] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:01:13.096800 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:13.098290 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:13.167241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd45db-48fe-4a65-abfb-afa647bc9f95 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:13.170885 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860a930-8bf2-40f7-9632-220600dd4935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:13.171484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860a930-8bf2-40f7-9632-220600dd4935 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:13.171763 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860a930-8bf2-40f7-9632-220600dd4935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:13.172034 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860a930-8bf2-40f7-9632-220600dd4935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:13.180781 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860a930-8bf2-40f7-9632-220600dd4935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:13.182351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860a930-8bf2-40f7-9632-220600dd4935 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:13.192077 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1253/2508] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:13.375477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f192550-7792-47be-94c3-9629e082726d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:13.376989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7f192550-7792-47be-94c3-9629e082726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:13.390035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f192550-7792-47be-94c3-9629e082726d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:13.395248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:13.396012 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:13.396401 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:13.397211 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] PATH_INFO: `/v3/projects/ddead0843ffd40379ec3d0b7a74f0d99` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:13.398158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddead0843ffd40379ec3d0b7a74f0d99)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:13.400119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:13.412301 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:13.449311 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddead0843ffd40379ec3d0b7a74f0d99', 'request_id': 'req-918d39bc-0e53-43ab-b871-31591188e0c5'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:13.455390 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddead0843ffd40379ec3d0b7a74f0d99', 'request_id': 'req-918d39bc-0e53-43ab-b871-31591188e0c5'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:13.460864 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddead0843ffd40379ec3d0b7a74f0d99', 'request_id': 'req-918d39bc-0e53-43ab-b871-31591188e0c5'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:13.473347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] The token cache is being invalidate because project ddead0843ffd40379ec3d0b7a74f0d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:01:13.473662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:13.474293 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:13.475836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1256/2509] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:01:13 2022] DELETE /identity/v3/projects/ddead0843ffd40379ec3d0b7a74f0d99 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:01:13.480366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860a930-8bf2-40f7-9632-220600dd4935 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:13.489940 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860a930-8bf2-40f7-9632-220600dd4935 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:13.502459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:13.548981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4237ff6-68d6-40c3-88f2-2c6ea2ea7581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:13.549603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4237ff6-68d6-40c3-88f2-2c6ea2ea7581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:13.549874 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4237ff6-68d6-40c3-88f2-2c6ea2ea7581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:13.550145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4237ff6-68d6-40c3-88f2-2c6ea2ea7581 admin admin] PATH_INFO: `/v3/users/77982ca1f0d04b4fa6fae6af4fb7ef12` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:13.551292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4237ff6-68d6-40c3-88f2-2c6ea2ea7581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77982ca1f0d04b4fa6fae6af4fb7ef12)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:13.553193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4237ff6-68d6-40c3-88f2-2c6ea2ea7581 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:13.600380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b4237ff6-68d6-40c3-88f2-2c6ea2ea7581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77982ca1f0d04b4fa6fae6af4fb7ef12'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:13.615050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b4237ff6-68d6-40c3-88f2-2c6ea2ea7581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77982ca1f0d04b4fa6fae6af4fb7ef12'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:13.622476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b4237ff6-68d6-40c3-88f2-2c6ea2ea7581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77982ca1f0d04b4fa6fae6af4fb7ef12'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:13.630891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b4237ff6-68d6-40c3-88f2-2c6ea2ea7581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77982ca1f0d04b4fa6fae6af4fb7ef12'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:13.631523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b4237ff6-68d6-40c3-88f2-2c6ea2ea7581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77982ca1f0d04b4fa6fae6af4fb7ef12'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:13.642137 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1254/2510] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:01:13 2022] DELETE /identity/v3/users/77982ca1f0d04b4fa6fae6af4fb7ef12 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:01:13.943780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:13.945662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:13.959783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d39bc-0e53-43ab-b871-31591188e0c5 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:14.019976 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405d253-2a05-43a7-90da-7e7b1b92f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:14.020545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405d253-2a05-43a7-90da-7e7b1b92f8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.020868 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405d253-2a05-43a7-90da-7e7b1b92f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.021140 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405d253-2a05-43a7-90da-7e7b1b92f8c0 admin admin] PATH_INFO: `/v3/projects/6aaeb41da2674ec5a031251292d57235` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.022299 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405d253-2a05-43a7-90da-7e7b1b92f8c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aaeb41da2674ec5a031251292d57235)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:14.024368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405d253-2a05-43a7-90da-7e7b1b92f8c0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:14.072423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5405d253-2a05-43a7-90da-7e7b1b92f8c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aaeb41da2674ec5a031251292d57235', 'request_id': 'req-5405d253-2a05-43a7-90da-7e7b1b92f8c0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:14.078592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5405d253-2a05-43a7-90da-7e7b1b92f8c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aaeb41da2674ec5a031251292d57235', 'request_id': 'req-5405d253-2a05-43a7-90da-7e7b1b92f8c0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:14.084431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5405d253-2a05-43a7-90da-7e7b1b92f8c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aaeb41da2674ec5a031251292d57235', 'request_id': 'req-5405d253-2a05-43a7-90da-7e7b1b92f8c0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:14.096923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5405d253-2a05-43a7-90da-7e7b1b92f8c0 admin admin] The token cache is being invalidate because project 6aaeb41da2674ec5a031251292d57235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:01:14.097212 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5405d253-2a05-43a7-90da-7e7b1b92f8c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:14.097852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5405d253-2a05-43a7-90da-7e7b1b92f8c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:01:14.099406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1257/2511] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:01:13 2022] DELETE /identity/v3/projects/6aaeb41da2674ec5a031251292d57235 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:01:14.105067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d600-7648-495a-8c41-5be7425c25e8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.105623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d600-7648-495a-8c41-5be7425c25e8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.105623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d600-7648-495a-8c41-5be7425c25e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.153737 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5b31d600-7648-495a-8c41-5be7425c25e8 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:14.154993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5b31d600-7648-495a-8c41-5be7425c25e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:14.215338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1255/2512] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:01:14.224167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c83ed-48a9-4478-b0c5-829c5ea2a0a1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.224450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c83ed-48a9-4478-b0c5-829c5ea2a0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.224735 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c83ed-48a9-4478-b0c5-829c5ea2a0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.245356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-fa5c83ed-48a9-4478-b0c5-829c5ea2a0a1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:14.246551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fa5c83ed-48a9-4478-b0c5-829c5ea2a0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:14.254517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1258/2513] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:01:14.258699 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31d600-7648-495a-8c41-5be7425c25e8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:14.268340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31d600-7648-495a-8c41-5be7425c25e8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:14.272994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f5b2e-829f-4626-9306-53c654fdb631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:14.273523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f5b2e-829f-4626-9306-53c654fdb631 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.273801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f5b2e-829f-4626-9306-53c654fdb631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.274070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f5b2e-829f-4626-9306-53c654fdb631 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.275283 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f5b2e-829f-4626-9306-53c654fdb631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:01:14.275587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f5b2e-829f-4626-9306-53c654fdb631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:14.277214 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f5b2e-829f-4626-9306-53c654fdb631 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:14.285841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:14.293291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1256/2514] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:01:14.297679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c83ed-48a9-4478-b0c5-829c5ea2a0a1 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:14.307968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c83ed-48a9-4478-b0c5-829c5ea2a0a1 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:14.313386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e8ff-be57-411e-8ecf-30c4ee5ac932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:14.314057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e8ff-be57-411e-8ecf-30c4ee5ac932 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.314342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e8ff-be57-411e-8ecf-30c4ee5ac932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.314615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e8ff-be57-411e-8ecf-30c4ee5ac932 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.315469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967e8ff-be57-411e-8ecf-30c4ee5ac932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:14.317648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967e8ff-be57-411e-8ecf-30c4ee5ac932 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:14.347666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1259/2515] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:01:14 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:01:14.351848 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f5b2e-829f-4626-9306-53c654fdb631 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:14.362879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f5b2e-829f-4626-9306-53c654fdb631 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:14.422245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95f30e-96aa-44d7-b8f7-e50cce6a4984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:14.422974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95f30e-96aa-44d7-b8f7-e50cce6a4984 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.423341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95f30e-96aa-44d7-b8f7-e50cce6a4984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.423736 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95f30e-96aa-44d7-b8f7-e50cce6a4984 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.424257 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95f30e-96aa-44d7-b8f7-e50cce6a4984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:14.426329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95f30e-96aa-44d7-b8f7-e50cce6a4984 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:14.451112 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1257/2516] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:01:14 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:01:14.455164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e8ff-be57-411e-8ecf-30c4ee5ac932 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:14.460603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:14.468280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e8ff-be57-411e-8ecf-30c4ee5ac932 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:14.474323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99cb85-796e-4c34-9dfd-ef9fa424015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:14.475032 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99cb85-796e-4c34-9dfd-ef9fa424015c admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.475402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99cb85-796e-4c34-9dfd-ef9fa424015c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.475774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99cb85-796e-4c34-9dfd-ef9fa424015c admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.476495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99cb85-796e-4c34-9dfd-ef9fa424015c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:14.478740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99cb85-796e-4c34-9dfd-ef9fa424015c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:14.488801 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1260/2517] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:01:14.493159 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95f30e-96aa-44d7-b8f7-e50cce6a4984 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:14.504255 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95f30e-96aa-44d7-b8f7-e50cce6a4984 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:14.509630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe434cc-88ce-4692-b78a-9bc88184615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:14.510334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe434cc-88ce-4692-b78a-9bc88184615c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.510609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe434cc-88ce-4692-b78a-9bc88184615c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.510959 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe434cc-88ce-4692-b78a-9bc88184615c admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.511710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe434cc-88ce-4692-b78a-9bc88184615c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:14.513418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe434cc-88ce-4692-b78a-9bc88184615c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:14.523804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1258/2518] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:01:14.528271 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99cb85-796e-4c34-9dfd-ef9fa424015c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:14.541119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99cb85-796e-4c34-9dfd-ef9fa424015c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:14.546575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce289e-acd9-4e81-bcb4-fc1d694e32f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:14.547276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce289e-acd9-4e81-bcb4-fc1d694e32f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.547620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce289e-acd9-4e81-bcb4-fc1d694e32f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.548084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce289e-acd9-4e81-bcb4-fc1d694e32f6 admin admin] PATH_INFO: `/v3/projects/582512e6ad9c4fa58c9c34d4d49fdd05/users/f88df0c9fadc4135b04ad2a9412026ec/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.565214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce289e-acd9-4e81-bcb4-fc1d694e32f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=582512e6ad9c4fa58c9c34d4d49fdd05, user_id=f88df0c9fadc4135b04ad2a9412026ec, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:14.568805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce289e-acd9-4e81-bcb4-fc1d694e32f6 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:14.583392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1261/2519] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:01:14 2022] PUT /identity/v3/projects/582512e6ad9c4fa58c9c34d4d49fdd05/users/f88df0c9fadc4135b04ad2a9412026ec/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:01:14.594263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf7914-e84f-4bca-b813-674128c9628c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.594604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf7914-e84f-4bca-b813-674128c9628c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.594913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf7914-e84f-4bca-b813-674128c9628c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.627331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f8cf7914-e84f-4bca-b813-674128c9628c None None] MFA Rules not processed for user `f88df0c9fadc4135b04ad2a9412026ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:14.628726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f8cf7914-e84f-4bca-b813-674128c9628c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:14.700674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1259/2520] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:01:14.705206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce289e-acd9-4e81-bcb4-fc1d694e32f6 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:14.767157 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce289e-acd9-4e81-bcb4-fc1d694e32f6 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:14.772014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd7883-22df-467a-9b69-1bd759e28428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:14.772606 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd7883-22df-467a-9b69-1bd759e28428 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.772887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd7883-22df-467a-9b69-1bd759e28428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.773210 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd7883-22df-467a-9b69-1bd759e28428 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.773786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd7883-22df-467a-9b69-1bd759e28428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:14.775799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd7883-22df-467a-9b69-1bd759e28428 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:14.810407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1262/2521] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:01:14 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:01:14.814619 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf7914-e84f-4bca-b813-674128c9628c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:14.825687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf7914-e84f-4bca-b813-674128c9628c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:14.881900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3f08f-9dd5-4a8c-9cae-48f561bc8517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:14.882505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f08f-9dd5-4a8c-9cae-48f561bc8517 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.882876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f08f-9dd5-4a8c-9cae-48f561bc8517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.883148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f08f-9dd5-4a8c-9cae-48f561bc8517 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.883773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3f08f-9dd5-4a8c-9cae-48f561bc8517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:14.886169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3f08f-9dd5-4a8c-9cae-48f561bc8517 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:14.902459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:14.909526 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1260/2522] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:01:14 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:01:14.913764 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd7883-22df-467a-9b69-1bd759e28428 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:14.925382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd7883-22df-467a-9b69-1bd759e28428 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:14.929858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9601b-c535-4497-9cc1-ca2e076e1f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:14.930444 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9601b-c535-4497-9cc1-ca2e076e1f21 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.931136 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9601b-c535-4497-9cc1-ca2e076e1f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.931412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9601b-c535-4497-9cc1-ca2e076e1f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.932049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9601b-c535-4497-9cc1-ca2e076e1f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:14.933747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9601b-c535-4497-9cc1-ca2e076e1f21 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:14.945037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1263/2523] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:01:14.950099 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3f08f-9dd5-4a8c-9cae-48f561bc8517 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:14.959989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3f08f-9dd5-4a8c-9cae-48f561bc8517 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:14.965313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad338c-aaa9-4498-aed7-ce839ae83ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:14.965962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad338c-aaa9-4498-aed7-ce839ae83ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.966241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad338c-aaa9-4498-aed7-ce839ae83ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.966513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad338c-aaa9-4498-aed7-ce839ae83ad7 admin admin] PATH_INFO: `/v3/projects/56b648e29839413aa5bbfb2933312f6d/users/c9ecb692ba2641ef9b025394bfc938ab/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.982187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad338c-aaa9-4498-aed7-ce839ae83ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b648e29839413aa5bbfb2933312f6d, user_id=c9ecb692ba2641ef9b025394bfc938ab, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:14.984894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad338c-aaa9-4498-aed7-ce839ae83ad7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:14.997265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1261/2524] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:01:14 2022] PUT /identity/v3/projects/56b648e29839413aa5bbfb2933312f6d/users/c9ecb692ba2641ef9b025394bfc938ab/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:01:15.001192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9601b-c535-4497-9cc1-ca2e076e1f21 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:15.011559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9601b-c535-4497-9cc1-ca2e076e1f21 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:15.067755 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a547d-124c-4469-bba0-052b235466b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:15.068277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a547d-124c-4469-bba0-052b235466b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:15.068557 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a547d-124c-4469-bba0-052b235466b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:15.068828 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a547d-124c-4469-bba0-052b235466b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:15.069928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a547d-124c-4469-bba0-052b235466b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:15.072170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a547d-124c-4469-bba0-052b235466b1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:15.081726 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1264/2525] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:01:15.085828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad338c-aaa9-4498-aed7-ce839ae83ad7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:15.096139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad338c-aaa9-4498-aed7-ce839ae83ad7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:15.100856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd7caf-4304-4274-bc37-b13ce5c9bc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:15.101495 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd7caf-4304-4274-bc37-b13ce5c9bc40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:15.101771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd7caf-4304-4274-bc37-b13ce5c9bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:15.102041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd7caf-4304-4274-bc37-b13ce5c9bc40 admin admin] PATH_INFO: `/v3/projects/56b648e29839413aa5bbfb2933312f6d/users/c9ecb692ba2641ef9b025394bfc938ab/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:15.103977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd7caf-4304-4274-bc37-b13ce5c9bc40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b648e29839413aa5bbfb2933312f6d, user_id=c9ecb692ba2641ef9b025394bfc938ab, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:15.106592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd7caf-4304-4274-bc37-b13ce5c9bc40 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:15.116733 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1262/2526] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:01:15 2022] PUT /identity/v3/projects/56b648e29839413aa5bbfb2933312f6d/users/c9ecb692ba2641ef9b025394bfc938ab/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:01:15.127339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10a9e7-d4d1-4ac3-bd33-9d1cf5950356 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:15.127629 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10a9e7-d4d1-4ac3-bd33-9d1cf5950356 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:15.127904 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10a9e7-d4d1-4ac3-bd33-9d1cf5950356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:15.158051 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0c10a9e7-d4d1-4ac3-bd33-9d1cf5950356 None None] MFA Rules not processed for user `c9ecb692ba2641ef9b025394bfc938ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:15.159289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0c10a9e7-d4d1-4ac3-bd33-9d1cf5950356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:15.185066 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:15.234925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1265/2527] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:01:15.245974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd7caf-4304-4274-bc37-b13ce5c9bc40 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:15.247675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e4bd7caf-4304-4274-bc37-b13ce5c9bc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:15.322783 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd7caf-4304-4274-bc37-b13ce5c9bc40 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:15.326291 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31875fdd-6ec6-4078-bd72-d84a9d3ec887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:15.326921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31875fdd-6ec6-4078-bd72-d84a9d3ec887 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:15.327199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31875fdd-6ec6-4078-bd72-d84a9d3ec887 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:15.327464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31875fdd-6ec6-4078-bd72-d84a9d3ec887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:15.381968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31875fdd-6ec6-4078-bd72-d84a9d3ec887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:15.383459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31875fdd-6ec6-4078-bd72-d84a9d3ec887 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:15.393057 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1263/2528] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:17.105625 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10a9e7-d4d1-4ac3-bd33-9d1cf5950356 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:17.115622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10a9e7-d4d1-4ac3-bd33-9d1cf5950356 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:17.120269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bfdbf-830f-4d62-93a6-2894ec492fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:17.120947 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bfdbf-830f-4d62-93a6-2894ec492fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:17.121139 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bfdbf-830f-4d62-93a6-2894ec492fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:17.121402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bfdbf-830f-4d62-93a6-2894ec492fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:17.131165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bfdbf-830f-4d62-93a6-2894ec492fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:17.132671 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bfdbf-830f-4d62-93a6-2894ec492fe6 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:17.142259 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1266/2529] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:21.980250 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87018102-87d7-4ced-ab97-697f0c9ecd9d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:21.981086 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87018102-87d7-4ced-ab97-697f0c9ecd9d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:21.981527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87018102-87d7-4ced-ab97-697f0c9ecd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:22.006315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-87018102-87d7-4ced-ab97-697f0c9ecd9d None None] MFA Rules not processed for user `f88df0c9fadc4135b04ad2a9412026ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:22.007643 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-87018102-87d7-4ced-ab97-697f0c9ecd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:22.017450 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1264/2530] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:01:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:01:22.731615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bfdbf-830f-4d62-93a6-2894ec492fe6 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:22.733059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-168bfdbf-830f-4d62-93a6-2894ec492fe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:22.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bfdbf-830f-4d62-93a6-2894ec492fe6 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:22.748264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacca2a-068f-475e-aa72-55b7e5f77492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:22.748878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacca2a-068f-475e-aa72-55b7e5f77492 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:22.749161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacca2a-068f-475e-aa72-55b7e5f77492 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:22.749435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacca2a-068f-475e-aa72-55b7e5f77492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:22.751269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5aacca2a-068f-475e-aa72-55b7e5f77492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:22.761754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacca2a-068f-475e-aa72-55b7e5f77492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:22.763385 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacca2a-068f-475e-aa72-55b7e5f77492 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:22.772145 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1267/2531] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:31.999344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=74,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:32.768132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=29 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:13.753611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b1950-3a59-4ec4-bcf5-92a61aa6329a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:13.754202 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b1950-3a59-4ec4-bcf5-92a61aa6329a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:13.754202 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b1950-3a59-4ec4-bcf5-92a61aa6329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:13.778258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-674b1950-3a59-4ec4-bcf5-92a61aa6329a None None] MFA Rules not processed for user `f88df0c9fadc4135b04ad2a9412026ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:13.779471 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-674b1950-3a59-4ec4-bcf5-92a61aa6329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:13.786546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1265/2532] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:02:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:14.980633 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacca2a-068f-475e-aa72-55b7e5f77492 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:14.982085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5aacca2a-068f-475e-aa72-55b7e5f77492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:15.079988 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacca2a-068f-475e-aa72-55b7e5f77492 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:15.085089 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291746b-bd2d-4fe4-847c-513d0c84533c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:15.085687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291746b-bd2d-4fe4-847c-513d0c84533c service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:15.085962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291746b-bd2d-4fe4-847c-513d0c84533c service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:15.086232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291746b-bd2d-4fe4-847c-513d0c84533c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:15.088473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8291746b-bd2d-4fe4-847c-513d0c84533c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:15.099665 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291746b-bd2d-4fe4-847c-513d0c84533c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:15.101230 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291746b-bd2d-4fe4-847c-513d0c84533c service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:15.111528 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1268/2533] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:23.772222 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:25.107457 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=41 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:42.865642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b1950-3a59-4ec4-bcf5-92a61aa6329a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:42.867221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-674b1950-3a59-4ec4-bcf5-92a61aa6329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:42.945175 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b1950-3a59-4ec4-bcf5-92a61aa6329a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:42.949082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f88e7e-5699-4266-8618-320350c0a2c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecc9e16475344b78bb885437b5d6bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:42.949681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f88e7e-5699-4266-8618-320350c0a2c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:42.949958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f88e7e-5699-4266-8618-320350c0a2c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:42.950227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f88e7e-5699-4266-8618-320350c0a2c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:42.951976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a0f88e7e-5699-4266-8618-320350c0a2c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:43.010247 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f88e7e-5699-4266-8618-320350c0a2c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:43.011729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f88e7e-5699-4266-8618-320350c0a2c9 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:43.020623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1266/2534] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:53.017052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=57 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:54.511613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfa9b4-1e56-4851-9977-1ea30fa5fd71 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:54.512130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfa9b4-1e56-4851-9977-1ea30fa5fd71 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:54.512252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfa9b4-1e56-4851-9977-1ea30fa5fd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:54.654609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-44cfa9b4-1e56-4851-9977-1ea30fa5fd71 None None] MFA Rules not processed for user `ab779a170d56400295f77401f847ab66`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:54.655754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-44cfa9b4-1e56-4851-9977-1ea30fa5fd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:54.662603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1269/2535] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:04.527360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:09.901018 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f061a-9158-45f8-9f68-269a6392c00b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.907508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f061a-9158-45f8-9f68-269a6392c00b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.907972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f061a-9158-45f8-9f68-269a6392c00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.933424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0c0f061a-9158-45f8-9f68-269a6392c00b None None] MFA Rules not processed for user `f88df0c9fadc4135b04ad2a9412026ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:09.934920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0c0f061a-9158-45f8-9f68-269a6392c00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:09.942823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1267/2536] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:19.186330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfa9b4-1e56-4851-9977-1ea30fa5fd71 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:19.206422 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfa9b4-1e56-4851-9977-1ea30fa5fd71 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:19.209931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1e124-2405-4532-a293-b6bbc1f4f6d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:19.210520 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1e124-2405-4532-a293-b6bbc1f4f6d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:19.210825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1e124-2405-4532-a293-b6bbc1f4f6d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:19.211095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1e124-2405-4532-a293-b6bbc1f4f6d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:19.212872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1aa1e124-2405-4532-a293-b6bbc1f4f6d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:19.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1e124-2405-4532-a293-b6bbc1f4f6d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:19.303496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1e124-2405-4532-a293-b6bbc1f4f6d7 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:19.322961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1270/2537] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:19.925233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:21.696591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f061a-9158-45f8-9f68-269a6392c00b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:21.706284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f061a-9158-45f8-9f68-269a6392c00b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:21.709810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ec03b-9868-429c-8e35-1cc17701ea1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:21.710401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec03b-9868-429c-8e35-1cc17701ea1a service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:21.710674 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec03b-9868-429c-8e35-1cc17701ea1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:21.710971 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec03b-9868-429c-8e35-1cc17701ea1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:21.712687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c13ec03b-9868-429c-8e35-1cc17701ea1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:21.725978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ec03b-9868-429c-8e35-1cc17701ea1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:21.727421 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ec03b-9868-429c-8e35-1cc17701ea1a service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:21.738517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1268/2538] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:29.320373 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=50 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:31.733804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:58.723041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1e124-2405-4532-a293-b6bbc1f4f6d7 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:58.732923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1e124-2405-4532-a293-b6bbc1f4f6d7 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:58.736840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565ede1-f9d4-4aee-8f19-5587e4316a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:58.737473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565ede1-f9d4-4aee-8f19-5587e4316a6e service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:58.737747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565ede1-f9d4-4aee-8f19-5587e4316a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:58.738013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565ede1-f9d4-4aee-8f19-5587e4316a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:58.740634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3565ede1-f9d4-4aee-8f19-5587e4316a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:58.768094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565ede1-f9d4-4aee-8f19-5587e4316a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:58.769747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565ede1-f9d4-4aee-8f19-5587e4316a6e service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:58.788681 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1271/2539] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:04:00.844300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ec03b-9868-429c-8e35-1cc17701ea1a service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:00.847069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c13ec03b-9868-429c-8e35-1cc17701ea1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:00.862398 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ec03b-9868-429c-8e35-1cc17701ea1a service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:00.869118 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9537ea6-e3de-44e2-9d6f-27aaa53e7dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:00.869785 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537ea6-e3de-44e2-9d6f-27aaa53e7dba service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:00.870124 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537ea6-e3de-44e2-9d6f-27aaa53e7dba service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:00.870473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537ea6-e3de-44e2-9d6f-27aaa53e7dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:00.872301 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c9537ea6-e3de-44e2-9d6f-27aaa53e7dba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:00.885110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9537ea6-e3de-44e2-9d6f-27aaa53e7dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:00.886687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9537ea6-e3de-44e2-9d6f-27aaa53e7dba service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:00.897335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1269/2540] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:05.608055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565ede1-f9d4-4aee-8f19-5587e4316a6e service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:05.619716 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565ede1-f9d4-4aee-8f19-5587e4316a6e service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:05.624534 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8780-38be-4bac-871e-4348ec7e7857 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:05.625115 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8780-38be-4bac-871e-4348ec7e7857 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:05.625387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8780-38be-4bac-871e-4348ec7e7857 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:05.625648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8780-38be-4bac-871e-4348ec7e7857 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:05.627403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-593a8780-38be-4bac-871e-4348ec7e7857 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:05.638653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a8780-38be-4bac-871e-4348ec7e7857 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:05.640216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a8780-38be-4bac-871e-4348ec7e7857 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:05.650925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1272/2541] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:10.892893 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:11.692647 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566fa53-65a3-4597-8ebf-26c08c93f39d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:11.693028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566fa53-65a3-4597-8ebf-26c08c93f39d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:11.693408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566fa53-65a3-4597-8ebf-26c08c93f39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:11.713404 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b566fa53-65a3-4597-8ebf-26c08c93f39d None None] MFA Rules not processed for user `f88df0c9fadc4135b04ad2a9412026ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:11.714920 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b566fa53-65a3-4597-8ebf-26c08c93f39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:11.727066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1270/2542] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:04:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:15.646220 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=17 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:21.708100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:05.049844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09366d17-fd90-4d6d-9076-c86b20d6907e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:05.050338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09366d17-fd90-4d6d-9076-c86b20d6907e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:05.050455 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09366d17-fd90-4d6d-9076-c86b20d6907e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:05.071422 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-09366d17-fd90-4d6d-9076-c86b20d6907e None None] MFA Rules not processed for user `f88df0c9fadc4135b04ad2a9412026ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:05.072676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-09366d17-fd90-4d6d-9076-c86b20d6907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:05.080448 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1273/2543] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:05:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:05.709022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566fa53-65a3-4597-8ebf-26c08c93f39d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:05.720983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566fa53-65a3-4597-8ebf-26c08c93f39d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:05.726538 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21cd10-5d9c-43ef-8e3b-fa1b01dae09b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:05.727282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21cd10-5d9c-43ef-8e3b-fa1b01dae09b service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:05.727554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21cd10-5d9c-43ef-8e3b-fa1b01dae09b service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:05.727817 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21cd10-5d9c-43ef-8e3b-fa1b01dae09b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:05.729576 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ef21cd10-5d9c-43ef-8e3b-fa1b01dae09b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:05.741214 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21cd10-5d9c-43ef-8e3b-fa1b01dae09b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:05.742811 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21cd10-5d9c-43ef-8e3b-fa1b01dae09b service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:05.753084 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1271/2544] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:05:10.054677 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09366d17-fd90-4d6d-9076-c86b20d6907e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:10.071110 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09366d17-fd90-4d6d-9076-c86b20d6907e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:10.075088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03266d69-7101-431b-86ed-453131d382c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:10.076425 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03266d69-7101-431b-86ed-453131d382c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:10.076884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03266d69-7101-431b-86ed-453131d382c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:10.077445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03266d69-7101-431b-86ed-453131d382c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:10.080485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-03266d69-7101-431b-86ed-453131d382c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:10.161978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03266d69-7101-431b-86ed-453131d382c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:10.163859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03266d69-7101-431b-86ed-453131d382c0 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:10.175513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1274/2545] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:05:12.802682 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21cd10-5d9c-43ef-8e3b-fa1b01dae09b service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:12.804306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ef21cd10-5d9c-43ef-8e3b-fa1b01dae09b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:12.821678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21cd10-5d9c-43ef-8e3b-fa1b01dae09b service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:12.827160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e68fdf-e43d-4eb4-a0c6-0b490ac1de53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:12.828051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e68fdf-e43d-4eb4-a0c6-0b490ac1de53 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:12.828327 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e68fdf-e43d-4eb4-a0c6-0b490ac1de53 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:12.828597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e68fdf-e43d-4eb4-a0c6-0b490ac1de53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:12.830289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a2e68fdf-e43d-4eb4-a0c6-0b490ac1de53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:12.847392 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e68fdf-e43d-4eb4-a0c6-0b490ac1de53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:12.849732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e68fdf-e43d-4eb4-a0c6-0b490ac1de53 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:12.865022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1272/2546] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:05:13.526362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03266d69-7101-431b-86ed-453131d382c0 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:13.527820 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-03266d69-7101-431b-86ed-453131d382c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:13.542151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03266d69-7101-431b-86ed-453131d382c0 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:13.547402 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2778ef-abfc-4473-8614-a1baae33e339 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:13.548004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2778ef-abfc-4473-8614-a1baae33e339 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:13.548285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2778ef-abfc-4473-8614-a1baae33e339 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:13.548556 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2778ef-abfc-4473-8614-a1baae33e339 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:13.550888 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1a2778ef-abfc-4473-8614-a1baae33e339 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:13.562501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2778ef-abfc-4473-8614-a1baae33e339 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:13.564116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2778ef-abfc-4473-8614-a1baae33e339 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:13.574176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1275/2547] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:05:16.646563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e68fdf-e43d-4eb4-a0c6-0b490ac1de53 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:16.648854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a2e68fdf-e43d-4eb4-a0c6-0b490ac1de53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:16.668092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e68fdf-e43d-4eb4-a0c6-0b490ac1de53 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:16.673341 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:16.674001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:16.674261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:16.674569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] PATH_INFO: `/v3/users/ab779a170d56400295f77401f847ab66` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:16.676270 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab779a170d56400295f77401f847ab66)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:16.678211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:16.741994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab779a170d56400295f77401f847ab66'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:16.754667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab779a170d56400295f77401f847ab66'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:16.761852 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab779a170d56400295f77401f847ab66'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:16.770331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab779a170d56400295f77401f847ab66'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:16.770961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab779a170d56400295f77401f847ab66'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:16.777136 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1273/2548] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:05:16 2022] DELETE /identity/v3/users/ab779a170d56400295f77401f847ab66 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:16.954295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2778ef-abfc-4473-8614-a1baae33e339 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:16.973796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2778ef-abfc-4473-8614-a1baae33e339 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:17.064803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:17.066005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:17.066480 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:17.067038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] PATH_INFO: `/v3/projects/153b36284a9145378f79fa1300b0dddf` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:17.068250 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=153b36284a9145378f79fa1300b0dddf)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:17.070144 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:17.122776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '153b36284a9145378f79fa1300b0dddf', 'request_id': 'req-dc502240-dfcb-4590-b848-ed2030edc53d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.130667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '153b36284a9145378f79fa1300b0dddf', 'request_id': 'req-dc502240-dfcb-4590-b848-ed2030edc53d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.137322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '153b36284a9145378f79fa1300b0dddf', 'request_id': 'req-dc502240-dfcb-4590-b848-ed2030edc53d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.150756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] The token cache is being invalidate because project 153b36284a9145378f79fa1300b0dddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:05:17.151142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.151824 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.153358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1276/2549] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:05:16 2022] DELETE /identity/v3/projects/153b36284a9145378f79fa1300b0dddf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:17.157508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:17.159776 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:17.174331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc55e7e-ecef-440d-bc5b-db39dcabd16f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:17.238755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8eca7f-a58e-432e-84ce-fb8a312253d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:17.239760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eca7f-a58e-432e-84ce-fb8a312253d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:17.240259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eca7f-a58e-432e-84ce-fb8a312253d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:17.240734 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eca7f-a58e-432e-84ce-fb8a312253d0 admin admin] PATH_INFO: `/v3/users/bcd845e09ba840cca21c640d9f5d9b36` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:17.242684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8eca7f-a58e-432e-84ce-fb8a312253d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd845e09ba840cca21c640d9f5d9b36)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:17.244863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8eca7f-a58e-432e-84ce-fb8a312253d0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:17.301624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6e8eca7f-a58e-432e-84ce-fb8a312253d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd845e09ba840cca21c640d9f5d9b36'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.303618 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:17.314999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6e8eca7f-a58e-432e-84ce-fb8a312253d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd845e09ba840cca21c640d9f5d9b36'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.323962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6e8eca7f-a58e-432e-84ce-fb8a312253d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd845e09ba840cca21c640d9f5d9b36'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.333066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6e8eca7f-a58e-432e-84ce-fb8a312253d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd845e09ba840cca21c640d9f5d9b36'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.333688 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6e8eca7f-a58e-432e-84ce-fb8a312253d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd845e09ba840cca21c640d9f5d9b36'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.340422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1274/2550] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:05:17 2022] DELETE /identity/v3/users/bcd845e09ba840cca21c640d9f5d9b36 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:05:17.547553 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:17.548988 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:17.558349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:17.562689 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc502240-dfcb-4590-b848-ed2030edc53d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:17.638095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:17.638748 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:17.639065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:17.639347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] PATH_INFO: `/v3/projects/14e7a970d6e1436c9743edbb8e755389` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:17.640599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e7a970d6e1436c9743edbb8e755389)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:17.642433 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:17.695407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e7a970d6e1436c9743edbb8e755389', 'request_id': 'req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.702792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e7a970d6e1436c9743edbb8e755389', 'request_id': 'req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.709566 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e7a970d6e1436c9743edbb8e755389', 'request_id': 'req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.726846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] The token cache is being invalidate because project 14e7a970d6e1436c9743edbb8e755389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:05:17.726846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.727595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:17.729068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1277/2551] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:05:17 2022] DELETE /identity/v3/projects/14e7a970d6e1436c9743edbb8e755389 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:27.336747 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:27.723345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:07.133062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d296-b7fa-493b-b207-c06f975e1679 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:07.133585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d296-b7fa-493b-b207-c06f975e1679 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:07.133585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d296-b7fa-493b-b207-c06f975e1679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:07.154490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1433d296-b7fa-493b-b207-c06f975e1679 None None] MFA Rules not processed for user `f88df0c9fadc4135b04ad2a9412026ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:07.155835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1433d296-b7fa-493b-b207-c06f975e1679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:07.233391 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1275/2552] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:07.437928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:07.439341 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:07.499831 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4d81e-4df9-4fe5-abfb-d1a8feeeb022 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:07.503570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d291d-6f9b-474f-bd2e-854bbd024fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:07.504290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d291d-6f9b-474f-bd2e-854bbd024fdd service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:07.504577 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d291d-6f9b-474f-bd2e-854bbd024fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:07.504847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d291d-6f9b-474f-bd2e-854bbd024fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:07.506603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-367d291d-6f9b-474f-bd2e-854bbd024fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:07.517126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d291d-6f9b-474f-bd2e-854bbd024fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:07.518587 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d291d-6f9b-474f-bd2e-854bbd024fdd service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:07.527277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1278/2553] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:06:07.971096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8b0b7-8572-44f1-8efe-eb386e326585 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:07.971362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8b0b7-8572-44f1-8efe-eb386e326585 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:07.971634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8b0b7-8572-44f1-8efe-eb386e326585 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:07.972967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1276/2554] 10.222.0.33 () {54 vars in 921 bytes} [Sun Sep 11 01:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:06:07.979468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ed2b0-1210-4874-ae42-45ff6573d567 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:07.983668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ed2b0-1210-4874-ae42-45ff6573d567 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:07.983956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ed2b0-1210-4874-ae42-45ff6573d567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:08.046754 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-977ed2b0-1210-4874-ae42-45ff6573d567 None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:08.047949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-977ed2b0-1210-4874-ae42-45ff6573d567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:08.120903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1279/2555] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:06:08.131825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8b0b7-8572-44f1-8efe-eb386e326585 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:08.133897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f9c8b0b7-8572-44f1-8efe-eb386e326585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:08.149401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8b0b7-8572-44f1-8efe-eb386e326585 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:08.154522 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acd770-c8c7-40e3-b658-57df8e9cf46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:08.155169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acd770-c8c7-40e3-b658-57df8e9cf46f service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:08.155442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acd770-c8c7-40e3-b658-57df8e9cf46f service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:08.155832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acd770-c8c7-40e3-b658-57df8e9cf46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:08.172058 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acd770-c8c7-40e3-b658-57df8e9cf46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:08.173845 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acd770-c8c7-40e3-b658-57df8e9cf46f service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:08.186775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1277/2556] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:06:16.125533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ed2b0-1210-4874-ae42-45ff6573d567 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:16.128027 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-977ed2b0-1210-4874-ae42-45ff6573d567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:16.142338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ed2b0-1210-4874-ae42-45ff6573d567 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:16.147879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133736c-1343-4008-846f-b2d56c5ee200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:16.148472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133736c-1343-4008-846f-b2d56c5ee200 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:16.148747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133736c-1343-4008-846f-b2d56c5ee200 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:16.149013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133736c-1343-4008-846f-b2d56c5ee200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:16.150685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0133736c-1343-4008-846f-b2d56c5ee200 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:16.160857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133736c-1343-4008-846f-b2d56c5ee200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:16.162446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133736c-1343-4008-846f-b2d56c5ee200 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:16.171269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1280/2557] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:06:17.681979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acd770-c8c7-40e3-b658-57df8e9cf46f service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:17.691021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acd770-c8c7-40e3-b658-57df8e9cf46f service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:17.694524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b36030-24d0-4b5e-8eb2-c4ad7c9d75bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:17.695139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b36030-24d0-4b5e-8eb2-c4ad7c9d75bb service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:17.695410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b36030-24d0-4b5e-8eb2-c4ad7c9d75bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:17.695673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b36030-24d0-4b5e-8eb2-c4ad7c9d75bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:17.697329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-84b36030-24d0-4b5e-8eb2-c4ad7c9d75bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:17.759320 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b36030-24d0-4b5e-8eb2-c4ad7c9d75bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:17.760686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b36030-24d0-4b5e-8eb2-c4ad7c9d75bb service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:17.770215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1278/2558] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:06:24.508882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb10fa0-a8b7-4829-8d9e-72c043e3be22 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:24.509308 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb10fa0-a8b7-4829-8d9e-72c043e3be22 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:24.509579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb10fa0-a8b7-4829-8d9e-72c043e3be22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:24.531362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4cb10fa0-a8b7-4829-8d9e-72c043e3be22 None None] MFA Rules not processed for user `f88df0c9fadc4135b04ad2a9412026ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:24.532598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4cb10fa0-a8b7-4829-8d9e-72c043e3be22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:24.539514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1281/2559] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:06:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:24.722087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b36030-24d0-4b5e-8eb2-c4ad7c9d75bb service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:24.732426 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b36030-24d0-4b5e-8eb2-c4ad7c9d75bb service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:24.736006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be9677-c008-484b-bb94-029f7657f700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:24.736607 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be9677-c008-484b-bb94-029f7657f700 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:24.736879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be9677-c008-484b-bb94-029f7657f700 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:24.737142 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be9677-c008-484b-bb94-029f7657f700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:24.738849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-82be9677-c008-484b-bb94-029f7657f700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:24.748169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be9677-c008-484b-bb94-029f7657f700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:24.749523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be9677-c008-484b-bb94-029f7657f700 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:24.757227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1279/2560] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:06:25.178151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38869756-adef-47b0-8ab3-497180fff1b7 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:25.178435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38869756-adef-47b0-8ab3-497180fff1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:25.178708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38869756-adef-47b0-8ab3-497180fff1b7 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:25.180118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1282/2561] 10.222.0.33 () {54 vars in 921 bytes} [Sun Sep 11 01:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:06:25.186354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee0572-eac3-4562-bd8a-e22035082ab8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:25.186645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee0572-eac3-4562-bd8a-e22035082ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:25.186950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee0572-eac3-4562-bd8a-e22035082ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:25.207708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-28ee0572-eac3-4562-bd8a-e22035082ab8 None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:25.209058 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-28ee0572-eac3-4562-bd8a-e22035082ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:25.219948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1280/2562] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:25.231162 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38869756-adef-47b0-8ab3-497180fff1b7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:25.242009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38869756-adef-47b0-8ab3-497180fff1b7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:25.245537 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defa3ef-fdb2-4e00-b133-74f6cd833124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:25.246668 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defa3ef-fdb2-4e00-b133-74f6cd833124 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:25.246972 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defa3ef-fdb2-4e00-b133-74f6cd833124 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:25.247237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defa3ef-fdb2-4e00-b133-74f6cd833124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:25.257077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defa3ef-fdb2-4e00-b133-74f6cd833124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:25.258475 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defa3ef-fdb2-4e00-b133-74f6cd833124 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:25.268911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1283/2563] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:06:35.201586 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=70 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:35.264362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=82 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:48.119106 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf669c09-c1f8-4cbc-befc-9c1171e0e3b6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:48.119576 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf669c09-c1f8-4cbc-befc-9c1171e0e3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:48.119670 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf669c09-c1f8-4cbc-befc-9c1171e0e3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:48.141082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bf669c09-c1f8-4cbc-befc-9c1171e0e3b6 None None] MFA Rules not processed for user `f88df0c9fadc4135b04ad2a9412026ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:48.142509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bf669c09-c1f8-4cbc-befc-9c1171e0e3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:48.151311 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1281/2564] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:06:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:58.134693 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:01.460598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defa3ef-fdb2-4e00-b133-74f6cd833124 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:01.471830 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defa3ef-fdb2-4e00-b133-74f6cd833124 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:01.479096 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e295b-3407-4d4b-8a7a-91fdbbc18f8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:01.481759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e295b-3407-4d4b-8a7a-91fdbbc18f8b service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:01.481759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e295b-3407-4d4b-8a7a-91fdbbc18f8b service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:01.481759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e295b-3407-4d4b-8a7a-91fdbbc18f8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:01.482506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-683e295b-3407-4d4b-8a7a-91fdbbc18f8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:01.495196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e295b-3407-4d4b-8a7a-91fdbbc18f8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:01.497386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e295b-3407-4d4b-8a7a-91fdbbc18f8b service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:01.508450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1284/2565] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:07:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:07:11.503471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:31.530344 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf669c09-c1f8-4cbc-befc-9c1171e0e3b6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:31.531887 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bf669c09-c1f8-4cbc-befc-9c1171e0e3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:31.602236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf669c09-c1f8-4cbc-befc-9c1171e0e3b6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:31.607227 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b287f-adcd-4d64-b1e2-962828f3ad7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:31.607833 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b287f-adcd-4d64-b1e2-962828f3ad7d service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:31.608107 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b287f-adcd-4d64-b1e2-962828f3ad7d service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:31.608374 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b287f-adcd-4d64-b1e2-962828f3ad7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:31.610080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6c0b287f-adcd-4d64-b1e2-962828f3ad7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:31.621583 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b287f-adcd-4d64-b1e2-962828f3ad7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:31.623199 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b287f-adcd-4d64-b1e2-962828f3ad7d service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:31.633372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1282/2566] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:07:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:07:41.629306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=32 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:53.322305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24bfeb-ae60-42ea-bc6b-db1dea55c28e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:53.322853 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24bfeb-ae60-42ea-bc6b-db1dea55c28e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:53.322932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24bfeb-ae60-42ea-bc6b-db1dea55c28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:53.341752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-fa24bfeb-ae60-42ea-bc6b-db1dea55c28e None None] MFA Rules not processed for user `f88df0c9fadc4135b04ad2a9412026ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:53.342879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fa24bfeb-ae60-42ea-bc6b-db1dea55c28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:53.350811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1285/2567] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:07:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:03.336461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:44.244021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b287f-adcd-4d64-b1e2-962828f3ad7d service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:44.253420 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b287f-adcd-4d64-b1e2-962828f3ad7d service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:44.256978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a15e4a-3832-48e3-b0e6-256e130414ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:44.257572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a15e4a-3832-48e3-b0e6-256e130414ce service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:44.257870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a15e4a-3832-48e3-b0e6-256e130414ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:44.258138 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a15e4a-3832-48e3-b0e6-256e130414ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:44.259872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-67a15e4a-3832-48e3-b0e6-256e130414ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:44.269653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a15e4a-3832-48e3-b0e6-256e130414ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:44.271178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a15e4a-3832-48e3-b0e6-256e130414ce service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:44.279012 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1283/2568] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:09:54.275432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:44.894344 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24bfeb-ae60-42ea-bc6b-db1dea55c28e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:44.896388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fa24bfeb-ae60-42ea-bc6b-db1dea55c28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:44.919011 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24bfeb-ae60-42ea-bc6b-db1dea55c28e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:44.924457 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee5e0d-7756-4813-9f0b-f844c76c23b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:44.925239 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5e0d-7756-4813-9f0b-f844c76c23b9 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:44.925359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5e0d-7756-4813-9f0b-f844c76c23b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:44.925591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5e0d-7756-4813-9f0b-f844c76c23b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:44.927661 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-beee5e0d-7756-4813-9f0b-f844c76c23b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:44.940840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee5e0d-7756-4813-9f0b-f844c76c23b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:44.942476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee5e0d-7756-4813-9f0b-f844c76c23b9 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:44.955677 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1286/2569] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:45.100500 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a15e4a-3832-48e3-b0e6-256e130414ce service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:45.109251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a15e4a-3832-48e3-b0e6-256e130414ce service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:45.112870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb199f30-fb87-43d4-811e-505f4c9e7316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:45.113472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb199f30-fb87-43d4-811e-505f4c9e7316 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:45.113786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb199f30-fb87-43d4-811e-505f4c9e7316 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:45.114224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb199f30-fb87-43d4-811e-505f4c9e7316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:45.115953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fb199f30-fb87-43d4-811e-505f4c9e7316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:45.129690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb199f30-fb87-43d4-811e-505f4c9e7316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:45.131145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb199f30-fb87-43d4-811e-505f4c9e7316 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:45.142072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1284/2570] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:46.348689 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee5e0d-7756-4813-9f0b-f844c76c23b9 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:46.359801 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee5e0d-7756-4813-9f0b-f844c76c23b9 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:46.363709 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1909a2-eb0d-4acb-af02-4858010a889a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:46.364418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1909a2-eb0d-4acb-af02-4858010a889a service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:46.364788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1909a2-eb0d-4acb-af02-4858010a889a service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:46.365175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1909a2-eb0d-4acb-af02-4858010a889a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:46.367030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3e1909a2-eb0d-4acb-af02-4858010a889a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:46.380709 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1909a2-eb0d-4acb-af02-4858010a889a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:46.382194 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1909a2-eb0d-4acb-af02-4858010a889a service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:46.395744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1287/2571] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:10:52.056972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb199f30-fb87-43d4-811e-505f4c9e7316 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:52.067923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb199f30-fb87-43d4-811e-505f4c9e7316 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:52.072931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b726102-a635-49e7-ac42-a9e349e5f193 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:52.073466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726102-a635-49e7-ac42-a9e349e5f193 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:52.073739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726102-a635-49e7-ac42-a9e349e5f193 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:52.074005 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726102-a635-49e7-ac42-a9e349e5f193 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:52.075711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6b726102-a635-49e7-ac42-a9e349e5f193 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:52.087437 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b726102-a635-49e7-ac42-a9e349e5f193 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:52.089013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b726102-a635-49e7-ac42-a9e349e5f193 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:52.099838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1285/2572] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:56.388280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=12 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:57.885065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82592518-1617-4b78-902d-88bd1673df5d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:57.886043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82592518-1617-4b78-902d-88bd1673df5d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:57.886321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82592518-1617-4b78-902d-88bd1673df5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:57.905723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-82592518-1617-4b78-902d-88bd1673df5d None None] MFA Rules not processed for user `f88df0c9fadc4135b04ad2a9412026ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:57.906952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-82592518-1617-4b78-902d-88bd1673df5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:57.914467 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1288/2573] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:58.618013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b726102-a635-49e7-ac42-a9e349e5f193 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:58.629595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b726102-a635-49e7-ac42-a9e349e5f193 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:58.635252 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013493e-3eb7-4d9e-a6d7-7863c54c2491 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:58.636264 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013493e-3eb7-4d9e-a6d7-7863c54c2491 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:58.636696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013493e-3eb7-4d9e-a6d7-7863c54c2491 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:58.637633 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013493e-3eb7-4d9e-a6d7-7863c54c2491 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:58.639838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b013493e-3eb7-4d9e-a6d7-7863c54c2491 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:58.652726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013493e-3eb7-4d9e-a6d7-7863c54c2491 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:58.654586 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013493e-3eb7-4d9e-a6d7-7863c54c2491 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:58.667223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1286/2574] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:06.666076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82592518-1617-4b78-902d-88bd1673df5d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:06.680921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82592518-1617-4b78-902d-88bd1673df5d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:06.686199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa765ef0-a981-4851-9743-a17efbc9fd98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:06.686820 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa765ef0-a981-4851-9743-a17efbc9fd98 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:06.687093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa765ef0-a981-4851-9743-a17efbc9fd98 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:06.687356 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa765ef0-a981-4851-9743-a17efbc9fd98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:06.689084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-aa765ef0-a981-4851-9743-a17efbc9fd98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:06.700967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa765ef0-a981-4851-9743-a17efbc9fd98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:06.702519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa765ef0-a981-4851-9743-a17efbc9fd98 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:06.713569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1289/2575] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:08.661686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=18 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:12.296323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6350-291d-47e3-8de7-293300da65fa None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:12.297564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6350-291d-47e3-8de7-293300da65fa None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:12.297564 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6350-291d-47e3-8de7-293300da65fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:12.317363 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-559a6350-291d-47e3-8de7-293300da65fa None None] MFA Rules not processed for user `f88df0c9fadc4135b04ad2a9412026ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:12.318544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-559a6350-291d-47e3-8de7-293300da65fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:12.326356 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1287/2576] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:11:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:15.117835 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa765ef0-a981-4851-9743-a17efbc9fd98 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:15.153390 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa765ef0-a981-4851-9743-a17efbc9fd98 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:15.159444 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504deb9-fbeb-43fb-8816-f02364b33907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:15.160107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504deb9-fbeb-43fb-8816-f02364b33907 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:15.161047 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504deb9-fbeb-43fb-8816-f02364b33907 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:15.161327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504deb9-fbeb-43fb-8816-f02364b33907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:15.169949 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504deb9-fbeb-43fb-8816-f02364b33907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:15.172198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504deb9-fbeb-43fb-8816-f02364b33907 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:15.198409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1290/2577] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:22.312304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:22.619297 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a6350-291d-47e3-8de7-293300da65fa None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:22.639542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a6350-291d-47e3-8de7-293300da65fa None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:22.643047 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982d565-8dcc-49a1-af09-25dc537f3981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:22.643804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982d565-8dcc-49a1-af09-25dc537f3981 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:22.644076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982d565-8dcc-49a1-af09-25dc537f3981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:22.644339 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982d565-8dcc-49a1-af09-25dc537f3981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:22.652923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982d565-8dcc-49a1-af09-25dc537f3981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:22.654603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982d565-8dcc-49a1-af09-25dc537f3981 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:22.681458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1288/2578] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:25.195792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=33 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:32.679088 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=18 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:19.169557 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504deb9-fbeb-43fb-8816-f02364b33907 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:19.205122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504deb9-fbeb-43fb-8816-f02364b33907 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:19.210151 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe97ca-a3f7-4760-87ab-452d6483aee7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:19.210770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe97ca-a3f7-4760-87ab-452d6483aee7 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:19.211053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe97ca-a3f7-4760-87ab-452d6483aee7 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:19.211317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe97ca-a3f7-4760-87ab-452d6483aee7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:19.214105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fefe97ca-a3f7-4760-87ab-452d6483aee7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:19.258141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe97ca-a3f7-4760-87ab-452d6483aee7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:19.259783 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe97ca-a3f7-4760-87ab-452d6483aee7 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:19.270194 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1291/2579] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:12:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:12:25.085755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0262ad-1f7e-4ea6-83c6-33cbd8fc4c8f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:25.086232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0262ad-1f7e-4ea6-83c6-33cbd8fc4c8f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:25.086335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0262ad-1f7e-4ea6-83c6-33cbd8fc4c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:25.126538 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-af0262ad-1f7e-4ea6-83c6-33cbd8fc4c8f None None] MFA Rules not processed for user `f88df0c9fadc4135b04ad2a9412026ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:12:25.128130 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-af0262ad-1f7e-4ea6-83c6-33cbd8fc4c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:25.136095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1289/2580] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:12:25.466886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe97ca-a3f7-4760-87ab-452d6483aee7 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:25.476839 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe97ca-a3f7-4760-87ab-452d6483aee7 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:25.480840 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927cc0b-89f1-4812-a07a-5f6d4a7e7b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:25.481502 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927cc0b-89f1-4812-a07a-5f6d4a7e7b26 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:25.482116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927cc0b-89f1-4812-a07a-5f6d4a7e7b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:25.482471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927cc0b-89f1-4812-a07a-5f6d4a7e7b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:25.489901 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927cc0b-89f1-4812-a07a-5f6d4a7e7b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:25.491448 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927cc0b-89f1-4812-a07a-5f6d4a7e7b26 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:25.499510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1292/2581] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:12:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:12:34.807739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0262ad-1f7e-4ea6-83c6-33cbd8fc4c8f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:34.819523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0262ad-1f7e-4ea6-83c6-33cbd8fc4c8f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:34.825434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bf1b9-ff2e-4218-b4d6-6b7b243e6c3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:34.826026 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bf1b9-ff2e-4218-b4d6-6b7b243e6c3a service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:34.826305 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bf1b9-ff2e-4218-b4d6-6b7b243e6c3a service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:34.826573 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bf1b9-ff2e-4218-b4d6-6b7b243e6c3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:34.834949 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bf1b9-ff2e-4218-b4d6-6b7b243e6c3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:34.836566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bf1b9-ff2e-4218-b4d6-6b7b243e6c3a service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:34.846278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1290/2582] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:12:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:12:35.495849 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=31 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:37.298192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927cc0b-89f1-4812-a07a-5f6d4a7e7b26 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:37.313015 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927cc0b-89f1-4812-a07a-5f6d4a7e7b26 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:37.318547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e159c2-7055-44a4-8be7-c41bc16ee024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:37.319180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e159c2-7055-44a4-8be7-c41bc16ee024 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:37.320021 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e159c2-7055-44a4-8be7-c41bc16ee024 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:37.320450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e159c2-7055-44a4-8be7-c41bc16ee024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:37.334430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e159c2-7055-44a4-8be7-c41bc16ee024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:37.336889 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e159c2-7055-44a4-8be7-c41bc16ee024 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:37.352453 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1293/2583] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:12:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:12:44.842127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=17 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:47.345576 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:19.810295 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bf1b9-ff2e-4218-b4d6-6b7b243e6c3a service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:19.812719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cf4bf1b9-ff2e-4218-b4d6-6b7b243e6c3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:19.917424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bf1b9-ff2e-4218-b4d6-6b7b243e6c3a service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:19.922094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:19.922754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:19.923091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:19.923346 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] PATH_INFO: `/v3/users/f88df0c9fadc4135b04ad2a9412026ec` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:19.925150 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88df0c9fadc4135b04ad2a9412026ec)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:19.927160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:19.974162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88df0c9fadc4135b04ad2a9412026ec'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:19.987507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88df0c9fadc4135b04ad2a9412026ec'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:19.994832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88df0c9fadc4135b04ad2a9412026ec'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:20.003350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88df0c9fadc4135b04ad2a9412026ec'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:20.004015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88df0c9fadc4135b04ad2a9412026ec'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:20.010473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1291/2584] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:19 2022] DELETE /identity/v3/users/f88df0c9fadc4135b04ad2a9412026ec => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:20.015116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6551cee-98b3-498c-869a-30098c59ee25 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:20.015592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6551cee-98b3-498c-869a-30098c59ee25 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:20.015803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6551cee-98b3-498c-869a-30098c59ee25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:20.045606 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e6551cee-98b3-498c-869a-30098c59ee25 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:20.046992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e6551cee-98b3-498c-869a-30098c59ee25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:20.113193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1294/2585] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:20.125848 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:20.127303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:20.185646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:20.196463 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbace2-ffa4-43b8-be61-e2307f0fc576 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:20.200432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac128551-45bc-4a17-9603-bb054275cfe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:20.201051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128551-45bc-4a17-9603-bb054275cfe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:20.201326 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128551-45bc-4a17-9603-bb054275cfe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:20.201592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128551-45bc-4a17-9603-bb054275cfe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:20.210880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac128551-45bc-4a17-9603-bb054275cfe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:20.212286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac128551-45bc-4a17-9603-bb054275cfe6 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:20.221926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1292/2586] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:20.395000 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6551cee-98b3-498c-869a-30098c59ee25 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:20.396440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e6551cee-98b3-498c-869a-30098c59ee25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:20.414210 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6551cee-98b3-498c-869a-30098c59ee25 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:20.418837 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:20.419468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:20.419746 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:20.420014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] PATH_INFO: `/v3/projects/582512e6ad9c4fa58c9c34d4d49fdd05` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:20.421336 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=582512e6ad9c4fa58c9c34d4d49fdd05)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:20.425878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:20.483552 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '582512e6ad9c4fa58c9c34d4d49fdd05', 'request_id': 'req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:20.492832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '582512e6ad9c4fa58c9c34d4d49fdd05', 'request_id': 'req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:20.500476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '582512e6ad9c4fa58c9c34d4d49fdd05', 'request_id': 'req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:20.513579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] The token cache is being invalidate because project 582512e6ad9c4fa58c9c34d4d49fdd05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:20.513788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:20.514945 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:20.516181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1295/2587] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:20 2022] DELETE /identity/v3/projects/582512e6ad9c4fa58c9c34d4d49fdd05 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:20.520668 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac128551-45bc-4a17-9603-bb054275cfe6 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:20.530439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac128551-45bc-4a17-9603-bb054275cfe6 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:20.594172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3a4d5-6cdb-4640-82cf-39cf275a480e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:20.594861 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3a4d5-6cdb-4640-82cf-39cf275a480e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:20.595139 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3a4d5-6cdb-4640-82cf-39cf275a480e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:20.595410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3a4d5-6cdb-4640-82cf-39cf275a480e admin admin] PATH_INFO: `/v3/users/c9ecb692ba2641ef9b025394bfc938ab` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:20.612539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3a4d5-6cdb-4640-82cf-39cf275a480e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ecb692ba2641ef9b025394bfc938ab)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:20.614462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3a4d5-6cdb-4640-82cf-39cf275a480e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:20.658048 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d9c3a4d5-6cdb-4640-82cf-39cf275a480e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ecb692ba2641ef9b025394bfc938ab'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:20.670022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d9c3a4d5-6cdb-4640-82cf-39cf275a480e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ecb692ba2641ef9b025394bfc938ab'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:20.677046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d9c3a4d5-6cdb-4640-82cf-39cf275a480e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ecb692ba2641ef9b025394bfc938ab'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:20.684921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d9c3a4d5-6cdb-4640-82cf-39cf275a480e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ecb692ba2641ef9b025394bfc938ab'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:20.685551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d9c3a4d5-6cdb-4640-82cf-39cf275a480e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ecb692ba2641ef9b025394bfc938ab'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:20.691910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1293/2588] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:20 2022] DELETE /identity/v3/users/c9ecb692ba2641ef9b025394bfc938ab => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:20.962762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:20.964294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:20.978873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5353289-bf5e-4e6c-bc10-297e25f0cf3e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:21.037443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9646c33-de3b-4ad6-85dc-d6efbad75617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:21.038062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9646c33-de3b-4ad6-85dc-d6efbad75617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:21.038247 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9646c33-de3b-4ad6-85dc-d6efbad75617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:21.038515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9646c33-de3b-4ad6-85dc-d6efbad75617 admin admin] PATH_INFO: `/v3/projects/56b648e29839413aa5bbfb2933312f6d` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:21.039641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9646c33-de3b-4ad6-85dc-d6efbad75617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b648e29839413aa5bbfb2933312f6d)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:21.041503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9646c33-de3b-4ad6-85dc-d6efbad75617 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:21.062667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:21.089059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b9646c33-de3b-4ad6-85dc-d6efbad75617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b648e29839413aa5bbfb2933312f6d', 'request_id': 'req-b9646c33-de3b-4ad6-85dc-d6efbad75617'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:21.095147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b9646c33-de3b-4ad6-85dc-d6efbad75617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b648e29839413aa5bbfb2933312f6d', 'request_id': 'req-b9646c33-de3b-4ad6-85dc-d6efbad75617'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:21.100513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b9646c33-de3b-4ad6-85dc-d6efbad75617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b648e29839413aa5bbfb2933312f6d', 'request_id': 'req-b9646c33-de3b-4ad6-85dc-d6efbad75617'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:21.112484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b9646c33-de3b-4ad6-85dc-d6efbad75617 admin admin] The token cache is being invalidate because project 56b648e29839413aa5bbfb2933312f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:21.112768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b9646c33-de3b-4ad6-85dc-d6efbad75617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:21.113388 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b9646c33-de3b-4ad6-85dc-d6efbad75617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:21.114871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1296/2589] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:20 2022] DELETE /identity/v3/projects/56b648e29839413aa5bbfb2933312f6d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:26.783445 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44ba0-ed92-4623-87d5-0c70788040f6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:26.784007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44ba0-ed92-4623-87d5-0c70788040f6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:26.784007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44ba0-ed92-4623-87d5-0c70788040f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:26.831831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-21c44ba0-ed92-4623-87d5-0c70788040f6 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:26.833008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-21c44ba0-ed92-4623-87d5-0c70788040f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:26.856446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:26.891707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1294/2590] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:26.901294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613250bc-a612-46e4-b990-93049030ca28 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:26.901750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613250bc-a612-46e4-b990-93049030ca28 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:26.901836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613250bc-a612-46e4-b990-93049030ca28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:26.921250 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-613250bc-a612-46e4-b990-93049030ca28 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:26.922418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-613250bc-a612-46e4-b990-93049030ca28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:26.930027 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1297/2591] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:13:26.934595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c44ba0-ed92-4623-87d5-0c70788040f6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:26.948771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c44ba0-ed92-4623-87d5-0c70788040f6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:26.959379 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52da7a-fcbc-498f-ac83-727d03295a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:26.959989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52da7a-fcbc-498f-ac83-727d03295a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:26.960268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52da7a-fcbc-498f-ac83-727d03295a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:26.960541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52da7a-fcbc-498f-ac83-727d03295a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:26.961185 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52da7a-fcbc-498f-ac83-727d03295a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:26.961486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52da7a-fcbc-498f-ac83-727d03295a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:26.963179 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52da7a-fcbc-498f-ac83-727d03295a2f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:26.975565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1295/2592] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:26.983613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613250bc-a612-46e4-b990-93049030ca28 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:26.992555 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613250bc-a612-46e4-b990-93049030ca28 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:26.997099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46697-db11-4c7f-b163-8c33318cdd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:26.997684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46697-db11-4c7f-b163-8c33318cdd13 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:26.997963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46697-db11-4c7f-b163-8c33318cdd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:26.998232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46697-db11-4c7f-b163-8c33318cdd13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:26.998897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf46697-db11-4c7f-b163-8c33318cdd13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.000801 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf46697-db11-4c7f-b163-8c33318cdd13 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.036808 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1298/2593] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:26 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:27.040968 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52da7a-fcbc-498f-ac83-727d03295a2f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.051132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52da7a-fcbc-498f-ac83-727d03295a2f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:27.107412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8546eb-717a-4c1d-a794-7fcbb396ca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:27.108004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8546eb-717a-4c1d-a794-7fcbb396ca7c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.108279 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8546eb-717a-4c1d-a794-7fcbb396ca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.108547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8546eb-717a-4c1d-a794-7fcbb396ca7c admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.109159 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8546eb-717a-4c1d-a794-7fcbb396ca7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.111152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8546eb-717a-4c1d-a794-7fcbb396ca7c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.132022 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1296/2594] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:27 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:27.136120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46697-db11-4c7f-b163-8c33318cdd13 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.146715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46697-db11-4c7f-b163-8c33318cdd13 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:27.151305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47f9fb-8d5d-4f3a-b0e6-2552b36b0836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:27.151894 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47f9fb-8d5d-4f3a-b0e6-2552b36b0836 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.152194 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47f9fb-8d5d-4f3a-b0e6-2552b36b0836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.152448 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47f9fb-8d5d-4f3a-b0e6-2552b36b0836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.153084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47f9fb-8d5d-4f3a-b0e6-2552b36b0836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.155025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47f9fb-8d5d-4f3a-b0e6-2552b36b0836 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.165382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1299/2595] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:27.169224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8546eb-717a-4c1d-a794-7fcbb396ca7c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.178972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8546eb-717a-4c1d-a794-7fcbb396ca7c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:27.183501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b74d9-2fdf-42d7-af17-4c9bfb454b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:27.184080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b74d9-2fdf-42d7-af17-4c9bfb454b21 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.184353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b74d9-2fdf-42d7-af17-4c9bfb454b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.184618 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b74d9-2fdf-42d7-af17-4c9bfb454b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.185245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b74d9-2fdf-42d7-af17-4c9bfb454b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.186847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b74d9-2fdf-42d7-af17-4c9bfb454b21 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.197899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1297/2596] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:27.201773 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47f9fb-8d5d-4f3a-b0e6-2552b36b0836 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.212047 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47f9fb-8d5d-4f3a-b0e6-2552b36b0836 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:27.216647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28557b3-2e8c-45b3-b307-8bcfcbcf7132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:27.217277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28557b3-2e8c-45b3-b307-8bcfcbcf7132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.217558 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28557b3-2e8c-45b3-b307-8bcfcbcf7132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.217832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28557b3-2e8c-45b3-b307-8bcfcbcf7132 admin admin] PATH_INFO: `/v3/projects/e2f436b7cc684ad284ef0d6e98048938/users/726ac85ac01844e5882f81555379718c/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.232111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28557b3-2e8c-45b3-b307-8bcfcbcf7132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f436b7cc684ad284ef0d6e98048938, user_id=726ac85ac01844e5882f81555379718c, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.234760 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28557b3-2e8c-45b3-b307-8bcfcbcf7132 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.248764 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1300/2597] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:27 2022] PUT /identity/v3/projects/e2f436b7cc684ad284ef0d6e98048938/users/726ac85ac01844e5882f81555379718c/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:13:27.265443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259b57-84f7-42bd-b42f-b91512363909 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.265755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259b57-84f7-42bd-b42f-b91512363909 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.266128 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259b57-84f7-42bd-b42f-b91512363909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.299855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-de259b57-84f7-42bd-b42f-b91512363909 None None] MFA Rules not processed for user `726ac85ac01844e5882f81555379718c`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:27.301376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-de259b57-84f7-42bd-b42f-b91512363909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:27.377895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1298/2598] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:27.382418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28557b3-2e8c-45b3-b307-8bcfcbcf7132 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.442639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28557b3-2e8c-45b3-b307-8bcfcbcf7132 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:27.447565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dffa0b-6717-48de-87a3-068c2eeb1de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:27.448160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dffa0b-6717-48de-87a3-068c2eeb1de0 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.448435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dffa0b-6717-48de-87a3-068c2eeb1de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.448701 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dffa0b-6717-48de-87a3-068c2eeb1de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.449333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dffa0b-6717-48de-87a3-068c2eeb1de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.451268 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dffa0b-6717-48de-87a3-068c2eeb1de0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.476956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1301/2599] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:27 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:27.481091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de259b57-84f7-42bd-b42f-b91512363909 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.491583 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de259b57-84f7-42bd-b42f-b91512363909 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:27.511572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:27.549263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a046c79-1d93-40f6-ba30-c6942e917198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:27.549910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a046c79-1d93-40f6-ba30-c6942e917198 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.550133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a046c79-1d93-40f6-ba30-c6942e917198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.550401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a046c79-1d93-40f6-ba30-c6942e917198 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.551076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a046c79-1d93-40f6-ba30-c6942e917198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.552975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a046c79-1d93-40f6-ba30-c6942e917198 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.573642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1299/2600] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:27 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:27.577567 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dffa0b-6717-48de-87a3-068c2eeb1de0 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.587587 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dffa0b-6717-48de-87a3-068c2eeb1de0 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:27.592185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe105b-3b32-43c9-9b22-896f7b53f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:27.592771 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe105b-3b32-43c9-9b22-896f7b53f6da admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.593049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe105b-3b32-43c9-9b22-896f7b53f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.593320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe105b-3b32-43c9-9b22-896f7b53f6da admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.593956 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe105b-3b32-43c9-9b22-896f7b53f6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.595596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe105b-3b32-43c9-9b22-896f7b53f6da admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.605770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1302/2601] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:27.609621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a046c79-1d93-40f6-ba30-c6942e917198 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.619852 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a046c79-1d93-40f6-ba30-c6942e917198 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:27.624618 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea3b1c-6d1f-40d3-8464-228fb109b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:27.625259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea3b1c-6d1f-40d3-8464-228fb109b375 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.625533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea3b1c-6d1f-40d3-8464-228fb109b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.625801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea3b1c-6d1f-40d3-8464-228fb109b375 admin admin] PATH_INFO: `/v3/projects/602c738656944703be6e7b0d9086918e/users/87c8b4a4bbef4ce5a91665d8b86a48f2/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.640748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea3b1c-6d1f-40d3-8464-228fb109b375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602c738656944703be6e7b0d9086918e, user_id=87c8b4a4bbef4ce5a91665d8b86a48f2, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.643412 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea3b1c-6d1f-40d3-8464-228fb109b375 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.655823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1300/2602] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:27 2022] PUT /identity/v3/projects/602c738656944703be6e7b0d9086918e/users/87c8b4a4bbef4ce5a91665d8b86a48f2/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:27.659596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe105b-3b32-43c9-9b22-896f7b53f6da admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.669237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe105b-3b32-43c9-9b22-896f7b53f6da admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:27.674337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:27.725680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da5a58-28c3-4d35-b6a9-90fef0101793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:27.726263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da5a58-28c3-4d35-b6a9-90fef0101793 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.726541 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da5a58-28c3-4d35-b6a9-90fef0101793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.726838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da5a58-28c3-4d35-b6a9-90fef0101793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.727462 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da5a58-28c3-4d35-b6a9-90fef0101793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.729024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da5a58-28c3-4d35-b6a9-90fef0101793 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.738915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1303/2603] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:27.743079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea3b1c-6d1f-40d3-8464-228fb109b375 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.753519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea3b1c-6d1f-40d3-8464-228fb109b375 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:27.758051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19894aa3-9ba7-4295-9ad3-a36fd52eb1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:27.758683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19894aa3-9ba7-4295-9ad3-a36fd52eb1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.758984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19894aa3-9ba7-4295-9ad3-a36fd52eb1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.759251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19894aa3-9ba7-4295-9ad3-a36fd52eb1fd admin admin] PATH_INFO: `/v3/projects/602c738656944703be6e7b0d9086918e/users/87c8b4a4bbef4ce5a91665d8b86a48f2/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.761173 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19894aa3-9ba7-4295-9ad3-a36fd52eb1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=602c738656944703be6e7b0d9086918e, user_id=87c8b4a4bbef4ce5a91665d8b86a48f2, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.763827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19894aa3-9ba7-4295-9ad3-a36fd52eb1fd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.773675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1301/2604] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:27 2022] PUT /identity/v3/projects/602c738656944703be6e7b0d9086918e/users/87c8b4a4bbef4ce5a91665d8b86a48f2/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:13:27.783419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d053f3-99ca-4576-b520-95f1108b4149 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.783733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d053f3-99ca-4576-b520-95f1108b4149 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.784031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d053f3-99ca-4576-b520-95f1108b4149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.811163 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-89d053f3-99ca-4576-b520-95f1108b4149 None None] MFA Rules not processed for user `87c8b4a4bbef4ce5a91665d8b86a48f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:27.812282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-89d053f3-99ca-4576-b520-95f1108b4149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:27.880276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1304/2605] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:13:27.894464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fe963-04a5-469e-805a-c3a3010f0f61 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.895051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fe963-04a5-469e-805a-c3a3010f0f61 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.895051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fe963-04a5-469e-805a-c3a3010f0f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.916092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8d9fe963-04a5-469e-805a-c3a3010f0f61 None None] MFA Rules not processed for user `726ac85ac01844e5882f81555379718c`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:27.917302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8d9fe963-04a5-469e-805a-c3a3010f0f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:27.974148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1302/2606] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:27.987964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d053f3-99ca-4576-b520-95f1108b4149 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.989649 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-89d053f3-99ca-4576-b520-95f1108b4149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:28.085483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:28.089587 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d053f3-99ca-4576-b520-95f1108b4149 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:28.096393 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f641bbb-12e6-4adb-8106-a78a7283895a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:28.096992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f641bbb-12e6-4adb-8106-a78a7283895a service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:28.097294 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f641bbb-12e6-4adb-8106-a78a7283895a service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:28.097565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f641bbb-12e6-4adb-8106-a78a7283895a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:28.105176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f641bbb-12e6-4adb-8106-a78a7283895a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:28.106745 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f641bbb-12e6-4adb-8106-a78a7283895a service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:28.115861 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1305/2607] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:36.836729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fe963-04a5-469e-805a-c3a3010f0f61 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:36.838204 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8d9fe963-04a5-469e-805a-c3a3010f0f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:36.853826 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fe963-04a5-469e-805a-c3a3010f0f61 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:36.859363 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c46e0-bbd6-4eec-9569-afac885781ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:36.860495 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c46e0-bbd6-4eec-9569-afac885781ba service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:36.860771 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c46e0-bbd6-4eec-9569-afac885781ba service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:36.861037 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c46e0-bbd6-4eec-9569-afac885781ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:36.869007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c46e0-bbd6-4eec-9569-afac885781ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:36.870574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c46e0-bbd6-4eec-9569-afac885781ba service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:36.880733 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1303/2608] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:36 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:36.895603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522442f-c5b1-4dbb-b36c-9a5f36105b6f None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:36.896021 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522442f-c5b1-4dbb-b36c-9a5f36105b6f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:36.896130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522442f-c5b1-4dbb-b36c-9a5f36105b6f None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:36.897507 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1306/2609] 10.222.0.33 () {54 vars in 912 bytes} [Sun Sep 11 01:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:36.902040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c46e0-bbd6-4eec-9569-afac885781ba service nova] Authenticating service token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:36.913363 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-841c46e0-bbd6-4eec-9569-afac885781ba service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 11 01:13:36.913595 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c46e0-bbd6-4eec-9569-afac885781ba service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:36.921662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c46e0-bbd6-4eec-9569-afac885781ba service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:36.926684 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9723e7-311d-479b-bf39-04435dc609e6 tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87c8b4a4bbef4ce5a91665d8b86a48f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602c738656944703be6e7b0d9086918e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:36.927303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9723e7-311d-479b-bf39-04435dc609e6 tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:36.927579 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9723e7-311d-479b-bf39-04435dc609e6 tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:36.927841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9723e7-311d-479b-bf39-04435dc609e6 tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] PATH_INFO: `/v3/projects/602c738656944703be6e7b0d9086918e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:36.928946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9723e7-311d-479b-bf39-04435dc609e6 tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] RBAC: Authorizing `identity:get_project(project_id=602c738656944703be6e7b0d9086918e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:36.930683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9723e7-311d-479b-bf39-04435dc609e6 tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:36.932271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1304/2610] 10.222.0.33 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:36 2022] GET /identity/v3/projects/602c738656944703be6e7b0d9086918e => generated 389 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:13:37.273240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c51f3-1508-459c-b76b-fa72034cc695 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:37.273521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c51f3-1508-459c-b76b-fa72034cc695 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:37.273814 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c51f3-1508-459c-b76b-fa72034cc695 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:37.275153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1307/2611] 10.222.0.33 () {54 vars in 912 bytes} [Sun Sep 11 01:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:37.279828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9723e7-311d-479b-bf39-04435dc609e6 tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] Authenticating service token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:37.292921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9723e7-311d-479b-bf39-04435dc609e6 tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:37.301852 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9723e7-311d-479b-bf39-04435dc609e6 tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:37.306266 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dc006-f697-4e11-8c0a-fc1ac3966c1d tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87c8b4a4bbef4ce5a91665d8b86a48f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602c738656944703be6e7b0d9086918e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:37.306905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dc006-f697-4e11-8c0a-fc1ac3966c1d tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:37.307182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dc006-f697-4e11-8c0a-fc1ac3966c1d tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:37.307449 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dc006-f697-4e11-8c0a-fc1ac3966c1d tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] PATH_INFO: `/v3/projects/602c738656944703be6e7b0d9086918e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:37.308559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dc006-f697-4e11-8c0a-fc1ac3966c1d tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] RBAC: Authorizing `identity:get_project(project_id=602c738656944703be6e7b0d9086918e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:37.310319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dc006-f697-4e11-8c0a-fc1ac3966c1d tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:37.312101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1305/2612] 10.222.0.33 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:37 2022] GET /identity/v3/projects/602c738656944703be6e7b0d9086918e => generated 389 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:13:37.486662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c51f3-1508-459c-b76b-fa72034cc695 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:37.488408 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-252c51f3-1508-459c-b76b-fa72034cc695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:37.546262 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c51f3-1508-459c-b76b-fa72034cc695 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:37.549771 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f154a2-6bf9-4695-be42-4f99fbc2abf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:37.550358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f154a2-6bf9-4695-be42-4f99fbc2abf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:37.550633 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f154a2-6bf9-4695-be42-4f99fbc2abf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:37.550930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f154a2-6bf9-4695-be42-4f99fbc2abf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:37.552603 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-41f154a2-6bf9-4695-be42-4f99fbc2abf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:37.561786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f154a2-6bf9-4695-be42-4f99fbc2abf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:37.563243 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f154a2-6bf9-4695-be42-4f99fbc2abf2 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:37.571268 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1308/2613] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:40.228349 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dc006-f697-4e11-8c0a-fc1ac3966c1d tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:40.278923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:40.291650 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dc006-f697-4e11-8c0a-fc1ac3966c1d tempest-ServersAdminNegativeTestJSON-83679292 tempest-ServersAdminNegativeTestJSON-83679292-project-admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:40.296415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:40.297678 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:40.297954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:40.298224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] PATH_INFO: `/v3/users/726ac85ac01844e5882f81555379718c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:40.299455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] RBAC: Authorizing `identity:delete_user(user_id=726ac85ac01844e5882f81555379718c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:40.301374 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:40.347013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726ac85ac01844e5882f81555379718c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.358966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726ac85ac01844e5882f81555379718c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.365731 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726ac85ac01844e5882f81555379718c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.372853 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726ac85ac01844e5882f81555379718c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.373548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726ac85ac01844e5882f81555379718c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.379351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1306/2614] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:40 2022] DELETE /identity/v3/users/726ac85ac01844e5882f81555379718c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:40.383954 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0083e8-12ad-470a-8bf6-16d0df00dd19 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:40.384407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0083e8-12ad-470a-8bf6-16d0df00dd19 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:40.384514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0083e8-12ad-470a-8bf6-16d0df00dd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:40.403440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-eb0083e8-12ad-470a-8bf6-16d0df00dd19 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:40.404610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-eb0083e8-12ad-470a-8bf6-16d0df00dd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:40.462005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1309/2615] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:40.472533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:40.473858 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:40.529796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7feb45-bb09-46db-9570-dc56dfcf453f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:40.533976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818c427-4570-4612-9ef7-885323e739bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:40.534567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818c427-4570-4612-9ef7-885323e739bd service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:40.534873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818c427-4570-4612-9ef7-885323e739bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:40.535145 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818c427-4570-4612-9ef7-885323e739bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:40.545796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818c427-4570-4612-9ef7-885323e739bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:40.548322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818c427-4570-4612-9ef7-885323e739bd service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:40.558539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1307/2616] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:40.721931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0083e8-12ad-470a-8bf6-16d0df00dd19 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:40.723414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-eb0083e8-12ad-470a-8bf6-16d0df00dd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:40.735881 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0083e8-12ad-470a-8bf6-16d0df00dd19 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:40.740470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:40.741099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:40.741369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:40.741659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] PATH_INFO: `/v3/projects/e2f436b7cc684ad284ef0d6e98048938` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:40.742748 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f436b7cc684ad284ef0d6e98048938)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:40.744678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:40.789287 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f436b7cc684ad284ef0d6e98048938', 'request_id': 'req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.795199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f436b7cc684ad284ef0d6e98048938', 'request_id': 'req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.800554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f436b7cc684ad284ef0d6e98048938', 'request_id': 'req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.812332 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] The token cache is being invalidate because project e2f436b7cc684ad284ef0d6e98048938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:40.813165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.813756 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.815237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1310/2617] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:40 2022] DELETE /identity/v3/projects/e2f436b7cc684ad284ef0d6e98048938 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:40.819542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818c427-4570-4612-9ef7-885323e739bd service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:40.829467 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818c427-4570-4612-9ef7-885323e739bd service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:40.884090 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb4098-63d2-41f4-9d6c-bbda09d1c01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:40.884750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb4098-63d2-41f4-9d6c-bbda09d1c01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:40.885030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb4098-63d2-41f4-9d6c-bbda09d1c01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:40.885324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb4098-63d2-41f4-9d6c-bbda09d1c01e admin admin] PATH_INFO: `/v3/users/87c8b4a4bbef4ce5a91665d8b86a48f2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:40.886461 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb4098-63d2-41f4-9d6c-bbda09d1c01e admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c8b4a4bbef4ce5a91665d8b86a48f2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:40.888520 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb4098-63d2-41f4-9d6c-bbda09d1c01e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:40.903689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:40.934839 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9abb4098-63d2-41f4-9d6c-bbda09d1c01e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c8b4a4bbef4ce5a91665d8b86a48f2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.947303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9abb4098-63d2-41f4-9d6c-bbda09d1c01e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c8b4a4bbef4ce5a91665d8b86a48f2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.954639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9abb4098-63d2-41f4-9d6c-bbda09d1c01e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c8b4a4bbef4ce5a91665d8b86a48f2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.961003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9abb4098-63d2-41f4-9d6c-bbda09d1c01e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c8b4a4bbef4ce5a91665d8b86a48f2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.961621 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9abb4098-63d2-41f4-9d6c-bbda09d1c01e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c8b4a4bbef4ce5a91665d8b86a48f2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.967568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1308/2618] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:40 2022] DELETE /identity/v3/users/87c8b4a4bbef4ce5a91665d8b86a48f2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:41.240548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.242139 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:41.255571 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee48ea-9f5b-4ab5-881a-343eaa1b4ca0 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:41.267544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:41.315374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:41.316001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.316281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.316551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8 admin admin] PATH_INFO: `/v3/projects/602c738656944703be6e7b0d9086918e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.317653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=602c738656944703be6e7b0d9086918e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:41.319861 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:41.363670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602c738656944703be6e7b0d9086918e', 'request_id': 'req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.369710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602c738656944703be6e7b0d9086918e', 'request_id': 'req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.375852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602c738656944703be6e7b0d9086918e', 'request_id': 'req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.387437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8 admin admin] The token cache is being invalidate because project 602c738656944703be6e7b0d9086918e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:41.388042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.388381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d76dfd32-fba7-4201-bd3d-b787bdd0b1c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.389890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1311/2619] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:41 2022] DELETE /identity/v3/projects/602c738656944703be6e7b0d9086918e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:41.395712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b57f0-7277-4bcf-8c82-2ac021d97c05 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.396169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b57f0-7277-4bcf-8c82-2ac021d97c05 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.396259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b57f0-7277-4bcf-8c82-2ac021d97c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.415931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a45b57f0-7277-4bcf-8c82-2ac021d97c05 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:41.417102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a45b57f0-7277-4bcf-8c82-2ac021d97c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:41.475530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1309/2620] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:41.483824 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25500cca-c2c7-4b75-944b-e178f1e5738e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.484105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25500cca-c2c7-4b75-944b-e178f1e5738e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.484925 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25500cca-c2c7-4b75-944b-e178f1e5738e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.504077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-25500cca-c2c7-4b75-944b-e178f1e5738e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:41.505185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-25500cca-c2c7-4b75-944b-e178f1e5738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:41.512903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1312/2621] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:41.517074 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b57f0-7277-4bcf-8c82-2ac021d97c05 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.526784 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b57f0-7277-4bcf-8c82-2ac021d97c05 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:41.531840 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c1851-ad42-4233-9c07-3c401ab076ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:41.532435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c1851-ad42-4233-9c07-3c401ab076ca admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.532709 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c1851-ad42-4233-9c07-3c401ab076ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.532972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c1851-ad42-4233-9c07-3c401ab076ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.533604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c1851-ad42-4233-9c07-3c401ab076ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:41.533897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c1851-ad42-4233-9c07-3c401ab076ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:41.535510 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c1851-ad42-4233-9c07-3c401ab076ca admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:41.547348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1310/2622] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:41.551697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25500cca-c2c7-4b75-944b-e178f1e5738e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.560620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25500cca-c2c7-4b75-944b-e178f1e5738e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:41.565166 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c54a7-0169-42db-a198-6285bf3d89db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:41.565744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c54a7-0169-42db-a198-6285bf3d89db admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.566012 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c54a7-0169-42db-a198-6285bf3d89db admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.566272 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c54a7-0169-42db-a198-6285bf3d89db admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.566915 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c54a7-0169-42db-a198-6285bf3d89db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:41.569030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c54a7-0169-42db-a198-6285bf3d89db admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:41.595409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1313/2623] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:41 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:41.599523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c1851-ad42-4233-9c07-3c401ab076ca admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.610231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c1851-ad42-4233-9c07-3c401ab076ca admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:41.664149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be87f-afbe-46c7-aa6f-9884132e6b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:41.664736 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be87f-afbe-46c7-aa6f-9884132e6b82 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.665007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be87f-afbe-46c7-aa6f-9884132e6b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.665271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be87f-afbe-46c7-aa6f-9884132e6b82 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.665894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575be87f-afbe-46c7-aa6f-9884132e6b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:41.667877 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575be87f-afbe-46c7-aa6f-9884132e6b82 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:41.688800 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1311/2624] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:41 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:41.693104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c54a7-0169-42db-a198-6285bf3d89db admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.703038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c54a7-0169-42db-a198-6285bf3d89db admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:41.707570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c6f5b-f745-485a-bca7-82cb9b401194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:41.708150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c6f5b-f745-485a-bca7-82cb9b401194 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.708426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c6f5b-f745-485a-bca7-82cb9b401194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.708696 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c6f5b-f745-485a-bca7-82cb9b401194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.709327 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c6f5b-f745-485a-bca7-82cb9b401194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:41.710928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c6f5b-f745-485a-bca7-82cb9b401194 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:41.721334 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1314/2625] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:41.724964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be87f-afbe-46c7-aa6f-9884132e6b82 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.735149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be87f-afbe-46c7-aa6f-9884132e6b82 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:41.739675 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337da256-333a-496c-955e-46ed1af1329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:41.740246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337da256-333a-496c-955e-46ed1af1329f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.740520 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337da256-333a-496c-955e-46ed1af1329f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.740786 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337da256-333a-496c-955e-46ed1af1329f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.741437 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337da256-333a-496c-955e-46ed1af1329f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:41.743059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337da256-333a-496c-955e-46ed1af1329f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:41.745049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:41.755254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1312/2626] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:41.758690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c6f5b-f745-485a-bca7-82cb9b401194 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.768180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c6f5b-f745-485a-bca7-82cb9b401194 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:41.772647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a1f21-9e36-4f8b-9683-61dea112d26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:41.773270 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a1f21-9e36-4f8b-9683-61dea112d26c admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.773541 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a1f21-9e36-4f8b-9683-61dea112d26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.773807 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a1f21-9e36-4f8b-9683-61dea112d26c admin admin] PATH_INFO: `/v3/projects/3e02e219e2a448dd8afa15e2ab87d40d/users/ddd53637c65b44e5a503f36b0fb08e3f/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.788759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a1f21-9e36-4f8b-9683-61dea112d26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e02e219e2a448dd8afa15e2ab87d40d, user_id=ddd53637c65b44e5a503f36b0fb08e3f, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:41.791410 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a1f21-9e36-4f8b-9683-61dea112d26c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:41.804257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1315/2627] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:41 2022] PUT /identity/v3/projects/3e02e219e2a448dd8afa15e2ab87d40d/users/ddd53637c65b44e5a503f36b0fb08e3f/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:41.809184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d3097-94f0-49f3-b87f-b93b9a263aeb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.809467 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d3097-94f0-49f3-b87f-b93b9a263aeb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.809735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d3097-94f0-49f3-b87f-b93b9a263aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.829009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-dd4d3097-94f0-49f3-b87f-b93b9a263aeb None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:41.830184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dd4d3097-94f0-49f3-b87f-b93b9a263aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:41.887052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1313/2628] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:41.897141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a1f21-9e36-4f8b-9683-61dea112d26c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.898882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9b0a1f21-9e36-4f8b-9683-61dea112d26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:41.943016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:41.956647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a1f21-9e36-4f8b-9683-61dea112d26c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:41.960213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f267e-1a9e-4cb3-b8ae-fa323cfadcc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:41.960798 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f267e-1a9e-4cb3-b8ae-fa323cfadcc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.961068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f267e-1a9e-4cb3-b8ae-fa323cfadcc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.961334 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f267e-1a9e-4cb3-b8ae-fa323cfadcc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.971098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f267e-1a9e-4cb3-b8ae-fa323cfadcc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:41.972546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f267e-1a9e-4cb3-b8ae-fa323cfadcc2 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:41.981695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1316/2629] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:45.826957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a7a05-82d3-4b96-8e44-cb46045a1901 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:45.828044 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a7a05-82d3-4b96-8e44-cb46045a1901 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:45.828044 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a7a05-82d3-4b96-8e44-cb46045a1901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:45.862581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1d0a7a05-82d3-4b96-8e44-cb46045a1901 None None] MFA Rules not processed for user `ddd53637c65b44e5a503f36b0fb08e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:45.863841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1d0a7a05-82d3-4b96-8e44-cb46045a1901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:45.931147 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1314/2630] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:45.943069 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dda08-7016-49b6-be0f-13b2d8db5ffb None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:45.943617 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dda08-7016-49b6-be0f-13b2d8db5ffb None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:45.943617 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dda08-7016-49b6-be0f-13b2d8db5ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:45.965826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e17dda08-7016-49b6-be0f-13b2d8db5ffb None None] MFA Rules not processed for user `ddd53637c65b44e5a503f36b0fb08e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:45.967320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e17dda08-7016-49b6-be0f-13b2d8db5ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:45.976620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1317/2631] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:45.987855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a7a05-82d3-4b96-8e44-cb46045a1901 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:45.989298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1d0a7a05-82d3-4b96-8e44-cb46045a1901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:46.066897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a7a05-82d3-4b96-8e44-cb46045a1901 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:46.072816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc356de-25f1-423d-af04-9346a0b9e5a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:46.073429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc356de-25f1-423d-af04-9346a0b9e5a3 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:46.073703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc356de-25f1-423d-af04-9346a0b9e5a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:46.073998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc356de-25f1-423d-af04-9346a0b9e5a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:46.083232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc356de-25f1-423d-af04-9346a0b9e5a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:46.084854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc356de-25f1-423d-af04-9346a0b9e5a3 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:46.094909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1315/2632] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:55.477435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa6a96-d5c0-4bee-a431-a5c28543ea14 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:55.478019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa6a96-d5c0-4bee-a431-a5c28543ea14 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:55.478125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa6a96-d5c0-4bee-a431-a5c28543ea14 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:55.479695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1318/2633] 10.222.0.33 () {54 vars in 921 bytes} [Sun Sep 11 01:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:55.486149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b4ddb-1d50-47cc-9d48-4183c3981a2f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:55.486686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b4ddb-1d50-47cc-9d48-4183c3981a2f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:55.486686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b4ddb-1d50-47cc-9d48-4183c3981a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:55.510367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:55.524794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b42b4ddb-1d50-47cc-9d48-4183c3981a2f None None] MFA Rules not processed for user `c45d8e2b0b674e9a814167db4d78749e`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:55.526080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b42b4ddb-1d50-47cc-9d48-4183c3981a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:55.532696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1316/2634] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:55.544528 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa6a96-d5c0-4bee-a431-a5c28543ea14 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:55.556035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa6a96-d5c0-4bee-a431-a5c28543ea14 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:55.559495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad546a28-7a5b-43fd-a448-6be93d32f3a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:55.560083 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad546a28-7a5b-43fd-a448-6be93d32f3a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:55.560361 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad546a28-7a5b-43fd-a448-6be93d32f3a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:55.560630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad546a28-7a5b-43fd-a448-6be93d32f3a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:55.568997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad546a28-7a5b-43fd-a448-6be93d32f3a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:55.570404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad546a28-7a5b-43fd-a448-6be93d32f3a8 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:55.578239 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1319/2635] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:55.677260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b4ddb-1d50-47cc-9d48-4183c3981a2f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:55.678645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b42b4ddb-1d50-47cc-9d48-4183c3981a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:55.747082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b4ddb-1d50-47cc-9d48-4183c3981a2f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:55.752078 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485fe71-f749-4bbd-930a-5be722fd4101 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:55.752677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485fe71-f749-4bbd-930a-5be722fd4101 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:55.752953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485fe71-f749-4bbd-930a-5be722fd4101 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:55.753219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485fe71-f749-4bbd-930a-5be722fd4101 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:55.754966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8485fe71-f749-4bbd-930a-5be722fd4101 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:55.766105 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485fe71-f749-4bbd-930a-5be722fd4101 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:55.767714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485fe71-f749-4bbd-930a-5be722fd4101 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:55.777399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1317/2636] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:55.950447 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad546a28-7a5b-43fd-a448-6be93d32f3a8 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:55.959005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad546a28-7a5b-43fd-a448-6be93d32f3a8 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:55.962564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9172d0-8481-404c-a02a-6bccc5aa2d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:55.963190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9172d0-8481-404c-a02a-6bccc5aa2d05 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:55.963469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9172d0-8481-404c-a02a-6bccc5aa2d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:55.963740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9172d0-8481-404c-a02a-6bccc5aa2d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:55.965442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1f9172d0-8481-404c-a02a-6bccc5aa2d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:55.978717 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9172d0-8481-404c-a02a-6bccc5aa2d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:55.980150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9172d0-8481-404c-a02a-6bccc5aa2d05 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:55.991358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1320/2637] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:05.773264 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=35 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:05.986826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=22 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:35.855486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485fe71-f749-4bbd-930a-5be722fd4101 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:35.868505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485fe71-f749-4bbd-930a-5be722fd4101 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:35.873273 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9fcf3-bec4-45c5-a048-8d7a8bc83190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:35.873992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9fcf3-bec4-45c5-a048-8d7a8bc83190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:35.874267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9fcf3-bec4-45c5-a048-8d7a8bc83190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:35.874534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9fcf3-bec4-45c5-a048-8d7a8bc83190 admin admin] PATH_INFO: `/v3/users/ddd53637c65b44e5a503f36b0fb08e3f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:35.875676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9fcf3-bec4-45c5-a048-8d7a8bc83190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd53637c65b44e5a503f36b0fb08e3f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:35.877714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9fcf3-bec4-45c5-a048-8d7a8bc83190 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:35.940238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-acd9fcf3-bec4-45c5-a048-8d7a8bc83190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd53637c65b44e5a503f36b0fb08e3f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:35.952790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-acd9fcf3-bec4-45c5-a048-8d7a8bc83190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd53637c65b44e5a503f36b0fb08e3f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:35.962221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-acd9fcf3-bec4-45c5-a048-8d7a8bc83190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd53637c65b44e5a503f36b0fb08e3f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:35.971539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-acd9fcf3-bec4-45c5-a048-8d7a8bc83190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd53637c65b44e5a503f36b0fb08e3f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:35.972166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-acd9fcf3-bec4-45c5-a048-8d7a8bc83190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd53637c65b44e5a503f36b0fb08e3f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:35.978096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1318/2638] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:14:35 2022] DELETE /identity/v3/users/ddd53637c65b44e5a503f36b0fb08e3f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:36.147713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9172d0-8481-404c-a02a-6bccc5aa2d05 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:36.160914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9172d0-8481-404c-a02a-6bccc5aa2d05 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:36.217785 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c90fc-429b-4af7-a277-d666e6b493ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:36.218468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c90fc-429b-4af7-a277-d666e6b493ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:36.218767 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c90fc-429b-4af7-a277-d666e6b493ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:36.219038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c90fc-429b-4af7-a277-d666e6b493ba admin admin] PATH_INFO: `/v3/projects/3e02e219e2a448dd8afa15e2ab87d40d` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:36.220144 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c90fc-429b-4af7-a277-d666e6b493ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e02e219e2a448dd8afa15e2ab87d40d)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:36.222014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c90fc-429b-4af7-a277-d666e6b493ba admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:36.270077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-814c90fc-429b-4af7-a277-d666e6b493ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e02e219e2a448dd8afa15e2ab87d40d', 'request_id': 'req-814c90fc-429b-4af7-a277-d666e6b493ba'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:36.275942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-814c90fc-429b-4af7-a277-d666e6b493ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e02e219e2a448dd8afa15e2ab87d40d', 'request_id': 'req-814c90fc-429b-4af7-a277-d666e6b493ba'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:36.281568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-814c90fc-429b-4af7-a277-d666e6b493ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e02e219e2a448dd8afa15e2ab87d40d', 'request_id': 'req-814c90fc-429b-4af7-a277-d666e6b493ba'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:36.294510 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-814c90fc-429b-4af7-a277-d666e6b493ba admin admin] The token cache is being invalidate because project 3e02e219e2a448dd8afa15e2ab87d40d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:14:36.294827 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-814c90fc-429b-4af7-a277-d666e6b493ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:36.295471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-814c90fc-429b-4af7-a277-d666e6b493ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:36.296926 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1321/2639] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:14:36 2022] DELETE /identity/v3/projects/3e02e219e2a448dd8afa15e2ab87d40d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:36.301868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3933fe-1c16-4c94-b3f5-0bee795a760e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:36.302152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3933fe-1c16-4c94-b3f5-0bee795a760e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:36.302421 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3933fe-1c16-4c94-b3f5-0bee795a760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:36.322286 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cf3933fe-1c16-4c94-b3f5-0bee795a760e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:36.323620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cf3933fe-1c16-4c94-b3f5-0bee795a760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:36.384634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1319/2640] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:36.392805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89717f68-4e45-4ed7-b061-aedb0bd15591 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:36.393087 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89717f68-4e45-4ed7-b061-aedb0bd15591 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:36.393355 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89717f68-4e45-4ed7-b061-aedb0bd15591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:36.413440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-89717f68-4e45-4ed7-b061-aedb0bd15591 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:36.414628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-89717f68-4e45-4ed7-b061-aedb0bd15591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:36.428283 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1322/2641] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:36.432700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3933fe-1c16-4c94-b3f5-0bee795a760e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:36.444726 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3933fe-1c16-4c94-b3f5-0bee795a760e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:36.449506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d55674-968e-4443-92b7-9c4429f22f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:36.450101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d55674-968e-4443-92b7-9c4429f22f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:36.450373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d55674-968e-4443-92b7-9c4429f22f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:36.450637 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d55674-968e-4443-92b7-9c4429f22f7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:36.451988 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d55674-968e-4443-92b7-9c4429f22f7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:14:36.452284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d55674-968e-4443-92b7-9c4429f22f7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:36.453880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d55674-968e-4443-92b7-9c4429f22f7c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:36.465683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1320/2642] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:14:36.470006 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89717f68-4e45-4ed7-b061-aedb0bd15591 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:36.479160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89717f68-4e45-4ed7-b061-aedb0bd15591 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:36.484276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa6315-01a9-4765-bafb-409c3c32328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:36.484858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa6315-01a9-4765-bafb-409c3c32328c admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:36.485134 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa6315-01a9-4765-bafb-409c3c32328c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:36.485404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa6315-01a9-4765-bafb-409c3c32328c admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:36.486029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa6315-01a9-4765-bafb-409c3c32328c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:36.487922 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa6315-01a9-4765-bafb-409c3c32328c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:36.514320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1323/2643] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:14:36 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:14:36.518383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d55674-968e-4443-92b7-9c4429f22f7c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:36.528474 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d55674-968e-4443-92b7-9c4429f22f7c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:36.583551 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040bfd6-4aaa-45b6-b1c9-3141b84dbd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:36.584140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040bfd6-4aaa-45b6-b1c9-3141b84dbd12 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:36.584415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040bfd6-4aaa-45b6-b1c9-3141b84dbd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:36.584677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040bfd6-4aaa-45b6-b1c9-3141b84dbd12 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:36.585285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040bfd6-4aaa-45b6-b1c9-3141b84dbd12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:36.587207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040bfd6-4aaa-45b6-b1c9-3141b84dbd12 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:36.594961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:36.609832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1321/2644] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:14:36 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:36.613763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa6315-01a9-4765-bafb-409c3c32328c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:36.625085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa6315-01a9-4765-bafb-409c3c32328c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:36.629610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68290661-0646-431b-97c9-ec5ddeac7fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:36.630196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68290661-0646-431b-97c9-ec5ddeac7fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:36.630466 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68290661-0646-431b-97c9-ec5ddeac7fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:36.630762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68290661-0646-431b-97c9-ec5ddeac7fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:36.631379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68290661-0646-431b-97c9-ec5ddeac7fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:36.632936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68290661-0646-431b-97c9-ec5ddeac7fd4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:36.642445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1324/2645] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:36.646285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040bfd6-4aaa-45b6-b1c9-3141b84dbd12 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:36.656232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040bfd6-4aaa-45b6-b1c9-3141b84dbd12 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:36.660781 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae18b57-4bc5-43e4-84e3-c6806bc5472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:36.661365 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae18b57-4bc5-43e4-84e3-c6806bc5472f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:36.661644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae18b57-4bc5-43e4-84e3-c6806bc5472f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:36.662155 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae18b57-4bc5-43e4-84e3-c6806bc5472f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:36.662841 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae18b57-4bc5-43e4-84e3-c6806bc5472f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:36.664409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae18b57-4bc5-43e4-84e3-c6806bc5472f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:36.675419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1322/2646] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:36.679257 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68290661-0646-431b-97c9-ec5ddeac7fd4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:36.689685 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68290661-0646-431b-97c9-ec5ddeac7fd4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:36.694235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134b81d-8b9f-40c1-a4b3-a641f3ff6366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:36.694898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134b81d-8b9f-40c1-a4b3-a641f3ff6366 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:36.695174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134b81d-8b9f-40c1-a4b3-a641f3ff6366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:36.695439 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134b81d-8b9f-40c1-a4b3-a641f3ff6366 admin admin] PATH_INFO: `/v3/projects/4c166f85b58e4126ade37cbdfa42e49e/users/29f17284fbaf43c783edaf1e07c85ded/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:36.709662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134b81d-8b9f-40c1-a4b3-a641f3ff6366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c166f85b58e4126ade37cbdfa42e49e, user_id=29f17284fbaf43c783edaf1e07c85ded, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:36.712354 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134b81d-8b9f-40c1-a4b3-a641f3ff6366 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:36.724720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1325/2647] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:14:36 2022] PUT /identity/v3/projects/4c166f85b58e4126ade37cbdfa42e49e/users/29f17284fbaf43c783edaf1e07c85ded/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:36.729623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa163-bd21-4209-a296-18ff2a0e4be5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:36.729944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa163-bd21-4209-a296-18ff2a0e4be5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:36.730250 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa163-bd21-4209-a296-18ff2a0e4be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:36.751361 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ff4aa163-bd21-4209-a296-18ff2a0e4be5 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:36.752547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ff4aa163-bd21-4209-a296-18ff2a0e4be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:36.809072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1323/2648] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:14:36.819490 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134b81d-8b9f-40c1-a4b3-a641f3ff6366 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:36.821169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a134b81d-8b9f-40c1-a4b3-a641f3ff6366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:36.853503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:36.892592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134b81d-8b9f-40c1-a4b3-a641f3ff6366 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:36.896176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa8302-7188-44ab-a083-98e37674df59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:36.896763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa8302-7188-44ab-a083-98e37674df59 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:36.897066 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa8302-7188-44ab-a083-98e37674df59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:36.897330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa8302-7188-44ab-a083-98e37674df59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:36.906584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa8302-7188-44ab-a083-98e37674df59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:36.908006 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa8302-7188-44ab-a083-98e37674df59 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:36.917094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1326/2649] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:40.889478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02c2e6-9a0c-49ab-a74f-0dc4e718abaf None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:40.890025 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02c2e6-9a0c-49ab-a74f-0dc4e718abaf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:40.890025 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02c2e6-9a0c-49ab-a74f-0dc4e718abaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:40.919718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9e02c2e6-9a0c-49ab-a74f-0dc4e718abaf None None] MFA Rules not processed for user `29f17284fbaf43c783edaf1e07c85ded`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:40.920914 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9e02c2e6-9a0c-49ab-a74f-0dc4e718abaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:40.987719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1324/2650] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:14:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:40.998987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfc06b-e2c6-4a42-ae9f-7f18a7fe4e15 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:40.999433 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfc06b-e2c6-4a42-ae9f-7f18a7fe4e15 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:40.999611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfc06b-e2c6-4a42-ae9f-7f18a7fe4e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:41.042954 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e8bfc06b-e2c6-4a42-ae9f-7f18a7fe4e15 None None] MFA Rules not processed for user `29f17284fbaf43c783edaf1e07c85ded`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:41.044137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e8bfc06b-e2c6-4a42-ae9f-7f18a7fe4e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:41.051344 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1327/2651] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:14:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:41.064667 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02c2e6-9a0c-49ab-a74f-0dc4e718abaf None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:41.066046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9e02c2e6-9a0c-49ab-a74f-0dc4e718abaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:41.142689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02c2e6-9a0c-49ab-a74f-0dc4e718abaf None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:41.148253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2831e-9d01-411b-901a-297c2efe44fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:41.148866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2831e-9d01-411b-901a-297c2efe44fb service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:41.149140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2831e-9d01-411b-901a-297c2efe44fb service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:41.149410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2831e-9d01-411b-901a-297c2efe44fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:41.154328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:41.159710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2831e-9d01-411b-901a-297c2efe44fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:41.161954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2831e-9d01-411b-901a-297c2efe44fb service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:41.172218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1325/2652] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:43.693070 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfc06b-e2c6-4a42-ae9f-7f18a7fe4e15 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:43.705494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfc06b-e2c6-4a42-ae9f-7f18a7fe4e15 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:43.709101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5944be8-dfbe-4ee6-b2e1-eb60b36234d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:43.709696 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5944be8-dfbe-4ee6-b2e1-eb60b36234d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:43.709971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5944be8-dfbe-4ee6-b2e1-eb60b36234d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:43.710237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5944be8-dfbe-4ee6-b2e1-eb60b36234d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:43.712073 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a5944be8-dfbe-4ee6-b2e1-eb60b36234d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:43.721782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5944be8-dfbe-4ee6-b2e1-eb60b36234d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:43.723233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5944be8-dfbe-4ee6-b2e1-eb60b36234d1 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:43.740468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1328/2653] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:51.167265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:53.727748 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=28 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:31.648042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0589cb-ca5f-4498-afb1-3188715c73fd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:31.648581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0589cb-ca5f-4498-afb1-3188715c73fd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:31.648581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0589cb-ca5f-4498-afb1-3188715c73fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:31.667732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5b0589cb-ca5f-4498-afb1-3188715c73fd None None] MFA Rules not processed for user `29f17284fbaf43c783edaf1e07c85ded`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:31.668917 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5b0589cb-ca5f-4498-afb1-3188715c73fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:31.675641 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1326/2654] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:41.661818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:44.687183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5944be8-dfbe-4ee6-b2e1-eb60b36234d1 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:44.688749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a5944be8-dfbe-4ee6-b2e1-eb60b36234d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:44.699987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5944be8-dfbe-4ee6-b2e1-eb60b36234d1 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:44.704225 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4a0f-6ada-44e2-ab9d-efcca47e2132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:44.704870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4a0f-6ada-44e2-ab9d-efcca47e2132 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:44.705199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4a0f-6ada-44e2-ab9d-efcca47e2132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:44.705415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4a0f-6ada-44e2-ab9d-efcca47e2132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:44.707497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a7dd4a0f-6ada-44e2-ab9d-efcca47e2132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:44.721653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd4a0f-6ada-44e2-ab9d-efcca47e2132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:44.723104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd4a0f-6ada-44e2-ab9d-efcca47e2132 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:44.734160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1329/2655] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:15:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:15:45.920392 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0589cb-ca5f-4498-afb1-3188715c73fd None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:45.930030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0589cb-ca5f-4498-afb1-3188715c73fd None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:45.933614 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a54631-5355-4d07-82db-893afd5106ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:45.934208 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a54631-5355-4d07-82db-893afd5106ad service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:45.934483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a54631-5355-4d07-82db-893afd5106ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:45.934772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a54631-5355-4d07-82db-893afd5106ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:45.936773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-17a54631-5355-4d07-82db-893afd5106ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:45.951120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a54631-5355-4d07-82db-893afd5106ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:45.952577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a54631-5355-4d07-82db-893afd5106ad service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:45.964253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1327/2656] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:15:54.729155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:55.958645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:25.845877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4a0f-6ada-44e2-ab9d-efcca47e2132 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:25.859352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4a0f-6ada-44e2-ab9d-efcca47e2132 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:25.866365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124f75d-a3c1-4b59-923f-619b6ab08a35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:25.867002 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124f75d-a3c1-4b59-923f-619b6ab08a35 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:25.867276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124f75d-a3c1-4b59-923f-619b6ab08a35 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:25.867536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124f75d-a3c1-4b59-923f-619b6ab08a35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:25.869757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8124f75d-a3c1-4b59-923f-619b6ab08a35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:25.893090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124f75d-a3c1-4b59-923f-619b6ab08a35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:25.894784 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124f75d-a3c1-4b59-923f-619b6ab08a35 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:25.907877 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1330/2657] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:31.122137 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a54631-5355-4d07-82db-893afd5106ad service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:31.123603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-17a54631-5355-4d07-82db-893afd5106ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:31.190108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124f75d-a3c1-4b59-923f-619b6ab08a35 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:31.203070 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124f75d-a3c1-4b59-923f-619b6ab08a35 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:31.207585 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f0191-b36f-4d09-aa1a-e592c4c38a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:31.208206 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0191-b36f-4d09-aa1a-e592c4c38a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:31.208477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0191-b36f-4d09-aa1a-e592c4c38a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:31.208762 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0191-b36f-4d09-aa1a-e592c4c38a4d admin admin] PATH_INFO: `/v3/users/29f17284fbaf43c783edaf1e07c85ded` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:31.210503 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f0191-b36f-4d09-aa1a-e592c4c38a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f17284fbaf43c783edaf1e07c85ded)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:31.212470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f0191-b36f-4d09-aa1a-e592c4c38a4d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:31.220216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a54631-5355-4d07-82db-893afd5106ad service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:31.227207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5295d-be26-4f4c-9da7-137801529bf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:31.228210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5295d-be26-4f4c-9da7-137801529bf0 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:31.228486 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5295d-be26-4f4c-9da7-137801529bf0 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:31.228754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5295d-be26-4f4c-9da7-137801529bf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:31.230539 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fea5295d-be26-4f4c-9da7-137801529bf0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:31.243635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5295d-be26-4f4c-9da7-137801529bf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:31.245558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5295d-be26-4f4c-9da7-137801529bf0 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:31.259640 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1328/2658] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:31.265989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c94f0191-b36f-4d09-aa1a-e592c4c38a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f17284fbaf43c783edaf1e07c85ded'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:31.266581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c94f0191-b36f-4d09-aa1a-e592c4c38a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f17284fbaf43c783edaf1e07c85ded'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:31.280397 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c94f0191-b36f-4d09-aa1a-e592c4c38a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f17284fbaf43c783edaf1e07c85ded'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:31.291528 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c94f0191-b36f-4d09-aa1a-e592c4c38a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f17284fbaf43c783edaf1e07c85ded'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:31.306690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c94f0191-b36f-4d09-aa1a-e592c4c38a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f17284fbaf43c783edaf1e07c85ded'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:31.313692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1331/2659] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:16:31 2022] DELETE /identity/v3/users/29f17284fbaf43c783edaf1e07c85ded => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:31.491762 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5295d-be26-4f4c-9da7-137801529bf0 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:31.509127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5295d-be26-4f4c-9da7-137801529bf0 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:31.567303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:31.567928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:31.568206 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:31.568476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2 admin admin] PATH_INFO: `/v3/projects/4c166f85b58e4126ade37cbdfa42e49e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:31.570146 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c166f85b58e4126ade37cbdfa42e49e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:31.572070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:31.617375 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c166f85b58e4126ade37cbdfa42e49e', 'request_id': 'req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:31.624037 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c166f85b58e4126ade37cbdfa42e49e', 'request_id': 'req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:31.630293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c166f85b58e4126ade37cbdfa42e49e', 'request_id': 'req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:31.641113 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2 admin admin] The token cache is being invalidate because project 4c166f85b58e4126ade37cbdfa42e49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:16:31.641408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:31.642040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a2de719-e0d3-4b0b-bbaa-8e5354384de2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:31.643544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1329/2660] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:16:31 2022] DELETE /identity/v3/projects/4c166f85b58e4126ade37cbdfa42e49e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:31.649698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb301-6c84-4845-b62d-9baf83295cef None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:31.649985 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb301-6c84-4845-b62d-9baf83295cef None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:31.650260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb301-6c84-4845-b62d-9baf83295cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:31.669282 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-995eb301-6c84-4845-b62d-9baf83295cef None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:31.670463 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-995eb301-6c84-4845-b62d-9baf83295cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:31.728323 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1332/2661] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:16:31.736439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f120b-2ff7-46ec-b600-8f03de034ca1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:31.736720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f120b-2ff7-46ec-b600-8f03de034ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:31.737192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f120b-2ff7-46ec-b600-8f03de034ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:31.757123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6b4f120b-2ff7-46ec-b600-8f03de034ca1 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:31.758329 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6b4f120b-2ff7-46ec-b600-8f03de034ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:31.771900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1330/2662] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:31.776720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eb301-6c84-4845-b62d-9baf83295cef None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:31.786453 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eb301-6c84-4845-b62d-9baf83295cef None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:31.791025 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dccd6-07ad-4b62-9750-e9deb84e9ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:31.791622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dccd6-07ad-4b62-9750-e9deb84e9ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:31.791898 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dccd6-07ad-4b62-9750-e9deb84e9ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:31.792165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dccd6-07ad-4b62-9750-e9deb84e9ef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:31.792803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dccd6-07ad-4b62-9750-e9deb84e9ef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:16:31.793103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dccd6-07ad-4b62-9750-e9deb84e9ef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:31.794672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dccd6-07ad-4b62-9750-e9deb84e9ef5 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:31.806147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1333/2663] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:16:31.810865 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f120b-2ff7-46ec-b600-8f03de034ca1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:31.820526 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f120b-2ff7-46ec-b600-8f03de034ca1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:31.825233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01296075-11a9-4f4c-a045-01fae891ed92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:31.825827 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01296075-11a9-4f4c-a045-01fae891ed92 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:31.826100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01296075-11a9-4f4c-a045-01fae891ed92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:31.826362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01296075-11a9-4f4c-a045-01fae891ed92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:31.827050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01296075-11a9-4f4c-a045-01fae891ed92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:31.828910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01296075-11a9-4f4c-a045-01fae891ed92 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:31.840625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:31.858010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1331/2664] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:16:31 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:16:31.862133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dccd6-07ad-4b62-9750-e9deb84e9ef5 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:31.872302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dccd6-07ad-4b62-9750-e9deb84e9ef5 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:31.915308 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:31.930114 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828e738-5f3b-4acd-8833-a6e34fe75877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:31.930713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828e738-5f3b-4acd-8833-a6e34fe75877 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:31.931024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828e738-5f3b-4acd-8833-a6e34fe75877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:31.931299 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828e738-5f3b-4acd-8833-a6e34fe75877 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:31.931929 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828e738-5f3b-4acd-8833-a6e34fe75877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:31.934126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828e738-5f3b-4acd-8833-a6e34fe75877 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:31.955701 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1334/2665] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:16:31 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:16:31.959935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01296075-11a9-4f4c-a045-01fae891ed92 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:31.970060 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01296075-11a9-4f4c-a045-01fae891ed92 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:31.974607 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd862eff-0445-4b03-941f-92f8cc16dc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:31.975236 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd862eff-0445-4b03-941f-92f8cc16dc6f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:31.975516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd862eff-0445-4b03-941f-92f8cc16dc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:31.975787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd862eff-0445-4b03-941f-92f8cc16dc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:31.976425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd862eff-0445-4b03-941f-92f8cc16dc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:31.978007 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd862eff-0445-4b03-941f-92f8cc16dc6f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:31.987799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1332/2666] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:16:31.992175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828e738-5f3b-4acd-8833-a6e34fe75877 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:32.001767 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828e738-5f3b-4acd-8833-a6e34fe75877 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:32.007133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17371087-2ee3-477f-8b21-df0b0473da76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:32.007723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17371087-2ee3-477f-8b21-df0b0473da76 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:32.008000 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17371087-2ee3-477f-8b21-df0b0473da76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:32.008269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17371087-2ee3-477f-8b21-df0b0473da76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:32.008900 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17371087-2ee3-477f-8b21-df0b0473da76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:32.010489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17371087-2ee3-477f-8b21-df0b0473da76 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:32.020836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1335/2667] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:16:32.024708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd862eff-0445-4b03-941f-92f8cc16dc6f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:32.034404 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd862eff-0445-4b03-941f-92f8cc16dc6f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:32.038995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc2ffa-7518-4878-98db-47246b9bf489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:32.039625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc2ffa-7518-4878-98db-47246b9bf489 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:32.039901 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc2ffa-7518-4878-98db-47246b9bf489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:32.040168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc2ffa-7518-4878-98db-47246b9bf489 admin admin] PATH_INFO: `/v3/projects/a99cbda38e0c4f4c9a80ce2f58c7ca74/users/cbecfae5ad93473fbd3cffc0e0151414/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:32.055271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc2ffa-7518-4878-98db-47246b9bf489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99cbda38e0c4f4c9a80ce2f58c7ca74, user_id=cbecfae5ad93473fbd3cffc0e0151414, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:32.057897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc2ffa-7518-4878-98db-47246b9bf489 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:32.071757 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1333/2668] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:16:32 2022] PUT /identity/v3/projects/a99cbda38e0c4f4c9a80ce2f58c7ca74/users/cbecfae5ad93473fbd3cffc0e0151414/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:32.076441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d1488-5503-4527-b5e3-81b56a452918 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:32.076736 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d1488-5503-4527-b5e3-81b56a452918 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:32.077013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d1488-5503-4527-b5e3-81b56a452918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:32.095968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5e5d1488-5503-4527-b5e3-81b56a452918 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:32.097159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5e5d1488-5503-4527-b5e3-81b56a452918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:32.156269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1336/2669] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:32.166379 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc2ffa-7518-4878-98db-47246b9bf489 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:32.168042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-febc2ffa-7518-4878-98db-47246b9bf489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:32.223340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc2ffa-7518-4878-98db-47246b9bf489 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:32.227787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc6c43-b01f-48bb-b6ad-295e1ec89c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:32.228413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc6c43-b01f-48bb-b6ad-295e1ec89c28 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:32.228689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc6c43-b01f-48bb-b6ad-295e1ec89c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:32.228957 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc6c43-b01f-48bb-b6ad-295e1ec89c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:32.238094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc6c43-b01f-48bb-b6ad-295e1ec89c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:32.239546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc6c43-b01f-48bb-b6ad-295e1ec89c28 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:32.249052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1334/2670] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:36.521995 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3997bb-2d97-48d7-ba9c-fe4db0e993c7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:36.522607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3997bb-2d97-48d7-ba9c-fe4db0e993c7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:36.522607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3997bb-2d97-48d7-ba9c-fe4db0e993c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:36.584476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-bf3997bb-2d97-48d7-ba9c-fe4db0e993c7 None None] MFA Rules not processed for user `cbecfae5ad93473fbd3cffc0e0151414`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:36.585703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bf3997bb-2d97-48d7-ba9c-fe4db0e993c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:36.675104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1337/2671] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:36.691470 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc6c43-b01f-48bb-b6ad-295e1ec89c28 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:36.695910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9bfc6c43-b01f-48bb-b6ad-295e1ec89c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:36.777172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc6c43-b01f-48bb-b6ad-295e1ec89c28 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:36.782748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffa995-ae81-4a69-a690-11d2b1348877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:36.783373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffa995-ae81-4a69-a690-11d2b1348877 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:36.783652 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffa995-ae81-4a69-a690-11d2b1348877 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:36.783926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffa995-ae81-4a69-a690-11d2b1348877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:36.792894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffa995-ae81-4a69-a690-11d2b1348877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:36.794503 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffa995-ae81-4a69-a690-11d2b1348877 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:36.804933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1335/2672] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:38.120234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2fa42-4382-4189-a5bb-c2b59dbfb7d1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:38.120758 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2fa42-4382-4189-a5bb-c2b59dbfb7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:38.120855 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2fa42-4382-4189-a5bb-c2b59dbfb7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:38.139569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-34a2fa42-4382-4189-a5bb-c2b59dbfb7d1 None None] MFA Rules not processed for user `cbecfae5ad93473fbd3cffc0e0151414`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:38.140711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-34a2fa42-4382-4189-a5bb-c2b59dbfb7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:38.148913 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1338/2673] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:16:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:38.832196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffa995-ae81-4a69-a690-11d2b1348877 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:38.835042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fcffa995-ae81-4a69-a690-11d2b1348877 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:38.901581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:38.924981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffa995-ae81-4a69-a690-11d2b1348877 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:38.930740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a430d-1812-4f4a-ba74-c4b77dd71399 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:38.931350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a430d-1812-4f4a-ba74-c4b77dd71399 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:38.931624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a430d-1812-4f4a-ba74-c4b77dd71399 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:38.931891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a430d-1812-4f4a-ba74-c4b77dd71399 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:38.933843 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5f9a430d-1812-4f4a-ba74-c4b77dd71399 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:38.946578 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a430d-1812-4f4a-ba74-c4b77dd71399 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:38.948314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a430d-1812-4f4a-ba74-c4b77dd71399 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:38.958534 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1336/2674] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:48.066130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2fa42-4382-4189-a5bb-c2b59dbfb7d1 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:48.067690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-34a2fa42-4382-4189-a5bb-c2b59dbfb7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:48.084094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2fa42-4382-4189-a5bb-c2b59dbfb7d1 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:48.089472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5144a-6cbb-4902-bb44-8941e74fe6a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:48.090072 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5144a-6cbb-4902-bb44-8941e74fe6a5 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:48.090343 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5144a-6cbb-4902-bb44-8941e74fe6a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:48.090611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5144a-6cbb-4902-bb44-8941e74fe6a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:48.092322 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f1f5144a-6cbb-4902-bb44-8941e74fe6a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:48.104977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5144a-6cbb-4902-bb44-8941e74fe6a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:48.106546 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5144a-6cbb-4902-bb44-8941e74fe6a5 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:48.117698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1339/2675] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:48.954061 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=12 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:58.112593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:37.452548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a430d-1812-4f4a-ba74-c4b77dd71399 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:37.453915 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5f9a430d-1812-4f4a-ba74-c4b77dd71399 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:37.466408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a430d-1812-4f4a-ba74-c4b77dd71399 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:37.472300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f19ab-407f-4ab4-b9c2-2c0ed4143bdb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:37.472899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f19ab-407f-4ab4-b9c2-2c0ed4143bdb service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:37.473176 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f19ab-407f-4ab4-b9c2-2c0ed4143bdb service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:37.473442 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f19ab-407f-4ab4-b9c2-2c0ed4143bdb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:37.475685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-226f19ab-407f-4ab4-b9c2-2c0ed4143bdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:37.487386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f19ab-407f-4ab4-b9c2-2c0ed4143bdb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:37.488990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f19ab-407f-4ab4-b9c2-2c0ed4143bdb service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:37.500548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1337/2676] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:47.495324 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:50.155044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d7728-6e71-40ea-8bc5-f6551ec6dd02 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:50.155518 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d7728-6e71-40ea-8bc5-f6551ec6dd02 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:50.155646 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d7728-6e71-40ea-8bc5-f6551ec6dd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:50.174955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-200d7728-6e71-40ea-8bc5-f6551ec6dd02 None None] MFA Rules not processed for user `cbecfae5ad93473fbd3cffc0e0151414`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:50.176154 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-200d7728-6e71-40ea-8bc5-f6551ec6dd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:50.183775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1340/2677] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:17:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:50.484719 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f19ab-407f-4ab4-b9c2-2c0ed4143bdb service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:50.486168 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-226f19ab-407f-4ab4-b9c2-2c0ed4143bdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:50.497935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f19ab-407f-4ab4-b9c2-2c0ed4143bdb service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:50.501458 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b65bb-f203-43f7-8175-972b28532c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:50.502042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b65bb-f203-43f7-8175-972b28532c80 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:50.502319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b65bb-f203-43f7-8175-972b28532c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:50.502630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b65bb-f203-43f7-8175-972b28532c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:50.504261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0f7b65bb-f203-43f7-8175-972b28532c80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:50.513343 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b65bb-f203-43f7-8175-972b28532c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:50.514785 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b65bb-f203-43f7-8175-972b28532c80 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:50.522484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1338/2678] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:00.170092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:00.519042 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:01.397850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d7728-6e71-40ea-8bc5-f6551ec6dd02 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:01.411809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d7728-6e71-40ea-8bc5-f6551ec6dd02 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:01.417369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401de5ea-8fa7-4c7d-9620-41574867046e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:01.418054 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401de5ea-8fa7-4c7d-9620-41574867046e service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:01.418957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401de5ea-8fa7-4c7d-9620-41574867046e service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:01.418957 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401de5ea-8fa7-4c7d-9620-41574867046e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:01.421120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-401de5ea-8fa7-4c7d-9620-41574867046e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:01.437010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401de5ea-8fa7-4c7d-9620-41574867046e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:01.438584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401de5ea-8fa7-4c7d-9620-41574867046e service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:01.450781 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1341/2679] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:11.445748 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:59.675750 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa129c0-5f2e-4848-ac5f-f713980974b7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:59.676232 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa129c0-5f2e-4848-ac5f-f713980974b7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:59.676331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa129c0-5f2e-4848-ac5f-f713980974b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:59.695523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4fa129c0-5f2e-4848-ac5f-f713980974b7 None None] MFA Rules not processed for user `cbecfae5ad93473fbd3cffc0e0151414`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:59.696711 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4fa129c0-5f2e-4848-ac5f-f713980974b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:59.703471 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1339/2680] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:00.015131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401de5ea-8fa7-4c7d-9620-41574867046e service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:00.025024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401de5ea-8fa7-4c7d-9620-41574867046e service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:00.028582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49881e7a-d53d-435d-98d6-10fc2aac1196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:00.029164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49881e7a-d53d-435d-98d6-10fc2aac1196 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:00.029440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49881e7a-d53d-435d-98d6-10fc2aac1196 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:00.029706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49881e7a-d53d-435d-98d6-10fc2aac1196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:00.031396 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-49881e7a-d53d-435d-98d6-10fc2aac1196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:00.040547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49881e7a-d53d-435d-98d6-10fc2aac1196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:00.041939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49881e7a-d53d-435d-98d6-10fc2aac1196 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:00.050211 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1342/2681] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:09.690434 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:10.046198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:45.167390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa129c0-5f2e-4848-ac5f-f713980974b7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:45.177166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa129c0-5f2e-4848-ac5f-f713980974b7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:45.181206 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1928ec-e0a4-4e39-b904-466977584a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:45.181810 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1928ec-e0a4-4e39-b904-466977584a04 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:45.182091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1928ec-e0a4-4e39-b904-466977584a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:45.182359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1928ec-e0a4-4e39-b904-466977584a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:45.184144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cc1928ec-e0a4-4e39-b904-466977584a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:45.194702 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1928ec-e0a4-4e39-b904-466977584a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:45.196163 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1928ec-e0a4-4e39-b904-466977584a04 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:45.204802 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1340/2682] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:45.284693 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49881e7a-d53d-435d-98d6-10fc2aac1196 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:45.297064 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49881e7a-d53d-435d-98d6-10fc2aac1196 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:45.302009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f11680-2610-47b8-9548-796f41b6834f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:45.302605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f11680-2610-47b8-9548-796f41b6834f service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:45.302936 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f11680-2610-47b8-9548-796f41b6834f service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:45.303208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f11680-2610-47b8-9548-796f41b6834f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:45.304950 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-66f11680-2610-47b8-9548-796f41b6834f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:45.317250 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f11680-2610-47b8-9548-796f41b6834f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:45.318826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f11680-2610-47b8-9548-796f41b6834f service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:45.328600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1343/2683] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:45.505919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1928ec-e0a4-4e39-b904-466977584a04 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:45.514446 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1928ec-e0a4-4e39-b904-466977584a04 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:45.518353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f2957-9625-480d-a08f-a52a1c91b70c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:45.518953 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f2957-9625-480d-a08f-a52a1c91b70c service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:45.519230 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f2957-9625-480d-a08f-a52a1c91b70c service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:45.519499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f2957-9625-480d-a08f-a52a1c91b70c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:45.521186 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ca2f2957-9625-480d-a08f-a52a1c91b70c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:45.534066 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f2957-9625-480d-a08f-a52a1c91b70c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:45.535509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f2957-9625-480d-a08f-a52a1c91b70c service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:45.545975 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1341/2684] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:46.395213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f11680-2610-47b8-9548-796f41b6834f service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:46.404869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f11680-2610-47b8-9548-796f41b6834f service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:46.409372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6de500-ddaa-4857-8538-528251a294fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:46.410065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6de500-ddaa-4857-8538-528251a294fc service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:46.410333 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6de500-ddaa-4857-8538-528251a294fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:46.410596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6de500-ddaa-4857-8538-528251a294fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:46.413311 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9a6de500-ddaa-4857-8538-528251a294fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:46.424359 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6de500-ddaa-4857-8538-528251a294fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:46.426108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6de500-ddaa-4857-8538-528251a294fc service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:46.435107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1344/2685] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:55.541455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=12 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:56.431172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=12 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:17.276664 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06236ca5-bd76-4ef7-b67e-15b7eb097726 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:17.277178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06236ca5-bd76-4ef7-b67e-15b7eb097726 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:17.277276 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06236ca5-bd76-4ef7-b67e-15b7eb097726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:17.295859 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-06236ca5-bd76-4ef7-b67e-15b7eb097726 None None] MFA Rules not processed for user `cbecfae5ad93473fbd3cffc0e0151414`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:17.297053 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-06236ca5-bd76-4ef7-b67e-15b7eb097726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:17.304359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1342/2686] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:27.290721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:02.716909 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6de500-ddaa-4857-8538-528251a294fc service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:02.725544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6de500-ddaa-4857-8538-528251a294fc service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:02.729135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1126e-07d9-4217-abcf-cff132b63d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:02.729720 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1126e-07d9-4217-abcf-cff132b63d9b service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:02.730023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1126e-07d9-4217-abcf-cff132b63d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:02.730297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1126e-07d9-4217-abcf-cff132b63d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:02.732001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-aff1126e-07d9-4217-abcf-cff132b63d9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:02.745621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1126e-07d9-4217-abcf-cff132b63d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:02.747109 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1126e-07d9-4217-abcf-cff132b63d9b service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:02.758457 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1345/2687] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:02.943543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06236ca5-bd76-4ef7-b67e-15b7eb097726 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:02.944923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-06236ca5-bd76-4ef7-b67e-15b7eb097726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:03.020882 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06236ca5-bd76-4ef7-b67e-15b7eb097726 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:03.024649 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a557d19-2edc-42aa-b0f1-0eed05792327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecc9e16475344b78bb885437b5d6bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:03.025272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a557d19-2edc-42aa-b0f1-0eed05792327 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:03.025544 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a557d19-2edc-42aa-b0f1-0eed05792327 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:03.025836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a557d19-2edc-42aa-b0f1-0eed05792327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:03.027565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9a557d19-2edc-42aa-b0f1-0eed05792327 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:03.040873 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a557d19-2edc-42aa-b0f1-0eed05792327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:03.042269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a557d19-2edc-42aa-b0f1-0eed05792327 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:03.053528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1343/2688] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:12.753060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:13.048229 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=35 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:36.313702 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1126e-07d9-4217-abcf-cff132b63d9b service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:36.326573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1126e-07d9-4217-abcf-cff132b63d9b service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:36.330262 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8702fa-7237-4c2a-9703-e43b1f9b569f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecc9e16475344b78bb885437b5d6bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:36.330883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8702fa-7237-4c2a-9703-e43b1f9b569f service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:36.331155 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8702fa-7237-4c2a-9703-e43b1f9b569f service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:36.331418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8702fa-7237-4c2a-9703-e43b1f9b569f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:36.352811 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8702fa-7237-4c2a-9703-e43b1f9b569f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:36.354251 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8702fa-7237-4c2a-9703-e43b1f9b569f service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:36.362683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1346/2689] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:46.358873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=14 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:55.737729 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a557d19-2edc-42aa-b0f1-0eed05792327 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:55.776612 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a557d19-2edc-42aa-b0f1-0eed05792327 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:55.783267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17a57c-9aea-4494-9cc3-0b11d60fd264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:55.783571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17a57c-9aea-4494-9cc3-0b11d60fd264 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:55.783571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17a57c-9aea-4494-9cc3-0b11d60fd264 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:55.783876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17a57c-9aea-4494-9cc3-0b11d60fd264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:55.795865 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17a57c-9aea-4494-9cc3-0b11d60fd264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:55.796879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17a57c-9aea-4494-9cc3-0b11d60fd264 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:55.809634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1344/2690] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:05.804659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=17 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:10.451679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8702fa-7237-4c2a-9703-e43b1f9b569f service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:10.466216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8702fa-7237-4c2a-9703-e43b1f9b569f service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:10.472154 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9381f-1a04-4f44-9fdc-d48f86579a5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:10.472770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9381f-1a04-4f44-9fdc-d48f86579a5c service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:10.473072 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9381f-1a04-4f44-9fdc-d48f86579a5c service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:10.473338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9381f-1a04-4f44-9fdc-d48f86579a5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:10.475421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-abf9381f-1a04-4f44-9fdc-d48f86579a5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:10.489101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9381f-1a04-4f44-9fdc-d48f86579a5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:10.490672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9381f-1a04-4f44-9fdc-d48f86579a5c service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:10.506382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1347/2691] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:20.498597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:20.617876 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17a57c-9aea-4494-9cc3-0b11d60fd264 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:20.633642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17a57c-9aea-4494-9cc3-0b11d60fd264 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:20.637195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b89d90-272d-4306-9573-117a793fe1b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:20.637773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b89d90-272d-4306-9573-117a793fe1b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:20.638046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b89d90-272d-4306-9573-117a793fe1b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:20.638310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b89d90-272d-4306-9573-117a793fe1b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:20.647096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b89d90-272d-4306-9573-117a793fe1b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:20.648521 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b89d90-272d-4306-9573-117a793fe1b2 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:20.658454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1345/2692] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:23.728757 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9381f-1a04-4f44-9fdc-d48f86579a5c service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:23.772188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9381f-1a04-4f44-9fdc-d48f86579a5c service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:23.778551 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fba04a-f2f9-462a-86c6-304d66880f11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:23.778831 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fba04a-f2f9-462a-86c6-304d66880f11 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:23.779111 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fba04a-f2f9-462a-86c6-304d66880f11 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:23.779382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fba04a-f2f9-462a-86c6-304d66880f11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:23.783862 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-10fba04a-f2f9-462a-86c6-304d66880f11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:23.784237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b89d90-272d-4306-9573-117a793fe1b2 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:23.804733 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b89d90-272d-4306-9573-117a793fe1b2 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:23.809992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229bdc2-dfc6-4277-b107-9a8de789a031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:23.810627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229bdc2-dfc6-4277-b107-9a8de789a031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:23.810948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229bdc2-dfc6-4277-b107-9a8de789a031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:23.811212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229bdc2-dfc6-4277-b107-9a8de789a031 admin admin] PATH_INFO: `/v3/users/cbecfae5ad93473fbd3cffc0e0151414` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:23.812350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229bdc2-dfc6-4277-b107-9a8de789a031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbecfae5ad93473fbd3cffc0e0151414)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:23.814284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229bdc2-dfc6-4277-b107-9a8de789a031 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:23.820112 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fba04a-f2f9-462a-86c6-304d66880f11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:23.822187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fba04a-f2f9-462a-86c6-304d66880f11 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:23.832188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1348/2693] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:23.866154 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2229bdc2-dfc6-4277-b107-9a8de789a031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbecfae5ad93473fbd3cffc0e0151414'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:23.878659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2229bdc2-dfc6-4277-b107-9a8de789a031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbecfae5ad93473fbd3cffc0e0151414'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:23.886125 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2229bdc2-dfc6-4277-b107-9a8de789a031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbecfae5ad93473fbd3cffc0e0151414'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:23.893524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2229bdc2-dfc6-4277-b107-9a8de789a031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbecfae5ad93473fbd3cffc0e0151414'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:23.894216 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2229bdc2-dfc6-4277-b107-9a8de789a031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbecfae5ad93473fbd3cffc0e0151414'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:23.900884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1346/2694] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:22:23 2022] DELETE /identity/v3/users/cbecfae5ad93473fbd3cffc0e0151414 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:22:24.078236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fba04a-f2f9-462a-86c6-304d66880f11 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:24.089280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fba04a-f2f9-462a-86c6-304d66880f11 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:24.144029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:24.144652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:24.144931 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:24.145204 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f admin admin] PATH_INFO: `/v3/projects/a99cbda38e0c4f4c9a80ce2f58c7ca74` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:24.146310 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99cbda38e0c4f4c9a80ce2f58c7ca74)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:24.148213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:24.193346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99cbda38e0c4f4c9a80ce2f58c7ca74', 'request_id': 'req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:24.199244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99cbda38e0c4f4c9a80ce2f58c7ca74', 'request_id': 'req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:24.204731 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99cbda38e0c4f4c9a80ce2f58c7ca74', 'request_id': 'req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:24.217573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f admin admin] The token cache is being invalidate because project a99cbda38e0c4f4c9a80ce2f58c7ca74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:22:24.217863 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:24.218485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1454f8a8-1638-4eb5-8df0-35ac25e5c13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:24.219948 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1349/2695] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:22:24 2022] DELETE /identity/v3/projects/a99cbda38e0c4f4c9a80ce2f58c7ca74 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:24.224956 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769eb38-7795-47ac-8ece-941bacdced8a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:24.225248 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769eb38-7795-47ac-8ece-941bacdced8a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:24.225519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769eb38-7795-47ac-8ece-941bacdced8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:24.245937 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0769eb38-7795-47ac-8ece-941bacdced8a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:24.247182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0769eb38-7795-47ac-8ece-941bacdced8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:24.307000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1347/2696] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:24.368339 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbdee8-d098-45cc-a777-ebe43e534d63 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:24.369240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbdee8-d098-45cc-a777-ebe43e534d63 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:24.369518 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbdee8-d098-45cc-a777-ebe43e534d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:24.389365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2ebbdee8-d098-45cc-a777-ebe43e534d63 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:24.390563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2ebbdee8-d098-45cc-a777-ebe43e534d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:24.398393 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1350/2697] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:22:24.402649 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769eb38-7795-47ac-8ece-941bacdced8a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:24.412292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769eb38-7795-47ac-8ece-941bacdced8a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:24.416923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64503379-d82c-45a4-a25b-314a663fa35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:24.417515 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64503379-d82c-45a4-a25b-314a663fa35b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:24.417791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64503379-d82c-45a4-a25b-314a663fa35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:24.418062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64503379-d82c-45a4-a25b-314a663fa35b admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:24.418706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64503379-d82c-45a4-a25b-314a663fa35b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:22:24.419047 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64503379-d82c-45a4-a25b-314a663fa35b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:24.424558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64503379-d82c-45a4-a25b-314a663fa35b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:24.433482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1348/2698] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:22:24.437778 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbdee8-d098-45cc-a777-ebe43e534d63 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:24.447511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbdee8-d098-45cc-a777-ebe43e534d63 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:24.453130 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d23e11-e53a-4d4f-916d-591926edd88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:24.453269 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23e11-e53a-4d4f-916d-591926edd88f admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:24.453545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23e11-e53a-4d4f-916d-591926edd88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:24.453816 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23e11-e53a-4d4f-916d-591926edd88f admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:24.454465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d23e11-e53a-4d4f-916d-591926edd88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:24.456372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d23e11-e53a-4d4f-916d-591926edd88f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:24.483005 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1351/2699] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:22:24 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:22:24.487065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64503379-d82c-45a4-a25b-314a663fa35b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:24.497433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64503379-d82c-45a4-a25b-314a663fa35b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:24.534986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:24.555686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3032a3-8d98-4760-ba27-4c2c2d2d3f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:24.557177 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3032a3-8d98-4760-ba27-4c2c2d2d3f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:24.557500 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3032a3-8d98-4760-ba27-4c2c2d2d3f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:24.557777 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3032a3-8d98-4760-ba27-4c2c2d2d3f5c admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:24.558418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3032a3-8d98-4760-ba27-4c2c2d2d3f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:24.560702 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3032a3-8d98-4760-ba27-4c2c2d2d3f5c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:24.582132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1349/2700] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:22:24 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:22:24.586347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d23e11-e53a-4d4f-916d-591926edd88f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:24.597205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d23e11-e53a-4d4f-916d-591926edd88f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:24.602588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6e645-40b2-4332-985c-cf57bf5a29ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:24.603766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6e645-40b2-4332-985c-cf57bf5a29ca admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:24.604050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6e645-40b2-4332-985c-cf57bf5a29ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:24.604320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6e645-40b2-4332-985c-cf57bf5a29ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:24.604961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6e645-40b2-4332-985c-cf57bf5a29ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:24.606548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6e645-40b2-4332-985c-cf57bf5a29ca admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:24.608012 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:24.619434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1352/2701] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:22:24.622639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3032a3-8d98-4760-ba27-4c2c2d2d3f5c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:24.632702 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3032a3-8d98-4760-ba27-4c2c2d2d3f5c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:24.637398 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485d167-54d3-4e86-aa6f-10b49b5f2ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:24.638002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485d167-54d3-4e86-aa6f-10b49b5f2ddf admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:24.638274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485d167-54d3-4e86-aa6f-10b49b5f2ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:24.638547 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485d167-54d3-4e86-aa6f-10b49b5f2ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:24.639228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485d167-54d3-4e86-aa6f-10b49b5f2ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:24.640825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485d167-54d3-4e86-aa6f-10b49b5f2ddf admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:24.651659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1350/2702] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:22:24.655938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6e645-40b2-4332-985c-cf57bf5a29ca admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:24.666560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6e645-40b2-4332-985c-cf57bf5a29ca admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:24.672713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c57833-f216-4506-9318-cc54d809dc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:24.673639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c57833-f216-4506-9318-cc54d809dc11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:24.673939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c57833-f216-4506-9318-cc54d809dc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:24.674170 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c57833-f216-4506-9318-cc54d809dc11 admin admin] PATH_INFO: `/v3/projects/50e60b34cac74daa85db26af0ac963e8/users/414b83dda1fe412c88be68dec5c22fdd/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:24.691291 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c57833-f216-4506-9318-cc54d809dc11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e60b34cac74daa85db26af0ac963e8, user_id=414b83dda1fe412c88be68dec5c22fdd, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:24.693910 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c57833-f216-4506-9318-cc54d809dc11 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:24.707362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1353/2703] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:22:24 2022] PUT /identity/v3/projects/50e60b34cac74daa85db26af0ac963e8/users/414b83dda1fe412c88be68dec5c22fdd/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:22:24.712282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e464c-5905-4dce-87f1-13435bde6a6e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:24.712593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e464c-5905-4dce-87f1-13435bde6a6e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:24.712892 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e464c-5905-4dce-87f1-13435bde6a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:24.731946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-142e464c-5905-4dce-87f1-13435bde6a6e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:24.733141 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-142e464c-5905-4dce-87f1-13435bde6a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:24.791240 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1351/2704] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:24.800706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c57833-f216-4506-9318-cc54d809dc11 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:24.802506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-76c57833-f216-4506-9318-cc54d809dc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:24.860598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c57833-f216-4506-9318-cc54d809dc11 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:24.864175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541ae5e-ba5a-4e0b-8a4c-f82b725d100a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:24.864775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541ae5e-ba5a-4e0b-8a4c-f82b725d100a service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:24.865053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541ae5e-ba5a-4e0b-8a4c-f82b725d100a service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:24.865324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541ae5e-ba5a-4e0b-8a4c-f82b725d100a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:24.874374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541ae5e-ba5a-4e0b-8a4c-f82b725d100a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:24.875846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541ae5e-ba5a-4e0b-8a4c-f82b725d100a service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:24.885097 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1354/2705] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:28.864011 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f49a18-ff30-48be-86ea-631ceb32702d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:28.864489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f49a18-ff30-48be-86ea-631ceb32702d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:28.864655 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f49a18-ff30-48be-86ea-631ceb32702d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:28.896060 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-54f49a18-ff30-48be-86ea-631ceb32702d None None] MFA Rules not processed for user `414b83dda1fe412c88be68dec5c22fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:28.897274 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-54f49a18-ff30-48be-86ea-631ceb32702d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:28.973505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1352/2706] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:28.978395 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1ae3a-8af2-4b88-bc83-8a4db36b4452 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:28.978896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1ae3a-8af2-4b88-bc83-8a4db36b4452 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:28.979065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1ae3a-8af2-4b88-bc83-8a4db36b4452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:29.008368 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9ea1ae3a-8af2-4b88-bc83-8a4db36b4452 None None] MFA Rules not processed for user `414b83dda1fe412c88be68dec5c22fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:29.010191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9ea1ae3a-8af2-4b88-bc83-8a4db36b4452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:29.017146 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1355/2707] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:29.033800 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f49a18-ff30-48be-86ea-631ceb32702d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:29.037557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-54f49a18-ff30-48be-86ea-631ceb32702d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:29.089756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:29.117603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f49a18-ff30-48be-86ea-631ceb32702d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:29.123272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06e120-f4bc-4939-b49a-37ef08c345a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:29.123888 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06e120-f4bc-4939-b49a-37ef08c345a0 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:29.124157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06e120-f4bc-4939-b49a-37ef08c345a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:29.124430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06e120-f4bc-4939-b49a-37ef08c345a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:29.132836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06e120-f4bc-4939-b49a-37ef08c345a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:29.134979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06e120-f4bc-4939-b49a-37ef08c345a0 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:29.144348 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1353/2708] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:30.766874 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1ae3a-8af2-4b88-bc83-8a4db36b4452 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:30.768401 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9ea1ae3a-8af2-4b88-bc83-8a4db36b4452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:30.861813 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1ae3a-8af2-4b88-bc83-8a4db36b4452 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:30.867058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f67958-c355-4cb6-9a3c-797320351b6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:30.867719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67958-c355-4cb6-9a3c-797320351b6d service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:30.867997 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67958-c355-4cb6-9a3c-797320351b6d service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:30.868902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67958-c355-4cb6-9a3c-797320351b6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:30.870906 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-39f67958-c355-4cb6-9a3c-797320351b6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:30.889037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f67958-c355-4cb6-9a3c-797320351b6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:30.890687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f67958-c355-4cb6-9a3c-797320351b6d service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:30.901734 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1356/2709] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:39.139831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=12 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:40.283080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f2d0c-3958-4895-aadc-3ec260cf4d4a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:40.283689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f2d0c-3958-4895-aadc-3ec260cf4d4a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:40.283689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f2d0c-3958-4895-aadc-3ec260cf4d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:40.303837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7e9f2d0c-3958-4895-aadc-3ec260cf4d4a None None] MFA Rules not processed for user `414b83dda1fe412c88be68dec5c22fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:40.305014 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7e9f2d0c-3958-4895-aadc-3ec260cf4d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:40.312307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1354/2710] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:22:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:40.897537 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=73,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:41.322279 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f67958-c355-4cb6-9a3c-797320351b6d service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:41.323719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-39f67958-c355-4cb6-9a3c-797320351b6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:41.343297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f67958-c355-4cb6-9a3c-797320351b6d service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:41.349582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dc296-88a2-411e-a1ab-fcc9fc7a327f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:41.350173 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dc296-88a2-411e-a1ab-fcc9fc7a327f service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:41.350453 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dc296-88a2-411e-a1ab-fcc9fc7a327f service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:41.350744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dc296-88a2-411e-a1ab-fcc9fc7a327f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:41.352445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1a3dc296-88a2-411e-a1ab-fcc9fc7a327f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:41.363636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dc296-88a2-411e-a1ab-fcc9fc7a327f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:41.365192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dc296-88a2-411e-a1ab-fcc9fc7a327f service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:41.375473 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1357/2711] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:50.298368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:51.371287 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:03.606576 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f2d0c-3958-4895-aadc-3ec260cf4d4a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:03.620602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f2d0c-3958-4895-aadc-3ec260cf4d4a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:03.625062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c7b30-08c3-4585-8db0-58267a2c4a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:03.625683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7b30-08c3-4585-8db0-58267a2c4a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:03.625965 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7b30-08c3-4585-8db0-58267a2c4a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:03.626235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7b30-08c3-4585-8db0-58267a2c4a15 admin admin] PATH_INFO: `/v3/users/414b83dda1fe412c88be68dec5c22fdd` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:03.627352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c7b30-08c3-4585-8db0-58267a2c4a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=414b83dda1fe412c88be68dec5c22fdd)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:03.629253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c7b30-08c3-4585-8db0-58267a2c4a15 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:03.674020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c05c7b30-08c3-4585-8db0-58267a2c4a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414b83dda1fe412c88be68dec5c22fdd'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:03.686307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c05c7b30-08c3-4585-8db0-58267a2c4a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414b83dda1fe412c88be68dec5c22fdd'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:03.693031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c05c7b30-08c3-4585-8db0-58267a2c4a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414b83dda1fe412c88be68dec5c22fdd'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:03.700617 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c05c7b30-08c3-4585-8db0-58267a2c4a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414b83dda1fe412c88be68dec5c22fdd'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:03.701317 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c05c7b30-08c3-4585-8db0-58267a2c4a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414b83dda1fe412c88be68dec5c22fdd'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:03.707180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1355/2712] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:23:03 2022] DELETE /identity/v3/users/414b83dda1fe412c88be68dec5c22fdd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:03.876542 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dc296-88a2-411e-a1ab-fcc9fc7a327f service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:03.889020 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dc296-88a2-411e-a1ab-fcc9fc7a327f service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:03.945605 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6754b8a-6650-43b7-a235-f28869d231f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:03.946260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6754b8a-6650-43b7-a235-f28869d231f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:03.946540 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6754b8a-6650-43b7-a235-f28869d231f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:03.946842 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6754b8a-6650-43b7-a235-f28869d231f0 admin admin] PATH_INFO: `/v3/projects/50e60b34cac74daa85db26af0ac963e8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:03.947962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6754b8a-6650-43b7-a235-f28869d231f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e60b34cac74daa85db26af0ac963e8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:03.949832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6754b8a-6650-43b7-a235-f28869d231f0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:03.995477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b6754b8a-6650-43b7-a235-f28869d231f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e60b34cac74daa85db26af0ac963e8', 'request_id': 'req-b6754b8a-6650-43b7-a235-f28869d231f0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:04.001565 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b6754b8a-6650-43b7-a235-f28869d231f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e60b34cac74daa85db26af0ac963e8', 'request_id': 'req-b6754b8a-6650-43b7-a235-f28869d231f0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:04.012033 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b6754b8a-6650-43b7-a235-f28869d231f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e60b34cac74daa85db26af0ac963e8', 'request_id': 'req-b6754b8a-6650-43b7-a235-f28869d231f0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:04.023588 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b6754b8a-6650-43b7-a235-f28869d231f0 admin admin] The token cache is being invalidate because project 50e60b34cac74daa85db26af0ac963e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:23:04.023875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b6754b8a-6650-43b7-a235-f28869d231f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:04.024517 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b6754b8a-6650-43b7-a235-f28869d231f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:04.026516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1358/2713] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:23:03 2022] DELETE /identity/v3/projects/50e60b34cac74daa85db26af0ac963e8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:04.031642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87693194-f4d5-4987-97d3-08e2fe59d769 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:04.032396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87693194-f4d5-4987-97d3-08e2fe59d769 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:04.032396 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87693194-f4d5-4987-97d3-08e2fe59d769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:04.053697 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-87693194-f4d5-4987-97d3-08e2fe59d769 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:04.055261 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-87693194-f4d5-4987-97d3-08e2fe59d769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:04.119431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1356/2714] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:04.127255 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415fbd4-f1cb-408a-99c8-97e87a5fa9b5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:04.127545 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415fbd4-f1cb-408a-99c8-97e87a5fa9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:04.127824 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415fbd4-f1cb-408a-99c8-97e87a5fa9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:04.147646 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0415fbd4-f1cb-408a-99c8-97e87a5fa9b5 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:04.148838 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0415fbd4-f1cb-408a-99c8-97e87a5fa9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:04.157200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1359/2715] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:04.161428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87693194-f4d5-4987-97d3-08e2fe59d769 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:04.171032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87693194-f4d5-4987-97d3-08e2fe59d769 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:04.175576 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb4a46-6e25-47b2-8233-8d6d777d9dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:04.176160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb4a46-6e25-47b2-8233-8d6d777d9dea admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:04.176431 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb4a46-6e25-47b2-8233-8d6d777d9dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:04.176695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb4a46-6e25-47b2-8233-8d6d777d9dea admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:04.177330 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb4a46-6e25-47b2-8233-8d6d777d9dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:23:04.177625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb4a46-6e25-47b2-8233-8d6d777d9dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:04.179263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb4a46-6e25-47b2-8233-8d6d777d9dea admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:04.191836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1357/2716] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:23:04.198474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415fbd4-f1cb-408a-99c8-97e87a5fa9b5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:04.207637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415fbd4-f1cb-408a-99c8-97e87a5fa9b5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:04.212958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25e8ba-86e0-4567-ad4b-a9103baaa7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:04.213543 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25e8ba-86e0-4567-ad4b-a9103baaa7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:04.213821 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25e8ba-86e0-4567-ad4b-a9103baaa7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:04.214089 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25e8ba-86e0-4567-ad4b-a9103baaa7d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:04.214721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25e8ba-86e0-4567-ad4b-a9103baaa7d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:04.216634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25e8ba-86e0-4567-ad4b-a9103baaa7d0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:04.243016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1360/2717] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:23:04 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:04.247826 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb4a46-6e25-47b2-8233-8d6d777d9dea admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:04.257548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb4a46-6e25-47b2-8233-8d6d777d9dea admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:04.313376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd71b4-4443-4d93-801a-156888b8542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:04.313992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd71b4-4443-4d93-801a-156888b8542b admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:04.314268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd71b4-4443-4d93-801a-156888b8542b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:04.314536 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd71b4-4443-4d93-801a-156888b8542b admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:04.315207 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd71b4-4443-4d93-801a-156888b8542b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:04.317117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd71b4-4443-4d93-801a-156888b8542b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:04.325584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:04.340067 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1358/2718] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:23:04 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:04.344186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25e8ba-86e0-4567-ad4b-a9103baaa7d0 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:04.355059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25e8ba-86e0-4567-ad4b-a9103baaa7d0 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:04.359568 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6abd6-1fb9-41d4-9133-1ad5797a318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:04.360183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6abd6-1fb9-41d4-9133-1ad5797a318f admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:04.360454 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6abd6-1fb9-41d4-9133-1ad5797a318f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:04.360718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6abd6-1fb9-41d4-9133-1ad5797a318f admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:04.361347 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6abd6-1fb9-41d4-9133-1ad5797a318f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:04.362942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6abd6-1fb9-41d4-9133-1ad5797a318f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:04.373079 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1361/2719] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:04.377040 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd71b4-4443-4d93-801a-156888b8542b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:04.386991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd71b4-4443-4d93-801a-156888b8542b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:04.391642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99673ba3-a390-42c3-afa4-9acf1e568c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:04.392237 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99673ba3-a390-42c3-afa4-9acf1e568c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:04.392509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99673ba3-a390-42c3-afa4-9acf1e568c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:04.392778 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99673ba3-a390-42c3-afa4-9acf1e568c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:04.393415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99673ba3-a390-42c3-afa4-9acf1e568c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:04.395065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99673ba3-a390-42c3-afa4-9acf1e568c4c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:04.405927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1359/2720] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:04.410219 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6abd6-1fb9-41d4-9133-1ad5797a318f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:04.420933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6abd6-1fb9-41d4-9133-1ad5797a318f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:04.425527 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a030ac-d36e-47c9-9ccd-65fd497c29bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:04.426168 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a030ac-d36e-47c9-9ccd-65fd497c29bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:04.426990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a030ac-d36e-47c9-9ccd-65fd497c29bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:04.426990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a030ac-d36e-47c9-9ccd-65fd497c29bb admin admin] PATH_INFO: `/v3/projects/bb6f7dd7066248aa9979120079258ee0/users/0597959f9e854041987ea84078dd617f/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:04.441977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a030ac-d36e-47c9-9ccd-65fd497c29bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6f7dd7066248aa9979120079258ee0, user_id=0597959f9e854041987ea84078dd617f, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:04.444628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a030ac-d36e-47c9-9ccd-65fd497c29bb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:04.458344 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1362/2721] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:23:04 2022] PUT /identity/v3/projects/bb6f7dd7066248aa9979120079258ee0/users/0597959f9e854041987ea84078dd617f/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:04.469854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca8ed-e35a-4003-ae89-66c4712bea45 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:04.470174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca8ed-e35a-4003-ae89-66c4712bea45 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:04.470471 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca8ed-e35a-4003-ae89-66c4712bea45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:04.498948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-703ca8ed-e35a-4003-ae89-66c4712bea45 None None] MFA Rules not processed for user `0597959f9e854041987ea84078dd617f`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:04.500182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-703ca8ed-e35a-4003-ae89-66c4712bea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:04.563314 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1360/2722] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:04.576007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a030ac-d36e-47c9-9ccd-65fd497c29bb admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:04.577554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-28a030ac-d36e-47c9-9ccd-65fd497c29bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:04.609201 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:04.638661 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a030ac-d36e-47c9-9ccd-65fd497c29bb admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:04.642330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c4fd3-dbce-4ee8-b2db-6d35fc2fdf64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:04.642961 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c4fd3-dbce-4ee8-b2db-6d35fc2fdf64 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:04.643249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c4fd3-dbce-4ee8-b2db-6d35fc2fdf64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:04.643522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c4fd3-dbce-4ee8-b2db-6d35fc2fdf64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:04.651952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c4fd3-dbce-4ee8-b2db-6d35fc2fdf64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:04.653372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c4fd3-dbce-4ee8-b2db-6d35fc2fdf64 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:04.662670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1363/2723] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:11.116657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca8ed-e35a-4003-ae89-66c4712bea45 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:11.118164 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-703ca8ed-e35a-4003-ae89-66c4712bea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:11.220739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca8ed-e35a-4003-ae89-66c4712bea45 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:11.228992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c21ac-1359-4765-a992-0b2c297febbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:11.229720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c21ac-1359-4765-a992-0b2c297febbe service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:11.230095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c21ac-1359-4765-a992-0b2c297febbe service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:11.230443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c21ac-1359-4765-a992-0b2c297febbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:11.232625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-395c21ac-1359-4765-a992-0b2c297febbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:11.248143 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c21ac-1359-4765-a992-0b2c297febbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:11.250121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c21ac-1359-4765-a992-0b2c297febbe service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:11.274571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1361/2724] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:14.658597 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=14 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:15.233963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c4fd3-dbce-4ee8-b2db-6d35fc2fdf64 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:15.307952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c4fd3-dbce-4ee8-b2db-6d35fc2fdf64 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:15.312501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:15.313104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:15.313379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:15.313647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] PATH_INFO: `/v3/users/0597959f9e854041987ea84078dd617f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:15.314774 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] RBAC: Authorizing `identity:delete_user(user_id=0597959f9e854041987ea84078dd617f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:15.316671 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:15.361740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0597959f9e854041987ea84078dd617f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:15.362380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0597959f9e854041987ea84078dd617f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:15.369095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0597959f9e854041987ea84078dd617f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:15.377095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0597959f9e854041987ea84078dd617f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:15.389996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0597959f9e854041987ea84078dd617f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:15.396218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1364/2725] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:23:15 2022] DELETE /identity/v3/users/0597959f9e854041987ea84078dd617f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:15.400402 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2ff51-9670-44a5-868d-40fab66db096 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:15.401523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2ff51-9670-44a5-868d-40fab66db096 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:15.401523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2ff51-9670-44a5-868d-40fab66db096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:15.420151 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-91d2ff51-9670-44a5-868d-40fab66db096 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:15.421354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-91d2ff51-9670-44a5-868d-40fab66db096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:15.471665 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:15.481582 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1362/2726] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:15.491435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:15.492834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:15.550477 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ded7e-3284-4a9b-a414-a674984d8fab admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:15.554068 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bccc79-0291-431e-8d76-0aa2124fe610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:15.554661 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bccc79-0291-431e-8d76-0aa2124fe610 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:15.554959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bccc79-0291-431e-8d76-0aa2124fe610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:15.555224 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bccc79-0291-431e-8d76-0aa2124fe610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:15.564787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bccc79-0291-431e-8d76-0aa2124fe610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:15.566247 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bccc79-0291-431e-8d76-0aa2124fe610 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:15.576154 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1365/2727] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:15.745657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2ff51-9670-44a5-868d-40fab66db096 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:15.747233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-91d2ff51-9670-44a5-868d-40fab66db096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:15.762413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2ff51-9670-44a5-868d-40fab66db096 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:15.768122 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da612fcf-0e8c-4ae1-a70f-2a08b554435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:15.768754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da612fcf-0e8c-4ae1-a70f-2a08b554435f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:15.769036 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da612fcf-0e8c-4ae1-a70f-2a08b554435f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:15.769309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da612fcf-0e8c-4ae1-a70f-2a08b554435f admin admin] PATH_INFO: `/v3/projects/bb6f7dd7066248aa9979120079258ee0` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:15.770464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da612fcf-0e8c-4ae1-a70f-2a08b554435f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6f7dd7066248aa9979120079258ee0)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:15.772393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da612fcf-0e8c-4ae1-a70f-2a08b554435f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:15.819041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-da612fcf-0e8c-4ae1-a70f-2a08b554435f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6f7dd7066248aa9979120079258ee0', 'request_id': 'req-da612fcf-0e8c-4ae1-a70f-2a08b554435f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:15.826472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-da612fcf-0e8c-4ae1-a70f-2a08b554435f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6f7dd7066248aa9979120079258ee0', 'request_id': 'req-da612fcf-0e8c-4ae1-a70f-2a08b554435f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:15.832583 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-da612fcf-0e8c-4ae1-a70f-2a08b554435f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6f7dd7066248aa9979120079258ee0', 'request_id': 'req-da612fcf-0e8c-4ae1-a70f-2a08b554435f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:15.843398 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-da612fcf-0e8c-4ae1-a70f-2a08b554435f admin admin] The token cache is being invalidate because project bb6f7dd7066248aa9979120079258ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:23:15.843683 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-da612fcf-0e8c-4ae1-a70f-2a08b554435f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:15.844300 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-da612fcf-0e8c-4ae1-a70f-2a08b554435f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:15.845775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1363/2728] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:23:15 2022] DELETE /identity/v3/projects/bb6f7dd7066248aa9979120079258ee0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:15.851107 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6602c29-6645-4a17-a5bf-d31c1d4d6a58 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:15.851560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6602c29-6645-4a17-a5bf-d31c1d4d6a58 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:15.851670 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6602c29-6645-4a17-a5bf-d31c1d4d6a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:15.870648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a6602c29-6645-4a17-a5bf-d31c1d4d6a58 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:15.871913 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a6602c29-6645-4a17-a5bf-d31c1d4d6a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:15.888893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:15.934235 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1366/2729] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:15.942009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e3f82-e5cd-4ada-af64-7da1a272e0af None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:15.942299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e3f82-e5cd-4ada-af64-7da1a272e0af None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:15.942572 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e3f82-e5cd-4ada-af64-7da1a272e0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:15.962571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cd1e3f82-e5cd-4ada-af64-7da1a272e0af None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:15.964405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cd1e3f82-e5cd-4ada-af64-7da1a272e0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:15.972281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1364/2730] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:15.976442 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6602c29-6645-4a17-a5bf-d31c1d4d6a58 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:15.985794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6602c29-6645-4a17-a5bf-d31c1d4d6a58 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:15.990276 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc6150-fb20-4605-9bdf-b9fae7ad2c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:15.990892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6150-fb20-4605-9bdf-b9fae7ad2c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:15.991168 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6150-fb20-4605-9bdf-b9fae7ad2c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:15.991435 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6150-fb20-4605-9bdf-b9fae7ad2c28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:15.992065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc6150-fb20-4605-9bdf-b9fae7ad2c28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:23:15.992360 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc6150-fb20-4605-9bdf-b9fae7ad2c28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:15.993930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc6150-fb20-4605-9bdf-b9fae7ad2c28 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:16.005075 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1367/2731] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:23:16.009160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e3f82-e5cd-4ada-af64-7da1a272e0af None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:16.018880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e3f82-e5cd-4ada-af64-7da1a272e0af None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:16.023560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46c3b2-fa96-47f7-93f9-152092fe65dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:16.024143 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46c3b2-fa96-47f7-93f9-152092fe65dd admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:16.024418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46c3b2-fa96-47f7-93f9-152092fe65dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:16.024685 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46c3b2-fa96-47f7-93f9-152092fe65dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:16.025312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46c3b2-fa96-47f7-93f9-152092fe65dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:16.027831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46c3b2-fa96-47f7-93f9-152092fe65dd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:16.053986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1365/2732] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:23:16 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:16.058407 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc6150-fb20-4605-9bdf-b9fae7ad2c28 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:16.068377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc6150-fb20-4605-9bdf-b9fae7ad2c28 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:16.123881 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140813a7-d826-4eba-9a67-4fac1325fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:16.124361 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140813a7-d826-4eba-9a67-4fac1325fca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:16.124639 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140813a7-d826-4eba-9a67-4fac1325fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:16.124908 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140813a7-d826-4eba-9a67-4fac1325fca4 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:16.125560 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140813a7-d826-4eba-9a67-4fac1325fca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:16.127506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140813a7-d826-4eba-9a67-4fac1325fca4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:16.149535 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1368/2733] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:23:16 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:16.154404 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46c3b2-fa96-47f7-93f9-152092fe65dd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:16.165146 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46c3b2-fa96-47f7-93f9-152092fe65dd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:16.169881 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768a9e4-22a5-4274-81fd-8539ff8cf211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:16.170520 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768a9e4-22a5-4274-81fd-8539ff8cf211 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:16.170870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768a9e4-22a5-4274-81fd-8539ff8cf211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:16.171128 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768a9e4-22a5-4274-81fd-8539ff8cf211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:16.171788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768a9e4-22a5-4274-81fd-8539ff8cf211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:16.173408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768a9e4-22a5-4274-81fd-8539ff8cf211 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:16.183969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1366/2734] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:16.187662 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140813a7-d826-4eba-9a67-4fac1325fca4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:16.197479 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140813a7-d826-4eba-9a67-4fac1325fca4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:16.202834 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc86f5-bcd5-4115-ac00-48b77314aae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:16.203420 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc86f5-bcd5-4115-ac00-48b77314aae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:16.203701 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc86f5-bcd5-4115-ac00-48b77314aae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:16.203986 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc86f5-bcd5-4115-ac00-48b77314aae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:16.204598 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc86f5-bcd5-4115-ac00-48b77314aae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:16.206167 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc86f5-bcd5-4115-ac00-48b77314aae8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:16.216494 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1369/2735] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:16.220550 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768a9e4-22a5-4274-81fd-8539ff8cf211 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:16.230303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768a9e4-22a5-4274-81fd-8539ff8cf211 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:16.235142 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1be28d-f9b0-41c0-8d7c-070acada3ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:16.235809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1be28d-f9b0-41c0-8d7c-070acada3ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:16.236108 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1be28d-f9b0-41c0-8d7c-070acada3ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:16.236376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1be28d-f9b0-41c0-8d7c-070acada3ef2 admin admin] PATH_INFO: `/v3/projects/cf6bd8a6d0dd4a2da19d392bd090d3cb/users/d35d8ccee4284309907c4a5d0f0fdeb8/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:16.252378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1be28d-f9b0-41c0-8d7c-070acada3ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6bd8a6d0dd4a2da19d392bd090d3cb, user_id=d35d8ccee4284309907c4a5d0f0fdeb8, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:16.255692 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1be28d-f9b0-41c0-8d7c-070acada3ef2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:16.268855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1367/2736] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:23:16 2022] PUT /identity/v3/projects/cf6bd8a6d0dd4a2da19d392bd090d3cb/users/d35d8ccee4284309907c4a5d0f0fdeb8/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:16.279349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91caf6a8-9f55-4356-b63c-664169d41ab4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:16.279634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91caf6a8-9f55-4356-b63c-664169d41ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:16.279930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91caf6a8-9f55-4356-b63c-664169d41ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:16.308740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-91caf6a8-9f55-4356-b63c-664169d41ab4 None None] MFA Rules not processed for user `d35d8ccee4284309907c4a5d0f0fdeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:16.309946 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-91caf6a8-9f55-4356-b63c-664169d41ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:16.372191 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1370/2737] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:16.381954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1be28d-f9b0-41c0-8d7c-070acada3ef2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:16.383708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7a1be28d-f9b0-41c0-8d7c-070acada3ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:16.560410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1be28d-f9b0-41c0-8d7c-070acada3ef2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:16.564273 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcae4f-f58b-45fa-9ac9-1a7559efb589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:16.564870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcae4f-f58b-45fa-9ac9-1a7559efb589 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:16.565140 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcae4f-f58b-45fa-9ac9-1a7559efb589 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:16.565406 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcae4f-f58b-45fa-9ac9-1a7559efb589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:16.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcae4f-f58b-45fa-9ac9-1a7559efb589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:16.574769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcae4f-f58b-45fa-9ac9-1a7559efb589 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:16.583118 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1368/2738] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:20.968743 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91caf6a8-9f55-4356-b63c-664169d41ab4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:20.988714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:21.050610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91caf6a8-9f55-4356-b63c-664169d41ab4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.055242 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.055878 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.056152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.056673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] PATH_INFO: `/v3/users/d35d8ccee4284309907c4a5d0f0fdeb8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.057857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35d8ccee4284309907c4a5d0f0fdeb8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.059798 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.104748 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35d8ccee4284309907c4a5d0f0fdeb8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:21.105457 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35d8ccee4284309907c4a5d0f0fdeb8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:21.114144 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35d8ccee4284309907c4a5d0f0fdeb8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:21.123184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35d8ccee4284309907c4a5d0f0fdeb8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:21.135799 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35d8ccee4284309907c4a5d0f0fdeb8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:21.141792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1371/2739] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:23:20 2022] DELETE /identity/v3/users/d35d8ccee4284309907c4a5d0f0fdeb8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:21.146471 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce0c7b-c29c-4f44-a1c6-e6c22e43ef59 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.146980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce0c7b-c29c-4f44-a1c6-e6c22e43ef59 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.147079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce0c7b-c29c-4f44-a1c6-e6c22e43ef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.177407 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:21.188401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-66ce0c7b-c29c-4f44-a1c6-e6c22e43ef59 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:21.189592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-66ce0c7b-c29c-4f44-a1c6-e6c22e43ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:21.247196 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1369/2740] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:23:21.256857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.258408 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:21.326908 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a351dca-a2cc-434f-9f38-85d27881d6bd admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.330457 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7fe7f-564a-44aa-b38a-3f52b7e2e1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.331092 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7fe7f-564a-44aa-b38a-3f52b7e2e1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.331369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7fe7f-564a-44aa-b38a-3f52b7e2e1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.331636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7fe7f-564a-44aa-b38a-3f52b7e2e1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.340780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7fe7f-564a-44aa-b38a-3f52b7e2e1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.342263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7fe7f-564a-44aa-b38a-3f52b7e2e1a9 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.351884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1372/2741] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:21.527672 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce0c7b-c29c-4f44-a1c6-e6c22e43ef59 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.529102 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-66ce0c7b-c29c-4f44-a1c6-e6c22e43ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:21.543335 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce0c7b-c29c-4f44-a1c6-e6c22e43ef59 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.547954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934531f4-779b-4dec-b813-e9fbf7d52e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.548584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934531f4-779b-4dec-b813-e9fbf7d52e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.549381 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934531f4-779b-4dec-b813-e9fbf7d52e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.549660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934531f4-779b-4dec-b813-e9fbf7d52e75 admin admin] PATH_INFO: `/v3/projects/cf6bd8a6d0dd4a2da19d392bd090d3cb` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.550981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934531f4-779b-4dec-b813-e9fbf7d52e75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf6bd8a6d0dd4a2da19d392bd090d3cb)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.552868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934531f4-779b-4dec-b813-e9fbf7d52e75 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.599170 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-934531f4-779b-4dec-b813-e9fbf7d52e75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6bd8a6d0dd4a2da19d392bd090d3cb', 'request_id': 'req-934531f4-779b-4dec-b813-e9fbf7d52e75'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:21.607371 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-934531f4-779b-4dec-b813-e9fbf7d52e75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6bd8a6d0dd4a2da19d392bd090d3cb', 'request_id': 'req-934531f4-779b-4dec-b813-e9fbf7d52e75'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:21.613506 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-934531f4-779b-4dec-b813-e9fbf7d52e75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6bd8a6d0dd4a2da19d392bd090d3cb', 'request_id': 'req-934531f4-779b-4dec-b813-e9fbf7d52e75'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:21.624736 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-934531f4-779b-4dec-b813-e9fbf7d52e75 admin admin] The token cache is being invalidate because project cf6bd8a6d0dd4a2da19d392bd090d3cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:23:21.625021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-934531f4-779b-4dec-b813-e9fbf7d52e75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:21.625727 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-934531f4-779b-4dec-b813-e9fbf7d52e75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:21.627273 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1370/2742] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:23:21 2022] DELETE /identity/v3/projects/cf6bd8a6d0dd4a2da19d392bd090d3cb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:21.632209 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f85fa2-259b-401e-8882-ef7940ae29d0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.632487 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f85fa2-259b-401e-8882-ef7940ae29d0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.632752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f85fa2-259b-401e-8882-ef7940ae29d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.652120 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-81f85fa2-259b-401e-8882-ef7940ae29d0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:21.653292 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-81f85fa2-259b-401e-8882-ef7940ae29d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:21.661331 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:21.711690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1373/2743] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:21.719413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5cce8-ce84-41ef-9b4b-616ad79d43b6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.719703 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5cce8-ce84-41ef-9b4b-616ad79d43b6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.719980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5cce8-ce84-41ef-9b4b-616ad79d43b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.739128 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8dc5cce8-ce84-41ef-9b4b-616ad79d43b6 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:21.740319 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8dc5cce8-ce84-41ef-9b4b-616ad79d43b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:21.748655 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1371/2744] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:21.752663 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f85fa2-259b-401e-8882-ef7940ae29d0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.762529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f85fa2-259b-401e-8882-ef7940ae29d0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.768392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5b6a1-570b-4492-8ed3-fba1e4632b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.769028 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b6a1-570b-4492-8ed3-fba1e4632b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.769307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b6a1-570b-4492-8ed3-fba1e4632b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.769631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b6a1-570b-4492-8ed3-fba1e4632b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.770225 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5b6a1-570b-4492-8ed3-fba1e4632b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:23:21.770530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5b6a1-570b-4492-8ed3-fba1e4632b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.772171 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5b6a1-570b-4492-8ed3-fba1e4632b7c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.787037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1374/2745] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:23:21.788178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5cce8-ce84-41ef-9b4b-616ad79d43b6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.797971 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5cce8-ce84-41ef-9b4b-616ad79d43b6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.802590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf54db-dd85-447a-b5b3-96f43d12ea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.803213 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf54db-dd85-447a-b5b3-96f43d12ea6d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.803490 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf54db-dd85-447a-b5b3-96f43d12ea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.803757 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf54db-dd85-447a-b5b3-96f43d12ea6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.804383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf54db-dd85-447a-b5b3-96f43d12ea6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.806260 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf54db-dd85-447a-b5b3-96f43d12ea6d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.834100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1372/2746] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:23:21 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:21.838846 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5b6a1-570b-4492-8ed3-fba1e4632b7c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.848596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5b6a1-570b-4492-8ed3-fba1e4632b7c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.904284 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f31c61-48ba-4ee2-9a25-ff9cabc381b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.904871 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f31c61-48ba-4ee2-9a25-ff9cabc381b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.905148 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f31c61-48ba-4ee2-9a25-ff9cabc381b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.905418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f31c61-48ba-4ee2-9a25-ff9cabc381b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.906034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f31c61-48ba-4ee2-9a25-ff9cabc381b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.907970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f31c61-48ba-4ee2-9a25-ff9cabc381b6 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.928942 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1375/2747] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:23:21 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:21.933855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf54db-dd85-447a-b5b3-96f43d12ea6d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.945483 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf54db-dd85-447a-b5b3-96f43d12ea6d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.950627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f8d8-9f9e-4bbe-b9fe-8d9a7054b17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.951250 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f8d8-9f9e-4bbe-b9fe-8d9a7054b17f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.951524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f8d8-9f9e-4bbe-b9fe-8d9a7054b17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.951792 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f8d8-9f9e-4bbe-b9fe-8d9a7054b17f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.952425 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9f8d8-9f9e-4bbe-b9fe-8d9a7054b17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.954045 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9f8d8-9f9e-4bbe-b9fe-8d9a7054b17f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.964602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1373/2748] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:21.968430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f31c61-48ba-4ee2-9a25-ff9cabc381b6 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f31c61-48ba-4ee2-9a25-ff9cabc381b6 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.982744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a501f-ac03-4997-a85b-af7b748912c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.983340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a501f-ac03-4997-a85b-af7b748912c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.983612 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a501f-ac03-4997-a85b-af7b748912c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.983879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a501f-ac03-4997-a85b-af7b748912c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.984501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a501f-ac03-4997-a85b-af7b748912c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.986057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a501f-ac03-4997-a85b-af7b748912c8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.996383 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1376/2749] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:22.000307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f8d8-9f9e-4bbe-b9fe-8d9a7054b17f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:22.010501 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f8d8-9f9e-4bbe-b9fe-8d9a7054b17f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:22.015046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed0d88-82a4-45bc-a830-681c355c09c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:22.015705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed0d88-82a4-45bc-a830-681c355c09c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:22.015986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed0d88-82a4-45bc-a830-681c355c09c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:22.016254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed0d88-82a4-45bc-a830-681c355c09c5 admin admin] PATH_INFO: `/v3/projects/5314110f14304766ad8a78e546e870b7/users/1a235a722d4d43b6a1c4a16097334f3c/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:22.031006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed0d88-82a4-45bc-a830-681c355c09c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5314110f14304766ad8a78e546e870b7, user_id=1a235a722d4d43b6a1c4a16097334f3c, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:22.033546 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed0d88-82a4-45bc-a830-681c355c09c5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:22.046244 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1374/2750] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:23:21 2022] PUT /identity/v3/projects/5314110f14304766ad8a78e546e870b7/users/1a235a722d4d43b6a1c4a16097334f3c/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:22.051452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935989c-9db8-46df-aa31-d6b9dfa00f30 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:22.051737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935989c-9db8-46df-aa31-d6b9dfa00f30 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:22.052007 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935989c-9db8-46df-aa31-d6b9dfa00f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:22.070636 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8935989c-9db8-46df-aa31-d6b9dfa00f30 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:22.071832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8935989c-9db8-46df-aa31-d6b9dfa00f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:22.131490 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1377/2751] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:22.141479 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed0d88-82a4-45bc-a830-681c355c09c5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:22.143210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e5ed0d88-82a4-45bc-a830-681c355c09c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:22.173969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:22.205967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed0d88-82a4-45bc-a830-681c355c09c5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:22.209708 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df91ea-6e87-45cd-8dd2-8dbaf697a73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:22.210297 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df91ea-6e87-45cd-8dd2-8dbaf697a73c service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:22.210574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df91ea-6e87-45cd-8dd2-8dbaf697a73c service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:22.210883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df91ea-6e87-45cd-8dd2-8dbaf697a73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:22.220072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df91ea-6e87-45cd-8dd2-8dbaf697a73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:22.221480 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df91ea-6e87-45cd-8dd2-8dbaf697a73c service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:22.231160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1375/2752] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:26.270072 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad348912-737d-498e-9338-834ae5c3b762 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:26.270631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad348912-737d-498e-9338-834ae5c3b762 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:26.271161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad348912-737d-498e-9338-834ae5c3b762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:26.302365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ad348912-737d-498e-9338-834ae5c3b762 None None] MFA Rules not processed for user `1a235a722d4d43b6a1c4a16097334f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:26.303614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ad348912-737d-498e-9338-834ae5c3b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:26.314965 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:26.376850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1378/2753] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:26.381508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df91ea-6e87-45cd-8dd2-8dbaf697a73c service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:26.392201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df91ea-6e87-45cd-8dd2-8dbaf697a73c service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:26.396739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19086a4-9857-423d-bcf4-1c5875372f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:26.397555 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19086a4-9857-423d-bcf4-1c5875372f88 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:26.398001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19086a4-9857-423d-bcf4-1c5875372f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:26.398266 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19086a4-9857-423d-bcf4-1c5875372f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:26.398959 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19086a4-9857-423d-bcf4-1c5875372f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:26.401482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19086a4-9857-423d-bcf4-1c5875372f88 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:26.435457 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1376/2754] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:23:26 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:23:26.439372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad348912-737d-498e-9338-834ae5c3b762 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:26.451345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad348912-737d-498e-9338-834ae5c3b762 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:26.513550 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b760bd8-b649-4fcc-a356-80b50ae60b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:26.514166 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b760bd8-b649-4fcc-a356-80b50ae60b2e admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:26.514445 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b760bd8-b649-4fcc-a356-80b50ae60b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:26.514715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b760bd8-b649-4fcc-a356-80b50ae60b2e admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:26.515386 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b760bd8-b649-4fcc-a356-80b50ae60b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:26.517317 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b760bd8-b649-4fcc-a356-80b50ae60b2e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:26.540341 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1379/2755] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:23:26 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:23:26.544432 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19086a4-9857-423d-bcf4-1c5875372f88 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:26.554976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19086a4-9857-423d-bcf4-1c5875372f88 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:26.559846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa607164-86a3-4271-893e-22de5f6577aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:26.560447 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa607164-86a3-4271-893e-22de5f6577aa admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:26.560721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa607164-86a3-4271-893e-22de5f6577aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:26.561003 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa607164-86a3-4271-893e-22de5f6577aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:26.561620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa607164-86a3-4271-893e-22de5f6577aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:26.563264 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa607164-86a3-4271-893e-22de5f6577aa admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:26.574981 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1377/2756] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:26.579129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b760bd8-b649-4fcc-a356-80b50ae60b2e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:26.590947 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b760bd8-b649-4fcc-a356-80b50ae60b2e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:26.595715 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7940c-3b3a-4e55-8193-2f966feb45f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:26.596346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7940c-3b3a-4e55-8193-2f966feb45f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:26.596695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7940c-3b3a-4e55-8193-2f966feb45f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:26.596928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7940c-3b3a-4e55-8193-2f966feb45f1 admin admin] PATH_INFO: `/v3/projects/19beea5850e948588205c5d15b8c9f29/users/be6e590e8d7743a898c40cad0efe7930/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:26.612852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7940c-3b3a-4e55-8193-2f966feb45f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19beea5850e948588205c5d15b8c9f29, user_id=be6e590e8d7743a898c40cad0efe7930, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:26.615538 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7940c-3b3a-4e55-8193-2f966feb45f1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:26.628437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1380/2757] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:23:26 2022] PUT /identity/v3/projects/19beea5850e948588205c5d15b8c9f29/users/be6e590e8d7743a898c40cad0efe7930/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:26.632391 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa607164-86a3-4271-893e-22de5f6577aa admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:26.642796 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa607164-86a3-4271-893e-22de5f6577aa admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:26.698496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f1872-5328-4c15-8397-7a70734ac65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:26.699124 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f1872-5328-4c15-8397-7a70734ac65a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:26.699405 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f1872-5328-4c15-8397-7a70734ac65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:26.699673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f1872-5328-4c15-8397-7a70734ac65a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:26.700293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f1872-5328-4c15-8397-7a70734ac65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:26.701861 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f1872-5328-4c15-8397-7a70734ac65a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:26.711401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1378/2758] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:26.715652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7940c-3b3a-4e55-8193-2f966feb45f1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:26.725530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7940c-3b3a-4e55-8193-2f966feb45f1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:26.730241 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87624f3-b497-49de-95ce-cf0d01aa2617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:26.730908 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87624f3-b497-49de-95ce-cf0d01aa2617 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:26.731184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87624f3-b497-49de-95ce-cf0d01aa2617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:26.731451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87624f3-b497-49de-95ce-cf0d01aa2617 admin admin] PATH_INFO: `/v3/projects/19beea5850e948588205c5d15b8c9f29/users/be6e590e8d7743a898c40cad0efe7930/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:26.733344 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87624f3-b497-49de-95ce-cf0d01aa2617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19beea5850e948588205c5d15b8c9f29, user_id=be6e590e8d7743a898c40cad0efe7930, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:26.735971 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87624f3-b497-49de-95ce-cf0d01aa2617 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:26.750403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1381/2759] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:23:26 2022] PUT /identity/v3/projects/19beea5850e948588205c5d15b8c9f29/users/be6e590e8d7743a898c40cad0efe7930/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:23:31.273224 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ecf0b-a94f-4796-a3eb-b47cb24e7157 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:31.273735 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ecf0b-a94f-4796-a3eb-b47cb24e7157 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:31.273851 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ecf0b-a94f-4796-a3eb-b47cb24e7157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:31.307487 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8b0ecf0b-a94f-4796-a3eb-b47cb24e7157 None None] MFA Rules not processed for user `be6e590e8d7743a898c40cad0efe7930`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:31.308991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8b0ecf0b-a94f-4796-a3eb-b47cb24e7157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:31.391992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1379/2760] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:31.409643 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87624f3-b497-49de-95ce-cf0d01aa2617 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:31.412267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c87624f3-b497-49de-95ce-cf0d01aa2617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:31.499747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:31.549098 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87624f3-b497-49de-95ce-cf0d01aa2617 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:31.555295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8880-2df9-4351-a745-5d371208c207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:31.556012 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8880-2df9-4351-a745-5d371208c207 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:31.557329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8880-2df9-4351-a745-5d371208c207 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:31.557329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8880-2df9-4351-a745-5d371208c207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:31.623791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d8880-2df9-4351-a745-5d371208c207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:31.625514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d8880-2df9-4351-a745-5d371208c207 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:31.637183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1382/2761] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:31.702315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4a336-38c7-41e9-ba98-3e4a96cb5818 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:31.702762 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4a336-38c7-41e9-ba98-3e4a96cb5818 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:31.703135 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4a336-38c7-41e9-ba98-3e4a96cb5818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:31.724110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cce4a336-38c7-41e9-ba98-3e4a96cb5818 None None] MFA Rules not processed for user `1a235a722d4d43b6a1c4a16097334f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:31.725337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cce4a336-38c7-41e9-ba98-3e4a96cb5818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:31.732559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1380/2762] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:23:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:32.002307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8880-2df9-4351-a745-5d371208c207 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:32.003706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bb5d8880-2df9-4351-a745-5d371208c207 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:32.059698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8880-2df9-4351-a745-5d371208c207 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:32.063233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b7405-19f4-4739-8b6e-ae7b55ff99d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:32.063920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b7405-19f4-4739-8b6e-ae7b55ff99d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:32.064194 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b7405-19f4-4739-8b6e-ae7b55ff99d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:32.064458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b7405-19f4-4739-8b6e-ae7b55ff99d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:32.066131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bf4b7405-19f4-4739-8b6e-ae7b55ff99d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:32.075303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b7405-19f4-4739-8b6e-ae7b55ff99d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:32.076692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b7405-19f4-4739-8b6e-ae7b55ff99d5 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:32.084411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1383/2763] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:41.718030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:42.080523 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4a336-38c7-41e9-ba98-3e4a96cb5818 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:42.080853 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=66 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:42.082183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cce4a336-38c7-41e9-ba98-3e4a96cb5818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:42.140511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4a336-38c7-41e9-ba98-3e4a96cb5818 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:42.144193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9240de8-68e9-4bbc-8d79-4bebb17a9332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecc9e16475344b78bb885437b5d6bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:42.144789 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9240de8-68e9-4bbc-8d79-4bebb17a9332 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:42.145059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9240de8-68e9-4bbc-8d79-4bebb17a9332 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:42.145321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9240de8-68e9-4bbc-8d79-4bebb17a9332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:42.154476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9240de8-68e9-4bbc-8d79-4bebb17a9332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:42.155950 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9240de8-68e9-4bbc-8d79-4bebb17a9332 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:42.167132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1381/2764] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:52.161907 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=26 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:07.534640 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1143f0-17fb-42eb-ad9c-ac4e0c290565 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:07.535233 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1143f0-17fb-42eb-ad9c-ac4e0c290565 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:07.535340 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1143f0-17fb-42eb-ad9c-ac4e0c290565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:07.555431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-fc1143f0-17fb-42eb-ad9c-ac4e0c290565 None None] MFA Rules not processed for user `1a235a722d4d43b6a1c4a16097334f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:07.556611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fc1143f0-17fb-42eb-ad9c-ac4e0c290565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:07.564350 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1384/2765] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:24:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:17.549031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:44.278178 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23a221-d586-4dcb-af33-1c5592f72044 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:44.278714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23a221-d586-4dcb-af33-1c5592f72044 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:44.278714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23a221-d586-4dcb-af33-1c5592f72044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:44.297757 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6a23a221-d586-4dcb-af33-1c5592f72044 None None] MFA Rules not processed for user `1a235a722d4d43b6a1c4a16097334f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:44.298970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6a23a221-d586-4dcb-af33-1c5592f72044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:44.306041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1382/2766] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:46.476883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1143f0-17fb-42eb-ad9c-ac4e0c290565 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:46.487920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1143f0-17fb-42eb-ad9c-ac4e0c290565 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:46.491509 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e690b14-528d-4b4c-b817-c7be9c6bed54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:46.492173 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e690b14-528d-4b4c-b817-c7be9c6bed54 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:46.492450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e690b14-528d-4b4c-b817-c7be9c6bed54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:46.492718 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e690b14-528d-4b4c-b817-c7be9c6bed54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:46.494505 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8e690b14-528d-4b4c-b817-c7be9c6bed54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:46.519426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e690b14-528d-4b4c-b817-c7be9c6bed54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:46.520897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e690b14-528d-4b4c-b817-c7be9c6bed54 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:46.529569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1385/2767] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:24:54.291695 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:56.525616 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=11 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:27.374939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23a221-d586-4dcb-af33-1c5592f72044 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.442401 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23a221-d586-4dcb-af33-1c5592f72044 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.446955 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.447574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.447847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.448109 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] PATH_INFO: `/v3/users/1a235a722d4d43b6a1c4a16097334f3c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.449875 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a235a722d4d43b6a1c4a16097334f3c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.451791 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.495792 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a235a722d4d43b6a1c4a16097334f3c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.507706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a235a722d4d43b6a1c4a16097334f3c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.515133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a235a722d4d43b6a1c4a16097334f3c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.522360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a235a722d4d43b6a1c4a16097334f3c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.522967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a235a722d4d43b6a1c4a16097334f3c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.529034 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1383/2768] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:27 2022] DELETE /identity/v3/users/1a235a722d4d43b6a1c4a16097334f3c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:27.697992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e690b14-528d-4b4c-b817-c7be9c6bed54 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.710381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e690b14-528d-4b4c-b817-c7be9c6bed54 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.770042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.770669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.770978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.771249 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] PATH_INFO: `/v3/projects/5314110f14304766ad8a78e546e870b7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.772436 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5314110f14304766ad8a78e546e870b7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.774247 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.819785 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5314110f14304766ad8a78e546e870b7', 'request_id': 'req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.825692 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5314110f14304766ad8a78e546e870b7', 'request_id': 'req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.831335 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5314110f14304766ad8a78e546e870b7', 'request_id': 'req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.843127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] The token cache is being invalidate because project 5314110f14304766ad8a78e546e870b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:27.843419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.844080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.845554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1386/2769] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:27 2022] DELETE /identity/v3/projects/5314110f14304766ad8a78e546e870b7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:27.849799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.851223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:27.864545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a21eb9-8729-4ac5-acb2-22d4634c9984 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.920299 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e0691-dbe1-4969-a015-39228ddfaf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.920924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e0691-dbe1-4969-a015-39228ddfaf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.921201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e0691-dbe1-4969-a015-39228ddfaf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.921470 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e0691-dbe1-4969-a015-39228ddfaf0e admin admin] PATH_INFO: `/v3/users/be6e590e8d7743a898c40cad0efe7930` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.922584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e0691-dbe1-4969-a015-39228ddfaf0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6e590e8d7743a898c40cad0efe7930)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.924530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e0691-dbe1-4969-a015-39228ddfaf0e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.946160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:27.974238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-951e0691-dbe1-4969-a015-39228ddfaf0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6e590e8d7743a898c40cad0efe7930'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.986635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-951e0691-dbe1-4969-a015-39228ddfaf0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6e590e8d7743a898c40cad0efe7930'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.993427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-951e0691-dbe1-4969-a015-39228ddfaf0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6e590e8d7743a898c40cad0efe7930'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:28.001904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-951e0691-dbe1-4969-a015-39228ddfaf0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6e590e8d7743a898c40cad0efe7930'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:28.002632 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-951e0691-dbe1-4969-a015-39228ddfaf0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6e590e8d7743a898c40cad0efe7930'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:28.008593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1384/2770] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:27 2022] DELETE /identity/v3/users/be6e590e8d7743a898c40cad0efe7930 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:28.185640 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.187067 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:28.200892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b42ff-b267-46cc-be2a-c6d87bcf2b3c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.258315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883012f-d990-45a0-95c6-56ac6d25d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.258974 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883012f-d990-45a0-95c6-56ac6d25d808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.259247 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883012f-d990-45a0-95c6-56ac6d25d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.259512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883012f-d990-45a0-95c6-56ac6d25d808 admin admin] PATH_INFO: `/v3/projects/19beea5850e948588205c5d15b8c9f29` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.260607 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883012f-d990-45a0-95c6-56ac6d25d808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19beea5850e948588205c5d15b8c9f29)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.262578 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883012f-d990-45a0-95c6-56ac6d25d808 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.296378 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:28.311304 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2883012f-d990-45a0-95c6-56ac6d25d808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19beea5850e948588205c5d15b8c9f29', 'request_id': 'req-2883012f-d990-45a0-95c6-56ac6d25d808'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:28.317469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2883012f-d990-45a0-95c6-56ac6d25d808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19beea5850e948588205c5d15b8c9f29', 'request_id': 'req-2883012f-d990-45a0-95c6-56ac6d25d808'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:28.323059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2883012f-d990-45a0-95c6-56ac6d25d808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19beea5850e948588205c5d15b8c9f29', 'request_id': 'req-2883012f-d990-45a0-95c6-56ac6d25d808'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:28.335733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2883012f-d990-45a0-95c6-56ac6d25d808 admin admin] The token cache is being invalidate because project 19beea5850e948588205c5d15b8c9f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:28.336021 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2883012f-d990-45a0-95c6-56ac6d25d808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:28.336638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2883012f-d990-45a0-95c6-56ac6d25d808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:28.338126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1387/2771] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:28 2022] DELETE /identity/v3/projects/19beea5850e948588205c5d15b8c9f29 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:28.343651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c7172-cd26-4cfb-bbd7-dbc711cd4f52 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.343933 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c7172-cd26-4cfb-bbd7-dbc711cd4f52 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.344200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c7172-cd26-4cfb-bbd7-dbc711cd4f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.391072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1b9c7172-cd26-4cfb-bbd7-dbc711cd4f52 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:28.392250 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1b9c7172-cd26-4cfb-bbd7-dbc711cd4f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:28.450642 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1385/2772] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:28.458297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf04ff-702f-4947-af23-0a6be9159edd None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.458606 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf04ff-702f-4947-af23-0a6be9159edd None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.458927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf04ff-702f-4947-af23-0a6be9159edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.478785 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2faf04ff-702f-4947-af23-0a6be9159edd None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:28.480579 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2faf04ff-702f-4947-af23-0a6be9159edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:28.488280 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1388/2773] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:28.492366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c7172-cd26-4cfb-bbd7-dbc711cd4f52 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.501900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c7172-cd26-4cfb-bbd7-dbc711cd4f52 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.506460 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e0e45-50f2-4be2-bb8b-dd87e04b399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.507085 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e0e45-50f2-4be2-bb8b-dd87e04b399a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.507362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e0e45-50f2-4be2-bb8b-dd87e04b399a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.507631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e0e45-50f2-4be2-bb8b-dd87e04b399a admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.508268 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e0e45-50f2-4be2-bb8b-dd87e04b399a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:28.508567 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e0e45-50f2-4be2-bb8b-dd87e04b399a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.510150 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e0e45-50f2-4be2-bb8b-dd87e04b399a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.522505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1386/2774] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:28.526513 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf04ff-702f-4947-af23-0a6be9159edd None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.536054 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf04ff-702f-4947-af23-0a6be9159edd None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.540917 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa164cc3-880a-4efc-bc6d-51c98a5d7f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.541489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa164cc3-880a-4efc-bc6d-51c98a5d7f8e admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.541759 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa164cc3-880a-4efc-bc6d-51c98a5d7f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.542023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa164cc3-880a-4efc-bc6d-51c98a5d7f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.542688 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa164cc3-880a-4efc-bc6d-51c98a5d7f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.544582 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa164cc3-880a-4efc-bc6d-51c98a5d7f8e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.581676 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1389/2775] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:28 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:28.585806 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e0e45-50f2-4be2-bb8b-dd87e04b399a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.595985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e0e45-50f2-4be2-bb8b-dd87e04b399a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.655191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd7b89-0ccc-44f6-b1bf-b2a9e7afa212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.655788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd7b89-0ccc-44f6-b1bf-b2a9e7afa212 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.656064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd7b89-0ccc-44f6-b1bf-b2a9e7afa212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.656332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd7b89-0ccc-44f6-b1bf-b2a9e7afa212 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.656967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd7b89-0ccc-44f6-b1bf-b2a9e7afa212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.658881 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd7b89-0ccc-44f6-b1bf-b2a9e7afa212 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.667574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:28.680577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1387/2776] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:28 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:28.685119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa164cc3-880a-4efc-bc6d-51c98a5d7f8e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.695112 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa164cc3-880a-4efc-bc6d-51c98a5d7f8e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.700087 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e82fb-c4c4-4f5e-a058-81cc27acda9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.700659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e82fb-c4c4-4f5e-a058-81cc27acda9c admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.700932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e82fb-c4c4-4f5e-a058-81cc27acda9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.701200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e82fb-c4c4-4f5e-a058-81cc27acda9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.701826 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e82fb-c4c4-4f5e-a058-81cc27acda9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.703420 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e82fb-c4c4-4f5e-a058-81cc27acda9c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.712887 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1390/2777] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:28.717323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd7b89-0ccc-44f6-b1bf-b2a9e7afa212 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.727149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd7b89-0ccc-44f6-b1bf-b2a9e7afa212 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.731739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160f689-a207-4c99-81c9-a27905c497a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.732316 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160f689-a207-4c99-81c9-a27905c497a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.732590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160f689-a207-4c99-81c9-a27905c497a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.732856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160f689-a207-4c99-81c9-a27905c497a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.733482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160f689-a207-4c99-81c9-a27905c497a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.735096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160f689-a207-4c99-81c9-a27905c497a5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.744676 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1388/2778] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:28.748552 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e82fb-c4c4-4f5e-a058-81cc27acda9c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.758118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e82fb-c4c4-4f5e-a058-81cc27acda9c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.763105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09ef5b-d6d7-4e9f-abe3-babc2ee09403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.763761 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09ef5b-d6d7-4e9f-abe3-babc2ee09403 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.764036 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09ef5b-d6d7-4e9f-abe3-babc2ee09403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.764303 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09ef5b-d6d7-4e9f-abe3-babc2ee09403 admin admin] PATH_INFO: `/v3/projects/ce33468ddbf542478a79463d351cc1c5/users/6d40431cce8e4115a13faa77e8a14d31/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.779472 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09ef5b-d6d7-4e9f-abe3-babc2ee09403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce33468ddbf542478a79463d351cc1c5, user_id=6d40431cce8e4115a13faa77e8a14d31, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.782153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09ef5b-d6d7-4e9f-abe3-babc2ee09403 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.795478 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1391/2779] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:28 2022] PUT /identity/v3/projects/ce33468ddbf542478a79463d351cc1c5/users/6d40431cce8e4115a13faa77e8a14d31/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:28.800417 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aedd61-4c7d-4404-ae1b-526dcf2bdf97 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.800749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aedd61-4c7d-4404-ae1b-526dcf2bdf97 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.801021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aedd61-4c7d-4404-ae1b-526dcf2bdf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.819954 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-38aedd61-4c7d-4404-ae1b-526dcf2bdf97 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:28.821194 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-38aedd61-4c7d-4404-ae1b-526dcf2bdf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:28.877958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1389/2780] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:28.888177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09ef5b-d6d7-4e9f-abe3-babc2ee09403 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.889875 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-df09ef5b-d6d7-4e9f-abe3-babc2ee09403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:28.946056 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09ef5b-d6d7-4e9f-abe3-babc2ee09403 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.950312 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d7d97-7894-4dcd-b1b6-59d8d600f1d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.950934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d7d97-7894-4dcd-b1b6-59d8d600f1d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.951216 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d7d97-7894-4dcd-b1b6-59d8d600f1d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.951486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d7d97-7894-4dcd-b1b6-59d8d600f1d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.960253 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d7d97-7894-4dcd-b1b6-59d8d600f1d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.961660 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d7d97-7894-4dcd-b1b6-59d8d600f1d1 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.970907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1392/2781] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:32.948738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b03d0b-18b6-42e9-8c91-4b364d21370c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:32.949235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b03d0b-18b6-42e9-8c91-4b364d21370c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:32.949349 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b03d0b-18b6-42e9-8c91-4b364d21370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:32.983912 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-19b03d0b-18b6-42e9-8c91-4b364d21370c None None] MFA Rules not processed for user `6d40431cce8e4115a13faa77e8a14d31`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:32.985723 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-19b03d0b-18b6-42e9-8c91-4b364d21370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:33.076331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1390/2782] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:33.080866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d7d97-7894-4dcd-b1b6-59d8d600f1d1 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:33.094561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d7d97-7894-4dcd-b1b6-59d8d600f1d1 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:33.100469 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e710-fca0-4923-b5fe-d6f8933b125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:33.100755 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e710-fca0-4923-b5fe-d6f8933b125f admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:33.101113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e710-fca0-4923-b5fe-d6f8933b125f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:33.101338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e710-fca0-4923-b5fe-d6f8933b125f admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:33.101948 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82e710-fca0-4923-b5fe-d6f8933b125f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:33.104057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82e710-fca0-4923-b5fe-d6f8933b125f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:33.134265 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1393/2783] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:33 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:33.138599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b03d0b-18b6-42e9-8c91-4b364d21370c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:33.149832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b03d0b-18b6-42e9-8c91-4b364d21370c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:33.219023 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503fcc5-eace-4d43-a71d-f3f03e040feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:33.220126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503fcc5-eace-4d43-a71d-f3f03e040feb admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:33.220608 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503fcc5-eace-4d43-a71d-f3f03e040feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:33.221429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503fcc5-eace-4d43-a71d-f3f03e040feb admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:33.222326 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503fcc5-eace-4d43-a71d-f3f03e040feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:33.224804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503fcc5-eace-4d43-a71d-f3f03e040feb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:33.245104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:33.255250 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1391/2784] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:33 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:33.256131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e710-fca0-4923-b5fe-d6f8933b125f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:33.269038 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e710-fca0-4923-b5fe-d6f8933b125f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:33.275389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943f466-0034-4a7f-8038-cf1a3b22f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:33.276013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943f466-0034-4a7f-8038-cf1a3b22f026 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:33.276289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943f466-0034-4a7f-8038-cf1a3b22f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:33.277127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943f466-0034-4a7f-8038-cf1a3b22f026 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:33.277782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943f466-0034-4a7f-8038-cf1a3b22f026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:33.279436 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943f466-0034-4a7f-8038-cf1a3b22f026 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:33.294602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1394/2785] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:33.296015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503fcc5-eace-4d43-a71d-f3f03e040feb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:33.309362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503fcc5-eace-4d43-a71d-f3f03e040feb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:33.318976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d07df-7676-4714-b83f-255f11e1ec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:33.319758 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d07df-7676-4714-b83f-255f11e1ec5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:33.320115 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d07df-7676-4714-b83f-255f11e1ec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:33.320462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d07df-7676-4714-b83f-255f11e1ec5b admin admin] PATH_INFO: `/v3/projects/195aa4e610f644f681a1669aab5dc3ec/users/76990411cdf147f1ad8454598d9473bf/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:33.337141 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d07df-7676-4714-b83f-255f11e1ec5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=195aa4e610f644f681a1669aab5dc3ec, user_id=76990411cdf147f1ad8454598d9473bf, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:33.340078 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d07df-7676-4714-b83f-255f11e1ec5b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:33.356374 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1392/2786] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:33 2022] PUT /identity/v3/projects/195aa4e610f644f681a1669aab5dc3ec/users/76990411cdf147f1ad8454598d9473bf/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:33.360278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943f466-0034-4a7f-8038-cf1a3b22f026 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:33.370932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943f466-0034-4a7f-8038-cf1a3b22f026 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:33.384501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:33.432180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206d8de-f90a-4d6f-853b-9cf0138b8134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:33.433805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d8de-f90a-4d6f-853b-9cf0138b8134 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:33.433805 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d8de-f90a-4d6f-853b-9cf0138b8134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:33.434080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d8de-f90a-4d6f-853b-9cf0138b8134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:33.434711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d8de-f90a-4d6f-853b-9cf0138b8134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:33.436316 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d8de-f90a-4d6f-853b-9cf0138b8134 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:33.446018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1395/2787] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:33.450923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d07df-7676-4714-b83f-255f11e1ec5b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:33.460948 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d07df-7676-4714-b83f-255f11e1ec5b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:33.465588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8780563-7e5a-4c0a-8900-703829442cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:33.466221 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8780563-7e5a-4c0a-8900-703829442cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:33.466492 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8780563-7e5a-4c0a-8900-703829442cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:33.466781 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8780563-7e5a-4c0a-8900-703829442cb7 admin admin] PATH_INFO: `/v3/projects/195aa4e610f644f681a1669aab5dc3ec/users/76990411cdf147f1ad8454598d9473bf/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:33.468635 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8780563-7e5a-4c0a-8900-703829442cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=195aa4e610f644f681a1669aab5dc3ec, user_id=76990411cdf147f1ad8454598d9473bf, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:33.471265 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8780563-7e5a-4c0a-8900-703829442cb7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:33.481193 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1393/2788] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:33 2022] PUT /identity/v3/projects/195aa4e610f644f681a1669aab5dc3ec/users/76990411cdf147f1ad8454598d9473bf/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:37.992055 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37e19-7a99-4f95-beb3-1781d53564ef None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:37.992644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37e19-7a99-4f95-beb3-1781d53564ef None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:37.992644 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37e19-7a99-4f95-beb3-1781d53564ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.024361 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b7f37e19-7a99-4f95-beb3-1781d53564ef None None] MFA Rules not processed for user `76990411cdf147f1ad8454598d9473bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:38.025602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b7f37e19-7a99-4f95-beb3-1781d53564ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:38.103018 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1396/2789] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:25:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:38.116039 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8780563-7e5a-4c0a-8900-703829442cb7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:38.117821 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d8780563-7e5a-4c0a-8900-703829442cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:38.212345 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8780563-7e5a-4c0a-8900-703829442cb7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:38.216651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784872c-bbb3-4add-a7c1-6039b2307199 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dfdb9054ac4fef97d8e30aa5a8bd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:38.217263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784872c-bbb3-4add-a7c1-6039b2307199 service glance] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.217541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784872c-bbb3-4add-a7c1-6039b2307199 service glance] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.218079 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784872c-bbb3-4add-a7c1-6039b2307199 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.278649 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784872c-bbb3-4add-a7c1-6039b2307199 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:38.280154 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784872c-bbb3-4add-a7c1-6039b2307199 service glance] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:38.290976 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1394/2790] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:25:38.455436 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207555c-2124-427d-a30b-35bc185ff599 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.455747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207555c-2124-427d-a30b-35bc185ff599 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.456040 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207555c-2124-427d-a30b-35bc185ff599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.520698 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4207555c-2124-427d-a30b-35bc185ff599 None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:38.521911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4207555c-2124-427d-a30b-35bc185ff599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:38.588755 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1397/2791] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 01:25:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:38.631443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784872c-bbb3-4add-a7c1-6039b2307199 service glance] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:38.632857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e784872c-bbb3-4add-a7c1-6039b2307199 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:38.696903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:38.727715 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784872c-bbb3-4add-a7c1-6039b2307199 service glance] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:38.732602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e60d83-3acc-49a1-ad6b-267716ecf24b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:38.733611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60d83-3acc-49a1-ad6b-267716ecf24b service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.733890 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60d83-3acc-49a1-ad6b-267716ecf24b service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.734157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60d83-3acc-49a1-ad6b-267716ecf24b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.742212 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e60d83-3acc-49a1-ad6b-267716ecf24b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:38.743807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e60d83-3acc-49a1-ad6b-267716ecf24b service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:38.752161 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1395/2792] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:25:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:25:47.671528 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e0183-ec16-4d18-80d4-2ec34b4584ba None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:47.672035 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e0183-ec16-4d18-80d4-2ec34b4584ba None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:47.672153 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e0183-ec16-4d18-80d4-2ec34b4584ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:47.679108 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:47.692243 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f66e0183-ec16-4d18-80d4-2ec34b4584ba None None] MFA Rules not processed for user `6d40431cce8e4115a13faa77e8a14d31`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:47.693421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f66e0183-ec16-4d18-80d4-2ec34b4584ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:47.700719 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1398/2793] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:25:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:47.954059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e60d83-3acc-49a1-ad6b-267716ecf24b service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:48.008366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e60d83-3acc-49a1-ad6b-267716ecf24b service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:48.011991 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07595a-75c1-473b-8f65-529e9d5a7245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:48.012585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07595a-75c1-473b-8f65-529e9d5a7245 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:48.012862 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07595a-75c1-473b-8f65-529e9d5a7245 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:48.013132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07595a-75c1-473b-8f65-529e9d5a7245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:48.014899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8a07595a-75c1-473b-8f65-529e9d5a7245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:48.024114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07595a-75c1-473b-8f65-529e9d5a7245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:48.025526 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07595a-75c1-473b-8f65-529e9d5a7245 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:48.033753 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1396/2794] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:49.581508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730165ed-9f82-4fe7-be34-f586a123466a None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.582019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730165ed-9f82-4fe7-be34-f586a123466a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.582231 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730165ed-9f82-4fe7-be34-f586a123466a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.601116 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-730165ed-9f82-4fe7-be34-f586a123466a None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:49.602403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-730165ed-9f82-4fe7-be34-f586a123466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:49.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1399/2795] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:49.623059 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07595a-75c1-473b-8f65-529e9d5a7245 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:49.634962 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07595a-75c1-473b-8f65-529e9d5a7245 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:49.639849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2cba6-c2c7-40d1-b001-d2bb681e9e57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:49.640427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2cba6-c2c7-40d1-b001-d2bb681e9e57 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.640700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2cba6-c2c7-40d1-b001-d2bb681e9e57 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.640964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2cba6-c2c7-40d1-b001-d2bb681e9e57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.649411 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2cba6-c2c7-40d1-b001-d2bb681e9e57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.651032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2cba6-c2c7-40d1-b001-d2bb681e9e57 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.659388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1397/2796] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:25:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:25:59.595823 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:59.656065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=47 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:02.446866 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730165ed-9f82-4fe7-be34-f586a123466a None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:02.455963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730165ed-9f82-4fe7-be34-f586a123466a None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:02.459422 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dccf5-a625-468c-a56d-04d8d14d3d6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:02.460002 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dccf5-a625-468c-a56d-04d8d14d3d6b service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:02.460272 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dccf5-a625-468c-a56d-04d8d14d3d6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:02.460536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dccf5-a625-468c-a56d-04d8d14d3d6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:02.462237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-421dccf5-a625-468c-a56d-04d8d14d3d6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:02.530611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dccf5-a625-468c-a56d-04d8d14d3d6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:02.532044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dccf5-a625-468c-a56d-04d8d14d3d6b service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:02.543267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1400/2797] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:04.886581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2cba6-c2c7-40d1-b001-d2bb681e9e57 service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.888100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fbd2cba6-c2c7-40d1-b001-d2bb681e9e57 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:04.900627 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2cba6-c2c7-40d1-b001-d2bb681e9e57 service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.904190 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7ee9e-8786-4f56-99d0-c44750cb4989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.904781 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7ee9e-8786-4f56-99d0-c44750cb4989 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.905062 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7ee9e-8786-4f56-99d0-c44750cb4989 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.905332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7ee9e-8786-4f56-99d0-c44750cb4989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.907034 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-94f7ee9e-8786-4f56-99d0-c44750cb4989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:04.920065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7ee9e-8786-4f56-99d0-c44750cb4989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.921492 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7ee9e-8786-4f56-99d0-c44750cb4989 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.932775 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1398/2798] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:12.537848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=34 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:14.927478 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:20.561218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dccf5-a625-468c-a56d-04d8d14d3d6b service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:20.569858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dccf5-a625-468c-a56d-04d8d14d3d6b service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:20.573399 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f0b51-0205-4b00-adf1-cca8ef15d87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:20.573990 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f0b51-0205-4b00-adf1-cca8ef15d87d service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:20.574267 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f0b51-0205-4b00-adf1-cca8ef15d87d service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:20.574538 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f0b51-0205-4b00-adf1-cca8ef15d87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:20.583158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f0b51-0205-4b00-adf1-cca8ef15d87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:20.584561 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f0b51-0205-4b00-adf1-cca8ef15d87d service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:20.596102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1401/2799] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:30.590027 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:52.447174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7ee9e-8786-4f56-99d0-c44750cb4989 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:52.448560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-94f7ee9e-8786-4f56-99d0-c44750cb4989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:52.516006 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7ee9e-8786-4f56-99d0-c44750cb4989 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:52.520969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c2a2c-d82f-4c41-aec8-cca8e3f9218f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:52.521556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2a2c-d82f-4c41-aec8-cca8e3f9218f service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:52.521832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2a2c-d82f-4c41-aec8-cca8e3f9218f service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:52.522108 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2a2c-d82f-4c41-aec8-cca8e3f9218f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:52.523823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ce0c2a2c-d82f-4c41-aec8-cca8e3f9218f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:52.535352 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c2a2c-d82f-4c41-aec8-cca8e3f9218f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:52.536899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c2a2c-d82f-4c41-aec8-cca8e3f9218f service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:52.546504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1399/2800] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:02.542293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=32 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:18.233763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f0b51-0205-4b00-adf1-cca8ef15d87d service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:18.236013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4a3f0b51-0205-4b00-adf1-cca8ef15d87d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:18.257213 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f0b51-0205-4b00-adf1-cca8ef15d87d service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:18.269014 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b26ed-a1b2-4b21-b021-7810311b518f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:18.269882 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b26ed-a1b2-4b21-b021-7810311b518f service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:18.270260 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b26ed-a1b2-4b21-b021-7810311b518f service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:18.270595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b26ed-a1b2-4b21-b021-7810311b518f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:18.272874 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-147b26ed-a1b2-4b21-b021-7810311b518f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:18.286409 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b26ed-a1b2-4b21-b021-7810311b518f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:18.288123 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b26ed-a1b2-4b21-b021-7810311b518f service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:18.300101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1402/2801] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:28.295277 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:30.544752 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c2a2c-d82f-4c41-aec8-cca8e3f9218f service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:30.546183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ce0c2a2c-d82f-4c41-aec8-cca8e3f9218f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:30.561755 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c2a2c-d82f-4c41-aec8-cca8e3f9218f service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:30.567774 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38d72e-dba3-4a4a-b557-c36a1025423e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:30.568379 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38d72e-dba3-4a4a-b557-c36a1025423e service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:30.568660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38d72e-dba3-4a4a-b557-c36a1025423e service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:30.568927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38d72e-dba3-4a4a-b557-c36a1025423e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:30.570639 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cc38d72e-dba3-4a4a-b557-c36a1025423e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:30.584046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38d72e-dba3-4a4a-b557-c36a1025423e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:30.585630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38d72e-dba3-4a4a-b557-c36a1025423e service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:30.597065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1400/2802] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:32.080132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e860fa-06af-4cb3-bf7d-ae17d51155bd None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:32.080569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e860fa-06af-4cb3-bf7d-ae17d51155bd None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:32.080689 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e860fa-06af-4cb3-bf7d-ae17d51155bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:32.100205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-41e860fa-06af-4cb3-bf7d-ae17d51155bd None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:32.101372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-41e860fa-06af-4cb3-bf7d-ae17d51155bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:32.108679 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1403/2803] 10.222.0.33 () {58 vars in 967 bytes} [Sun Sep 11 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:32.149532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38d72e-dba3-4a4a-b557-c36a1025423e service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:32.160717 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38d72e-dba3-4a4a-b557-c36a1025423e service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:32.165738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef8b40-3ade-4e47-823b-fa2bbc00c153 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:32.166322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef8b40-3ade-4e47-823b-fa2bbc00c153 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:32.166598 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef8b40-3ade-4e47-823b-fa2bbc00c153 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:32.166910 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef8b40-3ade-4e47-823b-fa2bbc00c153 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:32.174790 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef8b40-3ade-4e47-823b-fa2bbc00c153 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:32.176369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef8b40-3ade-4e47-823b-fa2bbc00c153 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:32.184489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1401/2804] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:29:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:29:32.664869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa010-76c9-4cbb-93f1-473babbf3d94 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:32.665156 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa010-76c9-4cbb-93f1-473babbf3d94 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:32.665430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa010-76c9-4cbb-93f1-473babbf3d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:32.685669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-508fa010-76c9-4cbb-93f1-473babbf3d94 None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:32.686924 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-508fa010-76c9-4cbb-93f1-473babbf3d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:32.693962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1404/2805] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:32.706528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef8b40-3ade-4e47-823b-fa2bbc00c153 service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:32.716934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef8b40-3ade-4e47-823b-fa2bbc00c153 service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:32.721831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819f499-dbd0-474f-8505-4ccbfd13c5bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:32.722409 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819f499-dbd0-474f-8505-4ccbfd13c5bc service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:32.722681 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819f499-dbd0-474f-8505-4ccbfd13c5bc service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:32.722971 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819f499-dbd0-474f-8505-4ccbfd13c5bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:32.730634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819f499-dbd0-474f-8505-4ccbfd13c5bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:32.732211 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819f499-dbd0-474f-8505-4ccbfd13c5bc service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:32.740055 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1402/2806] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:29:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:29:41.114385 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e897b-8f0b-411e-ad09-79e7aba9be0c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:41.114891 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e897b-8f0b-411e-ad09-79e7aba9be0c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:41.115001 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e897b-8f0b-411e-ad09-79e7aba9be0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:41.133914 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-be2e897b-8f0b-411e-ad09-79e7aba9be0c None None] MFA Rules not processed for user `6d40431cce8e4115a13faa77e8a14d31`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:41.135131 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-be2e897b-8f0b-411e-ad09-79e7aba9be0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:41.142058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1405/2807] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:29:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:42.713009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819f499-dbd0-474f-8505-4ccbfd13c5bc service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:42.714366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b819f499-dbd0-474f-8505-4ccbfd13c5bc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:42.728489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819f499-dbd0-474f-8505-4ccbfd13c5bc service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:42.733297 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7bc0a-4e07-4ab8-8a65-9058eca59a72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:42.733872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7bc0a-4e07-4ab8-8a65-9058eca59a72 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:42.734142 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7bc0a-4e07-4ab8-8a65-9058eca59a72 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:42.734404 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7bc0a-4e07-4ab8-8a65-9058eca59a72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:42.736050 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a7c7bc0a-4e07-4ab8-8a65-9058eca59a72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:42.746717 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7bc0a-4e07-4ab8-8a65-9058eca59a72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:42.748284 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7bc0a-4e07-4ab8-8a65-9058eca59a72 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:42.758225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1403/2808] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:46.962581 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276f9c6-06d4-4c72-be18-58ace358d69d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:46.963125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276f9c6-06d4-4c72-be18-58ace358d69d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:46.963440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276f9c6-06d4-4c72-be18-58ace358d69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:46.982430 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8276f9c6-06d4-4c72-be18-58ace358d69d None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:46.983749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8276f9c6-06d4-4c72-be18-58ace358d69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:46.990809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1406/2809] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 01:29:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:47.004706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7bc0a-4e07-4ab8-8a65-9058eca59a72 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:47.016686 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7bc0a-4e07-4ab8-8a65-9058eca59a72 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:47.021648 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3ab2d-f4bc-4c92-a022-44037db944eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:47.022233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3ab2d-f4bc-4c92-a022-44037db944eb service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:47.022508 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3ab2d-f4bc-4c92-a022-44037db944eb service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:47.022799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3ab2d-f4bc-4c92-a022-44037db944eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:47.031184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3ab2d-f4bc-4c92-a022-44037db944eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:47.032343 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3ab2d-f4bc-4c92-a022-44037db944eb service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:47.040383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1404/2810] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:29:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:29:54.771010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276f9c6-06d4-4c72-be18-58ace358d69d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:54.780538 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276f9c6-06d4-4c72-be18-58ace358d69d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:54.785843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e0ab3-1bcc-4c35-b043-66116d5582d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:54.786443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e0ab3-1bcc-4c35-b043-66116d5582d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:54.786782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e0ab3-1bcc-4c35-b043-66116d5582d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:54.787043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e0ab3-1bcc-4c35-b043-66116d5582d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:54.789291 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-391e0ab3-1bcc-4c35-b043-66116d5582d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:54.798903 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e0ab3-1bcc-4c35-b043-66116d5582d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:54.800345 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e0ab3-1bcc-4c35-b043-66116d5582d3 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:54.809133 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1407/2811] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:57.037075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=30 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:59.857809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3ab2d-f4bc-4c92-a022-44037db944eb service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:59.871253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3ab2d-f4bc-4c92-a022-44037db944eb service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:59.876599 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4786ea3-8f20-40f8-b04f-bb3caa8d0882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:59.877187 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4786ea3-8f20-40f8-b04f-bb3caa8d0882 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:59.877456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4786ea3-8f20-40f8-b04f-bb3caa8d0882 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:59.877718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4786ea3-8f20-40f8-b04f-bb3caa8d0882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:59.879462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f4786ea3-8f20-40f8-b04f-bb3caa8d0882 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:59.892027 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4786ea3-8f20-40f8-b04f-bb3caa8d0882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:59.893590 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4786ea3-8f20-40f8-b04f-bb3caa8d0882 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:59.905138 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1405/2812] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:04.805313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=18 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:09.900359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:39.259845 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e0ab3-1bcc-4c35-b043-66116d5582d3 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:39.272879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e0ab3-1bcc-4c35-b043-66116d5582d3 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:39.278223 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c668b3-d36f-4b80-9838-91f6dc9d7aad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:39.278870 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c668b3-d36f-4b80-9838-91f6dc9d7aad service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:39.279147 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c668b3-d36f-4b80-9838-91f6dc9d7aad service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:39.279414 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c668b3-d36f-4b80-9838-91f6dc9d7aad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:39.286885 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c668b3-d36f-4b80-9838-91f6dc9d7aad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:39.288800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c668b3-d36f-4b80-9838-91f6dc9d7aad service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:39.297358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1408/2813] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:49.293613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:18.902846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4786ea3-8f20-40f8-b04f-bb3caa8d0882 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:18.912075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4786ea3-8f20-40f8-b04f-bb3caa8d0882 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:18.916399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23fda1-4cf8-4b90-aa36-8511b00fbbf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:18.916985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23fda1-4cf8-4b90-aa36-8511b00fbbf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:18.917263 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23fda1-4cf8-4b90-aa36-8511b00fbbf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:18.917532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23fda1-4cf8-4b90-aa36-8511b00fbbf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:18.927575 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23fda1-4cf8-4b90-aa36-8511b00fbbf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:18.929259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23fda1-4cf8-4b90-aa36-8511b00fbbf0 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:18.939919 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1406/2814] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:28.935190 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:30.986657 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c668b3-d36f-4b80-9838-91f6dc9d7aad service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:30.996962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c668b3-d36f-4b80-9838-91f6dc9d7aad service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:31.000522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b115eb2-41bd-4468-a0be-d58d46950a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:31.001119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b115eb2-41bd-4468-a0be-d58d46950a59 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:31.001403 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b115eb2-41bd-4468-a0be-d58d46950a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:31.001672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b115eb2-41bd-4468-a0be-d58d46950a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:31.012024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b115eb2-41bd-4468-a0be-d58d46950a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:31.013465 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b115eb2-41bd-4468-a0be-d58d46950a59 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:31.024620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1409/2815] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:33.368414 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21899e94-32fd-4ec0-917c-71f2b7b93952 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:33.368899 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21899e94-32fd-4ec0-917c-71f2b7b93952 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:33.368993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21899e94-32fd-4ec0-917c-71f2b7b93952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:33.388123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-21899e94-32fd-4ec0-917c-71f2b7b93952 None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:33.389289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-21899e94-32fd-4ec0-917c-71f2b7b93952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:33.396477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1407/2816] 10.222.0.33 () {58 vars in 967 bytes} [Sun Sep 11 01:31:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:33.438610 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b115eb2-41bd-4468-a0be-d58d46950a59 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:33.450326 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b115eb2-41bd-4468-a0be-d58d46950a59 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:33.455495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ceaae-4bb0-43c3-99c1-7f7feb13f450 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:33.456090 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ceaae-4bb0-43c3-99c1-7f7feb13f450 service swift] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:33.456363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ceaae-4bb0-43c3-99c1-7f7feb13f450 service swift] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:33.456627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ceaae-4bb0-43c3-99c1-7f7feb13f450 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:33.464972 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ceaae-4bb0-43c3-99c1-7f7feb13f450 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:33.466511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ceaae-4bb0-43c3-99c1-7f7feb13f450 service swift] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:33.474176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1410/2817] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:31:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:31:33.834361 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21899e94-32fd-4ec0-917c-71f2b7b93952 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:33.843804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21899e94-32fd-4ec0-917c-71f2b7b93952 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:33.847403 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ac3a4-b6bc-47b5-8d2f-65c3c334d4e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:33.847994 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ac3a4-b6bc-47b5-8d2f-65c3c334d4e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:33.848269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ac3a4-b6bc-47b5-8d2f-65c3c334d4e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:33.848556 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ac3a4-b6bc-47b5-8d2f-65c3c334d4e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:33.908035 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ac3a4-b6bc-47b5-8d2f-65c3c334d4e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:33.909466 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ac3a4-b6bc-47b5-8d2f-65c3c334d4e5 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:33.919448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1408/2818] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:36.750073 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ceaae-4bb0-43c3-99c1-7f7feb13f450 service swift] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:36.763714 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ceaae-4bb0-43c3-99c1-7f7feb13f450 service swift] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:36.769046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87100d19-6b90-4449-ba4c-f63e5f2d399a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:36.769930 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87100d19-6b90-4449-ba4c-f63e5f2d399a service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:36.770583 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87100d19-6b90-4449-ba4c-f63e5f2d399a service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:36.770686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87100d19-6b90-4449-ba4c-f63e5f2d399a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:36.776417 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-87100d19-6b90-4449-ba4c-f63e5f2d399a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:36.792285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87100d19-6b90-4449-ba4c-f63e5f2d399a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:36.796096 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87100d19-6b90-4449-ba4c-f63e5f2d399a service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:36.808264 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1411/2819] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:39.896223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ac3a4-b6bc-47b5-8d2f-65c3c334d4e5 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:39.907535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ac3a4-b6bc-47b5-8d2f-65c3c334d4e5 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:39.912441 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba3714-3cc4-4ee4-82d3-f9b41b31f2a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:39.913032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba3714-3cc4-4ee4-82d3-f9b41b31f2a2 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:39.913307 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba3714-3cc4-4ee4-82d3-f9b41b31f2a2 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:39.913577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba3714-3cc4-4ee4-82d3-f9b41b31f2a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:39.915845 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7fba3714-3cc4-4ee4-82d3-f9b41b31f2a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:39.934430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba3714-3cc4-4ee4-82d3-f9b41b31f2a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:39.936428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba3714-3cc4-4ee4-82d3-f9b41b31f2a2 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:39.949748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1409/2820] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:39.967627 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87100d19-6b90-4449-ba4c-f63e5f2d399a service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:39.980106 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87100d19-6b90-4449-ba4c-f63e5f2d399a service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:39.985373 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:39.986124 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:39.986406 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:39.986678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] PATH_INFO: `/v3/users/6d40431cce8e4115a13faa77e8a14d31` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:39.987843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d40431cce8e4115a13faa77e8a14d31)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:39.989780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:40.037739 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d40431cce8e4115a13faa77e8a14d31'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.038318 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d40431cce8e4115a13faa77e8a14d31'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.045815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d40431cce8e4115a13faa77e8a14d31'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.053193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d40431cce8e4115a13faa77e8a14d31'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.066186 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d40431cce8e4115a13faa77e8a14d31'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.072139 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1412/2821] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:39 2022] DELETE /identity/v3/users/6d40431cce8e4115a13faa77e8a14d31 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:40.249712 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba3714-3cc4-4ee4-82d3-f9b41b31f2a2 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:40.260298 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba3714-3cc4-4ee4-82d3-f9b41b31f2a2 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:40.316576 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:40.317120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:40.317390 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:40.317650 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] PATH_INFO: `/v3/projects/ce33468ddbf542478a79463d351cc1c5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:40.318754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce33468ddbf542478a79463d351cc1c5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:40.320620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:40.366368 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce33468ddbf542478a79463d351cc1c5', 'request_id': 'req-3a6d8d94-e1ef-4109-9dd2-f77d20421445'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.373367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce33468ddbf542478a79463d351cc1c5', 'request_id': 'req-3a6d8d94-e1ef-4109-9dd2-f77d20421445'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.379481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce33468ddbf542478a79463d351cc1c5', 'request_id': 'req-3a6d8d94-e1ef-4109-9dd2-f77d20421445'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.389535 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] The token cache is being invalidate because project ce33468ddbf542478a79463d351cc1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:40.389821 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.390437 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.391900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1410/2822] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:40 2022] DELETE /identity/v3/projects/ce33468ddbf542478a79463d351cc1c5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:40.395865 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:40.397315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:40.411094 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570370bb-8c2b-4c71-9cee-e20b9f1106f3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:40.467604 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80949fe-a304-4912-96b2-f0fe98d9e3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:40.468229 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80949fe-a304-4912-96b2-f0fe98d9e3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:40.468519 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80949fe-a304-4912-96b2-f0fe98d9e3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:40.468768 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80949fe-a304-4912-96b2-f0fe98d9e3d0 admin admin] PATH_INFO: `/v3/users/76990411cdf147f1ad8454598d9473bf` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:40.469880 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80949fe-a304-4912-96b2-f0fe98d9e3d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76990411cdf147f1ad8454598d9473bf)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:40.471812 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80949fe-a304-4912-96b2-f0fe98d9e3d0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:40.507713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:40.518391 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c80949fe-a304-4912-96b2-f0fe98d9e3d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76990411cdf147f1ad8454598d9473bf'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.519054 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c80949fe-a304-4912-96b2-f0fe98d9e3d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76990411cdf147f1ad8454598d9473bf'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.526374 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c80949fe-a304-4912-96b2-f0fe98d9e3d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76990411cdf147f1ad8454598d9473bf'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.533460 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c80949fe-a304-4912-96b2-f0fe98d9e3d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76990411cdf147f1ad8454598d9473bf'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.545733 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c80949fe-a304-4912-96b2-f0fe98d9e3d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76990411cdf147f1ad8454598d9473bf'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.551599 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1413/2823] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:40 2022] DELETE /identity/v3/users/76990411cdf147f1ad8454598d9473bf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:40.727499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:40.728913 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:40.738958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:40.743149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d8d94-e1ef-4109-9dd2-f77d20421445 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:40.801366 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:40.801987 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:40.802259 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:40.802529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c admin admin] PATH_INFO: `/v3/projects/195aa4e610f644f681a1669aab5dc3ec` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:40.804071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=195aa4e610f644f681a1669aab5dc3ec)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:40.805966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:40.851902 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195aa4e610f644f681a1669aab5dc3ec', 'request_id': 'req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.858928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195aa4e610f644f681a1669aab5dc3ec', 'request_id': 'req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.865031 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195aa4e610f644f681a1669aab5dc3ec', 'request_id': 'req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.875441 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c admin admin] The token cache is being invalidate because project 195aa4e610f644f681a1669aab5dc3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:40.875724 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.876393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-45d39a43-ddec-4c25-a64d-bb63e3c0fc0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.877828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1411/2824] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:40 2022] DELETE /identity/v3/projects/195aa4e610f644f681a1669aab5dc3ec => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:40.882893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03ee4b-5178-429f-8deb-bd2cbc3a1033 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:40.883174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03ee4b-5178-429f-8deb-bd2cbc3a1033 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:40.883440 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03ee4b-5178-429f-8deb-bd2cbc3a1033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:40.903677 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ab03ee4b-5178-429f-8deb-bd2cbc3a1033 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:40.904856 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ab03ee4b-5178-429f-8deb-bd2cbc3a1033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:40.961537 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1414/2825] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:40.968996 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbca048-1e55-48e7-82a1-c7121b905933 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:40.969543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbca048-1e55-48e7-82a1-c7121b905933 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:40.969543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbca048-1e55-48e7-82a1-c7121b905933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:40.988604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3fbca048-1e55-48e7-82a1-c7121b905933 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:40.989789 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3fbca048-1e55-48e7-82a1-c7121b905933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:40.998153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1412/2826] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:41.002310 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03ee4b-5178-429f-8deb-bd2cbc3a1033 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.012752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03ee4b-5178-429f-8deb-bd2cbc3a1033 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.017721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce815664-2cad-4605-bd6d-fb3007c43ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.018522 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815664-2cad-4605-bd6d-fb3007c43ecb admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.018848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815664-2cad-4605-bd6d-fb3007c43ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.019102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815664-2cad-4605-bd6d-fb3007c43ecb admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.019739 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce815664-2cad-4605-bd6d-fb3007c43ecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:41.020036 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce815664-2cad-4605-bd6d-fb3007c43ecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.021595 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce815664-2cad-4605-bd6d-fb3007c43ecb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.034250 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1415/2827] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:41.038278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbca048-1e55-48e7-82a1-c7121b905933 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.047308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbca048-1e55-48e7-82a1-c7121b905933 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.051849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b3a24-c0a3-404b-a16e-9f5fb691d019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.052429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b3a24-c0a3-404b-a16e-9f5fb691d019 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.052701 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b3a24-c0a3-404b-a16e-9f5fb691d019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.052966 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b3a24-c0a3-404b-a16e-9f5fb691d019 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.053847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b3a24-c0a3-404b-a16e-9f5fb691d019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.056293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b3a24-c0a3-404b-a16e-9f5fb691d019 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.085095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1413/2828] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:41 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:41.089129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce815664-2cad-4605-bd6d-fb3007c43ecb admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.099273 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce815664-2cad-4605-bd6d-fb3007c43ecb admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.155331 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a43618-de24-4f86-970d-b2ffda864154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.155852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a43618-de24-4f86-970d-b2ffda864154 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.156132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a43618-de24-4f86-970d-b2ffda864154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.156405 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a43618-de24-4f86-970d-b2ffda864154 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.157039 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a43618-de24-4f86-970d-b2ffda864154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.158977 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a43618-de24-4f86-970d-b2ffda864154 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.181449 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1416/2829] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:41 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:41.185326 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b3a24-c0a3-404b-a16e-9f5fb691d019 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.195468 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b3a24-c0a3-404b-a16e-9f5fb691d019 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.200798 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08451a2d-3b2a-4ff2-9458-5cc59f80a04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.201387 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08451a2d-3b2a-4ff2-9458-5cc59f80a04b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.201662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08451a2d-3b2a-4ff2-9458-5cc59f80a04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.201974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08451a2d-3b2a-4ff2-9458-5cc59f80a04b admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.202619 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08451a2d-3b2a-4ff2-9458-5cc59f80a04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.204288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08451a2d-3b2a-4ff2-9458-5cc59f80a04b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.214018 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1414/2830] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:41.217740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a43618-de24-4f86-970d-b2ffda864154 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.227497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a43618-de24-4f86-970d-b2ffda864154 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.231959 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc4294-d427-404b-ab87-e9e893afa8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.232537 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc4294-d427-404b-ab87-e9e893afa8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.232836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc4294-d427-404b-ab87-e9e893afa8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.233104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc4294-d427-404b-ab87-e9e893afa8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.233724 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc4294-d427-404b-ab87-e9e893afa8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.235331 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc4294-d427-404b-ab87-e9e893afa8b2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.245987 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1417/2831] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:41.249749 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08451a2d-3b2a-4ff2-9458-5cc59f80a04b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.260092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08451a2d-3b2a-4ff2-9458-5cc59f80a04b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.264649 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e2b38-310b-4664-9ebb-4cf86da3448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.265306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e2b38-310b-4664-9ebb-4cf86da3448d admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.265584 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e2b38-310b-4664-9ebb-4cf86da3448d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.265857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e2b38-310b-4664-9ebb-4cf86da3448d admin admin] PATH_INFO: `/v3/projects/9a4e1d87b3c848448c4976065ec5006c/users/cc5c09c932714b3fb488067fe789e505/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.279998 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e2b38-310b-4664-9ebb-4cf86da3448d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4e1d87b3c848448c4976065ec5006c, user_id=cc5c09c932714b3fb488067fe789e505, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.282629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e2b38-310b-4664-9ebb-4cf86da3448d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.295385 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1415/2832] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:41 2022] PUT /identity/v3/projects/9a4e1d87b3c848448c4976065ec5006c/users/cc5c09c932714b3fb488067fe789e505/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:41.307214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf1be8-e3ca-48b8-8d0f-91b047030202 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.307496 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf1be8-e3ca-48b8-8d0f-91b047030202 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.307764 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf1be8-e3ca-48b8-8d0f-91b047030202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.334920 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4bbf1be8-e3ca-48b8-8d0f-91b047030202 None None] MFA Rules not processed for user `cc5c09c932714b3fb488067fe789e505`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:41.336117 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4bbf1be8-e3ca-48b8-8d0f-91b047030202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:41.341065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:41.399798 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1418/2833] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:31:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:41.404219 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e2b38-310b-4664-9ebb-4cf86da3448d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.437690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:41.467076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e2b38-310b-4664-9ebb-4cf86da3448d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.471754 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c1751-0189-4012-8631-58a5da9dd436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.472353 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c1751-0189-4012-8631-58a5da9dd436 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.472645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c1751-0189-4012-8631-58a5da9dd436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.472897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c1751-0189-4012-8631-58a5da9dd436 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.473528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c1751-0189-4012-8631-58a5da9dd436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.475464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c1751-0189-4012-8631-58a5da9dd436 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.501380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1416/2834] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:41 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:31:41.505369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf1be8-e3ca-48b8-8d0f-91b047030202 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.515794 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf1be8-e3ca-48b8-8d0f-91b047030202 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.571329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96492336-db97-4e9b-9836-f42437713151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.571928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96492336-db97-4e9b-9836-f42437713151 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.572208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96492336-db97-4e9b-9836-f42437713151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.572482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96492336-db97-4e9b-9836-f42437713151 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.573100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96492336-db97-4e9b-9836-f42437713151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.575023 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96492336-db97-4e9b-9836-f42437713151 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.595248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1419/2835] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:41 2022] POST /identity/v3/users => generated 303 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:41.599225 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c1751-0189-4012-8631-58a5da9dd436 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.610118 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c1751-0189-4012-8631-58a5da9dd436 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.614655 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347562a-f3bb-4ae7-bba0-b41a6df6fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.615285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347562a-f3bb-4ae7-bba0-b41a6df6fc9e admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.615558 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347562a-f3bb-4ae7-bba0-b41a6df6fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.615826 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347562a-f3bb-4ae7-bba0-b41a6df6fc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.616470 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347562a-f3bb-4ae7-bba0-b41a6df6fc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.618025 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347562a-f3bb-4ae7-bba0-b41a6df6fc9e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.628813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1417/2836] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:41.632734 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96492336-db97-4e9b-9836-f42437713151 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.642534 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96492336-db97-4e9b-9836-f42437713151 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.647141 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec796f-bd4a-4c1b-8bc3-d5652887fbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.647772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec796f-bd4a-4c1b-8bc3-d5652887fbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.648050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec796f-bd4a-4c1b-8bc3-d5652887fbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.648319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec796f-bd4a-4c1b-8bc3-d5652887fbb2 admin admin] PATH_INFO: `/v3/projects/e9d3775b324146ffbb1b26aa2b87f3ba/users/e014d1328c114b2dae6969def24cbc77/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.663458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec796f-bd4a-4c1b-8bc3-d5652887fbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d3775b324146ffbb1b26aa2b87f3ba, user_id=e014d1328c114b2dae6969def24cbc77, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.666721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec796f-bd4a-4c1b-8bc3-d5652887fbb2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.679584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1420/2837] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:41 2022] PUT /identity/v3/projects/e9d3775b324146ffbb1b26aa2b87f3ba/users/e014d1328c114b2dae6969def24cbc77/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:41.683243 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347562a-f3bb-4ae7-bba0-b41a6df6fc9e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.692931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347562a-f3bb-4ae7-bba0-b41a6df6fc9e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.748223 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2ac9d-e89a-4398-88ba-d43214740b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.748805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2ac9d-e89a-4398-88ba-d43214740b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.749075 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2ac9d-e89a-4398-88ba-d43214740b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.749338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2ac9d-e89a-4398-88ba-d43214740b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.749958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2ac9d-e89a-4398-88ba-d43214740b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.751543 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2ac9d-e89a-4398-88ba-d43214740b49 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.760825 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1418/2838] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:41.764816 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec796f-bd4a-4c1b-8bc3-d5652887fbb2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.775463 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec796f-bd4a-4c1b-8bc3-d5652887fbb2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.780039 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03e680-6824-4ed4-ab51-25828f56759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.780686 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03e680-6824-4ed4-ab51-25828f56759b admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.780960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03e680-6824-4ed4-ab51-25828f56759b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.781227 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03e680-6824-4ed4-ab51-25828f56759b admin admin] PATH_INFO: `/v3/projects/e9d3775b324146ffbb1b26aa2b87f3ba/users/e014d1328c114b2dae6969def24cbc77/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.783128 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03e680-6824-4ed4-ab51-25828f56759b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d3775b324146ffbb1b26aa2b87f3ba, user_id=e014d1328c114b2dae6969def24cbc77, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.785723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03e680-6824-4ed4-ab51-25828f56759b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.796474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1421/2839] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:41 2022] PUT /identity/v3/projects/e9d3775b324146ffbb1b26aa2b87f3ba/users/e014d1328c114b2dae6969def24cbc77/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:41.806183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119e075-3a21-4931-866a-e3ebb903d58a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.806526 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119e075-3a21-4931-866a-e3ebb903d58a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.806826 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119e075-3a21-4931-866a-e3ebb903d58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.834530 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0119e075-3a21-4931-866a-e3ebb903d58a None None] MFA Rules not processed for user `e014d1328c114b2dae6969def24cbc77`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:41.835757 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0119e075-3a21-4931-866a-e3ebb903d58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:41.904928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1419/2840] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:31:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:41.919363 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03e680-6824-4ed4-ab51-25828f56759b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.921085 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0b03e680-6824-4ed4-ab51-25828f56759b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:41.978453 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:41.995437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03e680-6824-4ed4-ab51-25828f56759b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:42.000944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a089a-d799-4c25-949a-179508cd2866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:42.001539 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a089a-d799-4c25-949a-179508cd2866 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:42.001815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a089a-d799-4c25-949a-179508cd2866 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:42.002082 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a089a-d799-4c25-949a-179508cd2866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:42.055796 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a089a-d799-4c25-949a-179508cd2866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:42.057361 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a089a-d799-4c25-949a-179508cd2866 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:42.065940 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1422/2841] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:44.739080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119e075-3a21-4931-866a-e3ebb903d58a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:44.740488 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0119e075-3a21-4931-866a-e3ebb903d58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:44.770220 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:44.799419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119e075-3a21-4931-866a-e3ebb903d58a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:44.803673 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a049894-1a3f-42ec-aeda-45883124289f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:44.804281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a049894-1a3f-42ec-aeda-45883124289f service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:44.804554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a049894-1a3f-42ec-aeda-45883124289f service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:44.804831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a049894-1a3f-42ec-aeda-45883124289f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:44.815049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a049894-1a3f-42ec-aeda-45883124289f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:44.816516 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a049894-1a3f-42ec-aeda-45883124289f service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:44.826559 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1420/2842] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:44 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:47.705919 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ae3f5-1005-4f4c-8d6c-cc91c31ae716 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:47.706437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ae3f5-1005-4f4c-8d6c-cc91c31ae716 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:47.706437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ae3f5-1005-4f4c-8d6c-cc91c31ae716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:47.725541 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-dc1ae3f5-1005-4f4c-8d6c-cc91c31ae716 None None] MFA Rules not processed for user `cc5c09c932714b3fb488067fe789e505`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:47.726766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-dc1ae3f5-1005-4f4c-8d6c-cc91c31ae716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:47.733659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1423/2843] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:48.089634 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a049894-1a3f-42ec-aeda-45883124289f service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:48.091691 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7a049894-1a3f-42ec-aeda-45883124289f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:48.104866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a049894-1a3f-42ec-aeda-45883124289f service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:48.108823 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309334cd-b627-43b7-9ed8-8fd5f945435a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:48.109436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309334cd-b627-43b7-9ed8-8fd5f945435a service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:48.109715 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309334cd-b627-43b7-9ed8-8fd5f945435a service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:48.109989 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309334cd-b627-43b7-9ed8-8fd5f945435a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:48.111923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-309334cd-b627-43b7-9ed8-8fd5f945435a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:48.126195 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309334cd-b627-43b7-9ed8-8fd5f945435a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:48.127832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309334cd-b627-43b7-9ed8-8fd5f945435a service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:48.143083 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1421/2844] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:57.719529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=32 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:58.135239 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=20 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:51.428532 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8631a2a-d545-4092-9167-0735f23efd24 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:51.429044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8631a2a-d545-4092-9167-0735f23efd24 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:51.429132 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8631a2a-d545-4092-9167-0735f23efd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:51.469847 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a8631a2a-d545-4092-9167-0735f23efd24 None None] MFA Rules not processed for user `cc5c09c932714b3fb488067fe789e505`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:51.471104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a8631a2a-d545-4092-9167-0735f23efd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:51.498285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1424/2845] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:52.743452 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309334cd-b627-43b7-9ed8-8fd5f945435a service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:52.744878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-309334cd-b627-43b7-9ed8-8fd5f945435a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:52.872439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309334cd-b627-43b7-9ed8-8fd5f945435a service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:52.877924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7f9d9-f0be-456b-8f5b-8200cfb58e86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:52.878529 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7f9d9-f0be-456b-8f5b-8200cfb58e86 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:52.878847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7f9d9-f0be-456b-8f5b-8200cfb58e86 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:52.879123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7f9d9-f0be-456b-8f5b-8200cfb58e86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:52.880846 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a0c7f9d9-f0be-456b-8f5b-8200cfb58e86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:52.893184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7f9d9-f0be-456b-8f5b-8200cfb58e86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:52.895169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7f9d9-f0be-456b-8f5b-8200cfb58e86 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:52.906557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1422/2846] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:32:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:01.496357 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=15 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:02.901982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=57 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:25.853646 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8631a2a-d545-4092-9167-0735f23efd24 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:25.855144 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a8631a2a-d545-4092-9167-0735f23efd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:25.907514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8631a2a-d545-4092-9167-0735f23efd24 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:25.913879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a820a9f-c87e-438e-a0fc-391c5285bf6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:25.914497 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a820a9f-c87e-438e-a0fc-391c5285bf6a service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:25.914788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a820a9f-c87e-438e-a0fc-391c5285bf6a service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:25.915058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a820a9f-c87e-438e-a0fc-391c5285bf6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:25.917137 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3a820a9f-c87e-438e-a0fc-391c5285bf6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:25.931968 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a820a9f-c87e-438e-a0fc-391c5285bf6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:25.933770 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a820a9f-c87e-438e-a0fc-391c5285bf6a service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:25.946028 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1425/2847] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:35.941564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=18 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:38.145294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44514b3d-ab42-40e4-bb56-fc2b0898394d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:38.145805 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44514b3d-ab42-40e4-bb56-fc2b0898394d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:38.145921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44514b3d-ab42-40e4-bb56-fc2b0898394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:38.166620 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-44514b3d-ab42-40e4-bb56-fc2b0898394d None None] MFA Rules not processed for user `cc5c09c932714b3fb488067fe789e505`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:38.167857 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-44514b3d-ab42-40e4-bb56-fc2b0898394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:38.175475 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1423/2848] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:34:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:41.452165 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a820a9f-c87e-438e-a0fc-391c5285bf6a service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:41.466048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a820a9f-c87e-438e-a0fc-391c5285bf6a service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:41.472695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960e310-2146-4677-8a06-b0888f0d2ae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:41.473318 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960e310-2146-4677-8a06-b0888f0d2ae0 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:41.473593 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960e310-2146-4677-8a06-b0888f0d2ae0 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:41.473859 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960e310-2146-4677-8a06-b0888f0d2ae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:41.475910 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2960e310-2146-4677-8a06-b0888f0d2ae0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:41.490653 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960e310-2146-4677-8a06-b0888f0d2ae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:41.492362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960e310-2146-4677-8a06-b0888f0d2ae0 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:41.504844 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1426/2849] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:48.161332 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:51.499106 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:08.191183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44514b3d-ab42-40e4-bb56-fc2b0898394d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:08.210043 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44514b3d-ab42-40e4-bb56-fc2b0898394d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:08.213594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efada2-b18b-403e-b6f6-5c84a242003c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:08.214182 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efada2-b18b-403e-b6f6-5c84a242003c service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:08.214456 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efada2-b18b-403e-b6f6-5c84a242003c service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:08.214739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efada2-b18b-403e-b6f6-5c84a242003c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:08.216557 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-05efada2-b18b-403e-b6f6-5c84a242003c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:08.238444 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efada2-b18b-403e-b6f6-5c84a242003c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:08.239905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efada2-b18b-403e-b6f6-5c84a242003c service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:08.248359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1424/2850] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:18.244172 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=15 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:21.280713 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960e310-2146-4677-8a06-b0888f0d2ae0 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:21.289951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960e310-2146-4677-8a06-b0888f0d2ae0 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:21.293514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e6679-bc25-4efd-a537-c257998a97b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:21.294416 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6679-bc25-4efd-a537-c257998a97b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:21.294694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6679-bc25-4efd-a537-c257998a97b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:21.295541 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6679-bc25-4efd-a537-c257998a97b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:21.297275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-324e6679-bc25-4efd-a537-c257998a97b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:21.308379 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e6679-bc25-4efd-a537-c257998a97b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:21.309792 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e6679-bc25-4efd-a537-c257998a97b7 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:21.318053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1427/2851] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:21.468246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16910-74c1-4189-9e51-4fd27ea2d510 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:21.468832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16910-74c1-4189-9e51-4fd27ea2d510 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:21.468832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16910-74c1-4189-9e51-4fd27ea2d510 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:21.470098 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1425/2852] 10.222.0.33 () {54 vars in 921 bytes} [Sun Sep 11 01:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:35:21.475860 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03d75c-4950-49e4-a964-7d02c68dc3aa None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:21.476240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03d75c-4950-49e4-a964-7d02c68dc3aa None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:21.476632 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03d75c-4950-49e4-a964-7d02c68dc3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:21.514932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0c03d75c-4950-49e4-a964-7d02c68dc3aa None None] MFA Rules not processed for user `c45d8e2b0b674e9a814167db4d78749e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:21.515651 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0c03d75c-4950-49e4-a964-7d02c68dc3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:21.523091 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1428/2853] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 01:35:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:35:21.540614 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c16910-74c1-4189-9e51-4fd27ea2d510 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:21.551710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c16910-74c1-4189-9e51-4fd27ea2d510 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:21.555333 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebef50-b206-41c7-8766-e7072e2c20bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:21.555921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebef50-b206-41c7-8766-e7072e2c20bf service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:21.556197 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebef50-b206-41c7-8766-e7072e2c20bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:21.556464 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebef50-b206-41c7-8766-e7072e2c20bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:21.563697 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebef50-b206-41c7-8766-e7072e2c20bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:21.565378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebef50-b206-41c7-8766-e7072e2c20bf service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:21.573583 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1426/2854] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:21.672955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03d75c-4950-49e4-a964-7d02c68dc3aa None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:21.674309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0c03d75c-4950-49e4-a964-7d02c68dc3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:21.689036 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03d75c-4950-49e4-a964-7d02c68dc3aa None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:21.694010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aa179-197f-4057-9db9-1c458d96d9cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:21.694622 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aa179-197f-4057-9db9-1c458d96d9cb service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:21.694933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aa179-197f-4057-9db9-1c458d96d9cb service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:21.695203 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aa179-197f-4057-9db9-1c458d96d9cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:21.696848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e81aa179-197f-4057-9db9-1c458d96d9cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:21.708491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81aa179-197f-4057-9db9-1c458d96d9cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:21.710060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81aa179-197f-4057-9db9-1c458d96d9cb service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:21.720515 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1429/2855] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:21.892560 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebef50-b206-41c7-8766-e7072e2c20bf service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:21.901351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebef50-b206-41c7-8766-e7072e2c20bf service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:21.905120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2d842-2ad6-4a3f-bb49-e190a1b79600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:21.905740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2d842-2ad6-4a3f-bb49-e190a1b79600 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:21.906019 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2d842-2ad6-4a3f-bb49-e190a1b79600 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:21.906289 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2d842-2ad6-4a3f-bb49-e190a1b79600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:21.908009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8ac2d842-2ad6-4a3f-bb49-e190a1b79600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:21.921133 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2d842-2ad6-4a3f-bb49-e190a1b79600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:21.922554 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2d842-2ad6-4a3f-bb49-e190a1b79600 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:21.933379 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1427/2856] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:21.993672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aa179-197f-4057-9db9-1c458d96d9cb service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:22.004628 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aa179-197f-4057-9db9-1c458d96d9cb service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:22.009667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386a02f-8dd7-4a11-a658-5c3c2ec40e58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:22.010256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386a02f-8dd7-4a11-a658-5c3c2ec40e58 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:22.010533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386a02f-8dd7-4a11-a658-5c3c2ec40e58 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:22.010830 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386a02f-8dd7-4a11-a658-5c3c2ec40e58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:22.012533 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b386a02f-8dd7-4a11-a658-5c3c2ec40e58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:22.024275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386a02f-8dd7-4a11-a658-5c3c2ec40e58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:22.025824 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386a02f-8dd7-4a11-a658-5c3c2ec40e58 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:22.035833 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1430/2857] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:31.928799 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=12 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:32.031289 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=27 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:39.435993 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2d842-2ad6-4a3f-bb49-e190a1b79600 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:39.447091 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2d842-2ad6-4a3f-bb49-e190a1b79600 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:39.453183 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000b163-e50c-4929-9337-5ea1437c0519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:39.453772 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000b163-e50c-4929-9337-5ea1437c0519 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:39.454045 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000b163-e50c-4929-9337-5ea1437c0519 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:39.454310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000b163-e50c-4929-9337-5ea1437c0519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:39.456072 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5000b163-e50c-4929-9337-5ea1437c0519 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:39.469282 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000b163-e50c-4929-9337-5ea1437c0519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:39.470528 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000b163-e50c-4929-9337-5ea1437c0519 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:39.481087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1428/2858] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:49.476597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:21.923566 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a495b-8ad6-4bdc-8bd2-0c7a29e7f84d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:21.924118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a495b-8ad6-4bdc-8bd2-0c7a29e7f84d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:21.924118 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a495b-8ad6-4bdc-8bd2-0c7a29e7f84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:21.944933 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-505a495b-8ad6-4bdc-8bd2-0c7a29e7f84d None None] MFA Rules not processed for user `cc5c09c932714b3fb488067fe789e505`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:21.946150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-505a495b-8ad6-4bdc-8bd2-0c7a29e7f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:21.954244 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1431/2859] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:36:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:21.992580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000b163-e50c-4929-9337-5ea1437c0519 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:21.993982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5000b163-e50c-4929-9337-5ea1437c0519 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:22.075322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000b163-e50c-4929-9337-5ea1437c0519 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:22.078999 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbd954-de6a-4548-bf27-157e8ba6e798 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dfdb9054ac4fef97d8e30aa5a8bd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:22.079609 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbd954-de6a-4548-bf27-157e8ba6e798 service glance] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:22.079883 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbd954-de6a-4548-bf27-157e8ba6e798 service glance] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:22.080166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbd954-de6a-4548-bf27-157e8ba6e798 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:22.082002 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f9dbd954-de6a-4548-bf27-157e8ba6e798 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:22.095645 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbd954-de6a-4548-bf27-157e8ba6e798 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:22.097096 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbd954-de6a-4548-bf27-157e8ba6e798 service glance] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:22.108257 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1429/2860] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:29.871908 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a495b-8ad6-4bdc-8bd2-0c7a29e7f84d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:29.881563 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a495b-8ad6-4bdc-8bd2-0c7a29e7f84d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:29.885086 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9cb3-e4f9-46aa-b1cc-5a293d9dfd59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:29.885678 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9cb3-e4f9-46aa-b1cc-5a293d9dfd59 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.885955 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9cb3-e4f9-46aa-b1cc-5a293d9dfd59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.886222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9cb3-e4f9-46aa-b1cc-5a293d9dfd59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.888019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5b7a9cb3-e4f9-46aa-b1cc-5a293d9dfd59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:29.904192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a9cb3-e4f9-46aa-b1cc-5a293d9dfd59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:29.905654 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a9cb3-e4f9-46aa-b1cc-5a293d9dfd59 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:29.916806 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1432/2861] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:32.104054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=35 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:39.911947 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=9 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:56.729245 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbd954-de6a-4548-bf27-157e8ba6e798 service glance] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:56.740377 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbd954-de6a-4548-bf27-157e8ba6e798 service glance] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:56.745909 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d165c-44a3-4792-b6b1-db170240bffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:56.746550 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d165c-44a3-4792-b6b1-db170240bffa service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:56.746851 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d165c-44a3-4792-b6b1-db170240bffa service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:56.747121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d165c-44a3-4792-b6b1-db170240bffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:56.754704 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d165c-44a3-4792-b6b1-db170240bffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:56.756297 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d165c-44a3-4792-b6b1-db170240bffa service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:56.765293 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1430/2862] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:37:06.760951 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:54.492045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9cb3-e4f9-46aa-b1cc-5a293d9dfd59 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:54.504535 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9cb3-e4f9-46aa-b1cc-5a293d9dfd59 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:54.510377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691428b4-5209-44e4-880a-af6fc788bb33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:54.511154 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691428b4-5209-44e4-880a-af6fc788bb33 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:54.511506 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691428b4-5209-44e4-880a-af6fc788bb33 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:54.511850 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691428b4-5209-44e4-880a-af6fc788bb33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:54.514302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-691428b4-5209-44e4-880a-af6fc788bb33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:54.527966 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691428b4-5209-44e4-880a-af6fc788bb33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:54.530857 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691428b4-5209-44e4-880a-af6fc788bb33 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:54.542113 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1433/2863] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:37:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:37:57.606545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d165c-44a3-4792-b6b1-db170240bffa service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:57.616121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d165c-44a3-4792-b6b1-db170240bffa service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:57.619730 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2cb08-734e-420c-b1f4-cfc7c2afe0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:57.620321 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2cb08-734e-420c-b1f4-cfc7c2afe0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:57.620601 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2cb08-734e-420c-b1f4-cfc7c2afe0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:57.620867 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2cb08-734e-420c-b1f4-cfc7c2afe0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:57.630279 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2cb08-734e-420c-b1f4-cfc7c2afe0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:57.631742 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2cb08-734e-420c-b1f4-cfc7c2afe0d0 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:57.641880 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1431/2864] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:37:57 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:00.620482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a77d3-76d3-4b1c-afb3-52beafb2d6df None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:00.621004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a77d3-76d3-4b1c-afb3-52beafb2d6df None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:00.621223 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a77d3-76d3-4b1c-afb3-52beafb2d6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:00.646700 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5b3a77d3-76d3-4b1c-afb3-52beafb2d6df None None] MFA Rules not processed for user `cc5c09c932714b3fb488067fe789e505`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:00.648076 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5b3a77d3-76d3-4b1c-afb3-52beafb2d6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:00.658896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1434/2865] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:03.425202 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2cb08-734e-420c-b1f4-cfc7c2afe0d0 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:03.437272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2cb08-734e-420c-b1f4-cfc7c2afe0d0 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:03.443473 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec175f-ca2c-46c0-9f2f-df24c576dbe5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:03.444104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec175f-ca2c-46c0-9f2f-df24c576dbe5 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:03.444382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec175f-ca2c-46c0-9f2f-df24c576dbe5 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:03.444651 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec175f-ca2c-46c0-9f2f-df24c576dbe5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:03.457271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec175f-ca2c-46c0-9f2f-df24c576dbe5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:03.459869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec175f-ca2c-46c0-9f2f-df24c576dbe5 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:03.483923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1432/2866] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:10.636911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=9 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:13.467746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=12 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:58.957100 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a77d3-76d3-4b1c-afb3-52beafb2d6df None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:58.970486 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a77d3-76d3-4b1c-afb3-52beafb2d6df None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:58.975744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2633215-dc8e-4759-ad45-2b704977f820 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:58.976358 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2633215-dc8e-4759-ad45-2b704977f820 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:58.976852 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2633215-dc8e-4759-ad45-2b704977f820 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:58.977135 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2633215-dc8e-4759-ad45-2b704977f820 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:58.978962 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a2633215-dc8e-4759-ad45-2b704977f820 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:58.991848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2633215-dc8e-4759-ad45-2b704977f820 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:58.993697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2633215-dc8e-4759-ad45-2b704977f820 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:59.005967 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1435/2867] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:59.225687 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec175f-ca2c-46c0-9f2f-df24c576dbe5 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:59.305351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec175f-ca2c-46c0-9f2f-df24c576dbe5 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:59.309832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:59.310445 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:59.310717 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:59.311013 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] PATH_INFO: `/v3/users/cc5c09c932714b3fb488067fe789e505` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:59.312100 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5c09c932714b3fb488067fe789e505)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:59.313985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:59.367270 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5c09c932714b3fb488067fe789e505'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.380459 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5c09c932714b3fb488067fe789e505'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.388170 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5c09c932714b3fb488067fe789e505'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.405371 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5c09c932714b3fb488067fe789e505'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.406087 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5c09c932714b3fb488067fe789e505'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.412231 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1433/2868] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:59 2022] DELETE /identity/v3/users/cc5c09c932714b3fb488067fe789e505 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:59.417691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e006-ae85-475d-8598-4818da1b0194 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:59.417981 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e006-ae85-475d-8598-4818da1b0194 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:59.418256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e006-ae85-475d-8598-4818da1b0194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:59.460890 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-83b4e006-ae85-475d-8598-4818da1b0194 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:59.462121 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-83b4e006-ae85-475d-8598-4818da1b0194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:59.522212 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1436/2869] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:59.532522 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:59.534000 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:59.592972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02175de0-7dad-4a0d-90fd-487d2463fdd2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:59.597646 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502983-1e9b-4089-a04f-1d8fb398fb8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:59.598258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502983-1e9b-4089-a04f-1d8fb398fb8c service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:59.598533 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502983-1e9b-4089-a04f-1d8fb398fb8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:59.598837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502983-1e9b-4089-a04f-1d8fb398fb8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:59.609894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7502983-1e9b-4089-a04f-1d8fb398fb8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:59.611398 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7502983-1e9b-4089-a04f-1d8fb398fb8c service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:59.620866 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1434/2870] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:59.790836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e006-ae85-475d-8598-4818da1b0194 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:59.792373 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-83b4e006-ae85-475d-8598-4818da1b0194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:59.804780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e006-ae85-475d-8598-4818da1b0194 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:59.809602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:59.810319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:59.810944 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:59.811290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] PATH_INFO: `/v3/projects/9a4e1d87b3c848448c4976065ec5006c` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:59.812424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4e1d87b3c848448c4976065ec5006c)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:59.814306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:59.861126 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4e1d87b3c848448c4976065ec5006c', 'request_id': 'req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.867124 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4e1d87b3c848448c4976065ec5006c', 'request_id': 'req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.873290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4e1d87b3c848448c4976065ec5006c', 'request_id': 'req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.885596 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] The token cache is being invalidate because project 9a4e1d87b3c848448c4976065ec5006c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:59.886352 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.886621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.888169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1437/2871] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:59 2022] DELETE /identity/v3/projects/9a4e1d87b3c848448c4976065ec5006c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:59.892322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502983-1e9b-4089-a04f-1d8fb398fb8c service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:59.899253 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:59.903545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502983-1e9b-4089-a04f-1d8fb398fb8c service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:59.964435 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a82f9-2adb-4bb1-9676-c61555c7df9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:59.965095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a82f9-2adb-4bb1-9676-c61555c7df9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:59.965373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a82f9-2adb-4bb1-9676-c61555c7df9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:59.965644 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a82f9-2adb-4bb1-9676-c61555c7df9c admin admin] PATH_INFO: `/v3/users/e014d1328c114b2dae6969def24cbc77` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:59.966807 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a82f9-2adb-4bb1-9676-c61555c7df9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e014d1328c114b2dae6969def24cbc77)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:59.968737 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a82f9-2adb-4bb1-9676-c61555c7df9c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:00.013504 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb4a82f9-2adb-4bb1-9676-c61555c7df9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e014d1328c114b2dae6969def24cbc77'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.025748 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb4a82f9-2adb-4bb1-9676-c61555c7df9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e014d1328c114b2dae6969def24cbc77'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.033065 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb4a82f9-2adb-4bb1-9676-c61555c7df9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e014d1328c114b2dae6969def24cbc77'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.040573 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb4a82f9-2adb-4bb1-9676-c61555c7df9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e014d1328c114b2dae6969def24cbc77'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.041197 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fb4a82f9-2adb-4bb1-9676-c61555c7df9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e014d1328c114b2dae6969def24cbc77'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.047657 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1435/2872] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:59 2022] DELETE /identity/v3/users/e014d1328c114b2dae6969def24cbc77 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:39:00.321927 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:00.323932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:00.340865 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d028aec-b6d9-426a-a066-4f9fb02aa7e4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:00.389750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:00.399346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582f90e-896b-4e59-9808-4a3cb4aaa017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:00.399975 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f90e-896b-4e59-9808-4a3cb4aaa017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:00.400252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f90e-896b-4e59-9808-4a3cb4aaa017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:00.400525 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f90e-896b-4e59-9808-4a3cb4aaa017 admin admin] PATH_INFO: `/v3/projects/e9d3775b324146ffbb1b26aa2b87f3ba` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:00.402195 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582f90e-896b-4e59-9808-4a3cb4aaa017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d3775b324146ffbb1b26aa2b87f3ba)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:00.404119 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582f90e-896b-4e59-9808-4a3cb4aaa017 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:00.450523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8582f90e-896b-4e59-9808-4a3cb4aaa017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d3775b324146ffbb1b26aa2b87f3ba', 'request_id': 'req-8582f90e-896b-4e59-9808-4a3cb4aaa017'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.456656 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8582f90e-896b-4e59-9808-4a3cb4aaa017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d3775b324146ffbb1b26aa2b87f3ba', 'request_id': 'req-8582f90e-896b-4e59-9808-4a3cb4aaa017'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.462127 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8582f90e-896b-4e59-9808-4a3cb4aaa017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d3775b324146ffbb1b26aa2b87f3ba', 'request_id': 'req-8582f90e-896b-4e59-9808-4a3cb4aaa017'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.475009 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8582f90e-896b-4e59-9808-4a3cb4aaa017 admin admin] The token cache is being invalidate because project e9d3775b324146ffbb1b26aa2b87f3ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:00.475297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8582f90e-896b-4e59-9808-4a3cb4aaa017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.475912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8582f90e-896b-4e59-9808-4a3cb4aaa017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.477431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1438/2873] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:00 2022] DELETE /identity/v3/projects/e9d3775b324146ffbb1b26aa2b87f3ba => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:00.482616 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f715aa-f109-4f3a-865a-8eaa61134fb3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:00.483127 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f715aa-f109-4f3a-865a-8eaa61134fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:00.483233 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f715aa-f109-4f3a-865a-8eaa61134fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:00.532228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a0f715aa-f109-4f3a-865a-8eaa61134fb3 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:00.533484 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a0f715aa-f109-4f3a-865a-8eaa61134fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:00.584787 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:00.595098 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1436/2874] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:00.603125 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b031cb-d7ff-4ff1-b885-4dc83fc2cb0e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:00.603404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b031cb-d7ff-4ff1-b885-4dc83fc2cb0e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:00.603673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b031cb-d7ff-4ff1-b885-4dc83fc2cb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:00.623010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-97b031cb-d7ff-4ff1-b885-4dc83fc2cb0e None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:00.624222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-97b031cb-d7ff-4ff1-b885-4dc83fc2cb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:00.631886 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1439/2875] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:00.636438 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f715aa-f109-4f3a-865a-8eaa61134fb3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:00.646081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f715aa-f109-4f3a-865a-8eaa61134fb3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:00.652509 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ca3bd-fc0f-46ae-bdc8-d8310472427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:00.653119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ca3bd-fc0f-46ae-bdc8-d8310472427c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:00.653424 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ca3bd-fc0f-46ae-bdc8-d8310472427c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:00.653721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ca3bd-fc0f-46ae-bdc8-d8310472427c admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:00.654373 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ca3bd-fc0f-46ae-bdc8-d8310472427c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:39:00.654721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ca3bd-fc0f-46ae-bdc8-d8310472427c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:00.656337 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ca3bd-fc0f-46ae-bdc8-d8310472427c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:00.668294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1437/2876] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:39:00.672620 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b031cb-d7ff-4ff1-b885-4dc83fc2cb0e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:00.681809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b031cb-d7ff-4ff1-b885-4dc83fc2cb0e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:00.687185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5057f3-5bc1-42d6-9862-6579c54db9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:00.687766 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5057f3-5bc1-42d6-9862-6579c54db9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:00.688039 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5057f3-5bc1-42d6-9862-6579c54db9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:00.688299 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5057f3-5bc1-42d6-9862-6579c54db9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:00.688907 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5057f3-5bc1-42d6-9862-6579c54db9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:00.690804 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5057f3-5bc1-42d6-9862-6579c54db9d2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:00.726377 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1440/2877] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:39:00 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:39:00.730372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ca3bd-fc0f-46ae-bdc8-d8310472427c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:00.739972 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ca3bd-fc0f-46ae-bdc8-d8310472427c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:00.794809 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cc5c8-c220-4d46-927e-2fae3b6e8966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:00.795328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cc5c8-c220-4d46-927e-2fae3b6e8966 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:00.795604 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cc5c8-c220-4d46-927e-2fae3b6e8966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:00.795870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cc5c8-c220-4d46-927e-2fae3b6e8966 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:00.796481 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cc5c8-c220-4d46-927e-2fae3b6e8966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:00.798360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cc5c8-c220-4d46-927e-2fae3b6e8966 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:00.819532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1438/2878] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:39:00 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:00.824400 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5057f3-5bc1-42d6-9862-6579c54db9d2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:00.834488 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5057f3-5bc1-42d6-9862-6579c54db9d2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:00.839192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaed29-deae-4ba9-a598-6b9bc56d896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:00.839780 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaed29-deae-4ba9-a598-6b9bc56d896b admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:00.840049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaed29-deae-4ba9-a598-6b9bc56d896b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:00.840318 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaed29-deae-4ba9-a598-6b9bc56d896b admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:00.840952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcaed29-deae-4ba9-a598-6b9bc56d896b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:00.842531 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcaed29-deae-4ba9-a598-6b9bc56d896b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:00.852419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1441/2879] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:00.856496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cc5c8-c220-4d46-927e-2fae3b6e8966 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:00.866388 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cc5c8-c220-4d46-927e-2fae3b6e8966 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:00.871553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad80b2-4426-413e-ade6-f90f591caec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:00.872142 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad80b2-4426-413e-ade6-f90f591caec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:00.872418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad80b2-4426-413e-ade6-f90f591caec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:00.872689 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad80b2-4426-413e-ade6-f90f591caec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:00.873325 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad80b2-4426-413e-ade6-f90f591caec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:00.874945 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad80b2-4426-413e-ade6-f90f591caec2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:00.885192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1439/2880] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:00.889765 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaed29-deae-4ba9-a598-6b9bc56d896b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:00.899646 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaed29-deae-4ba9-a598-6b9bc56d896b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:00.904268 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97016ad-6918-4e5e-8ba9-e75f48875eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:00.904902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97016ad-6918-4e5e-8ba9-e75f48875eac admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:00.905179 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97016ad-6918-4e5e-8ba9-e75f48875eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:00.905451 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97016ad-6918-4e5e-8ba9-e75f48875eac admin admin] PATH_INFO: `/v3/projects/165e9d07cedb4c0ca27cd21b4852592e/users/561e5a606c4545a9bebc15bbcb9de21a/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:00.919763 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97016ad-6918-4e5e-8ba9-e75f48875eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=165e9d07cedb4c0ca27cd21b4852592e, user_id=561e5a606c4545a9bebc15bbcb9de21a, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:00.922382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97016ad-6918-4e5e-8ba9-e75f48875eac admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:00.936448 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1442/2881] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:00 2022] PUT /identity/v3/projects/165e9d07cedb4c0ca27cd21b4852592e/users/561e5a606c4545a9bebc15bbcb9de21a/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:00.941477 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc6242-a64a-4042-9231-9e34eca63d3a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:00.941835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc6242-a64a-4042-9231-9e34eca63d3a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:00.942114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc6242-a64a-4042-9231-9e34eca63d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:00.961191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b0cc6242-a64a-4042-9231-9e34eca63d3a None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:00.962383 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b0cc6242-a64a-4042-9231-9e34eca63d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:01.019696 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1440/2882] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:01.029511 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97016ad-6918-4e5e-8ba9-e75f48875eac admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:01.031265 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f97016ad-6918-4e5e-8ba9-e75f48875eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:01.087708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97016ad-6918-4e5e-8ba9-e75f48875eac admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:01.091305 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ef419-333f-4fa7-bcac-d621dfa41d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:01.091897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef419-333f-4fa7-bcac-d621dfa41d6a service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:01.092178 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef419-333f-4fa7-bcac-d621dfa41d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:01.092450 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef419-333f-4fa7-bcac-d621dfa41d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:01.101256 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ef419-333f-4fa7-bcac-d621dfa41d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:01.102669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ef419-333f-4fa7-bcac-d621dfa41d6a service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:01.112501 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1443/2883] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:04.884706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121cbcf-8364-44a6-aea4-5cec472cdd4e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:04.885191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121cbcf-8364-44a6-aea4-5cec472cdd4e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:04.885191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121cbcf-8364-44a6-aea4-5cec472cdd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:04.914241 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0121cbcf-8364-44a6-aea4-5cec472cdd4e None None] MFA Rules not processed for user `561e5a606c4545a9bebc15bbcb9de21a`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:04.915410 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0121cbcf-8364-44a6-aea4-5cec472cdd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:04.976362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:04.987838 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1441/2884] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:39:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:39:04.991883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ef419-333f-4fa7-bcac-d621dfa41d6a service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:05.001524 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ef419-333f-4fa7-bcac-d621dfa41d6a service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:05.006198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0da7-912b-4ce7-9b63-d4f390683871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:05.006815 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0da7-912b-4ce7-9b63-d4f390683871 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:05.007093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0da7-912b-4ce7-9b63-d4f390683871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:05.007562 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0da7-912b-4ce7-9b63-d4f390683871 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:05.008187 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f0da7-912b-4ce7-9b63-d4f390683871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:05.010060 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f0da7-912b-4ce7-9b63-d4f390683871 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:05.022243 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:05.045353 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1444/2885] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:39:04 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:05.049228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121cbcf-8364-44a6-aea4-5cec472cdd4e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:05.060153 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121cbcf-8364-44a6-aea4-5cec472cdd4e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:05.118169 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1d25d-ec3e-4be3-9e75-4c45e24846ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:05.119580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1d25d-ec3e-4be3-9e75-4c45e24846ec admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:05.119896 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1d25d-ec3e-4be3-9e75-4c45e24846ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:05.120175 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1d25d-ec3e-4be3-9e75-4c45e24846ec admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:05.121331 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1d25d-ec3e-4be3-9e75-4c45e24846ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:05.123513 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1d25d-ec3e-4be3-9e75-4c45e24846ec admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:05.155056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1442/2886] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:39:05 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:05.159175 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0da7-912b-4ce7-9b63-d4f390683871 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:05.169716 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0da7-912b-4ce7-9b63-d4f390683871 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:05.174591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf1651-3ffc-43f4-80eb-987a3d281fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:05.175521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf1651-3ffc-43f4-80eb-987a3d281fef admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:05.175803 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf1651-3ffc-43f4-80eb-987a3d281fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:05.176222 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf1651-3ffc-43f4-80eb-987a3d281fef admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:05.176872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf1651-3ffc-43f4-80eb-987a3d281fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:05.178470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf1651-3ffc-43f4-80eb-987a3d281fef admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:05.190044 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1445/2887] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:05.194157 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1d25d-ec3e-4be3-9e75-4c45e24846ec admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:05.204843 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1d25d-ec3e-4be3-9e75-4c45e24846ec admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:05.209507 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100cdf8-d3cf-4cc4-90d8-66574c30db84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:05.210160 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100cdf8-d3cf-4cc4-90d8-66574c30db84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:05.210439 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100cdf8-d3cf-4cc4-90d8-66574c30db84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:05.210710 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100cdf8-d3cf-4cc4-90d8-66574c30db84 admin admin] PATH_INFO: `/v3/projects/2595f038be0649d79912ef51fa8ae7e7/users/23cef81504f6407da73f487f08dd9dd5/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:05.227041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100cdf8-d3cf-4cc4-90d8-66574c30db84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2595f038be0649d79912ef51fa8ae7e7, user_id=23cef81504f6407da73f487f08dd9dd5, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:05.229720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100cdf8-d3cf-4cc4-90d8-66574c30db84 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:05.249562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1443/2888] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:05 2022] PUT /identity/v3/projects/2595f038be0649d79912ef51fa8ae7e7/users/23cef81504f6407da73f487f08dd9dd5/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:05.251019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf1651-3ffc-43f4-80eb-987a3d281fef admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:05.262709 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf1651-3ffc-43f4-80eb-987a3d281fef admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:05.357275 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd0980-dcf2-4148-b7e5-7c7aed673202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:05.357879 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd0980-dcf2-4148-b7e5-7c7aed673202 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:05.358154 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd0980-dcf2-4148-b7e5-7c7aed673202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:05.358419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd0980-dcf2-4148-b7e5-7c7aed673202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:05.359105 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd0980-dcf2-4148-b7e5-7c7aed673202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:05.360687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd0980-dcf2-4148-b7e5-7c7aed673202 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:05.372978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1446/2889] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:05.378114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100cdf8-d3cf-4cc4-90d8-66574c30db84 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:05.397418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100cdf8-d3cf-4cc4-90d8-66574c30db84 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:05.403120 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d0bf6-ee1d-4760-8ce6-3c3c8cf14089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:05.403454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d0bf6-ee1d-4760-8ce6-3c3c8cf14089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:05.403653 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d0bf6-ee1d-4760-8ce6-3c3c8cf14089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:05.404995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d0bf6-ee1d-4760-8ce6-3c3c8cf14089 admin admin] PATH_INFO: `/v3/projects/2595f038be0649d79912ef51fa8ae7e7/users/23cef81504f6407da73f487f08dd9dd5/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:05.408156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d0bf6-ee1d-4760-8ce6-3c3c8cf14089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2595f038be0649d79912ef51fa8ae7e7, user_id=23cef81504f6407da73f487f08dd9dd5, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:05.410854 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d0bf6-ee1d-4760-8ce6-3c3c8cf14089 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:05.429828 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1444/2890] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:05 2022] PUT /identity/v3/projects/2595f038be0649d79912ef51fa8ae7e7/users/23cef81504f6407da73f487f08dd9dd5/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:09.881621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650a638-73f5-439e-8552-7b2d1e3439a1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:09.882650 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650a638-73f5-439e-8552-7b2d1e3439a1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:09.883160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650a638-73f5-439e-8552-7b2d1e3439a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:09.921152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b650a638-73f5-439e-8552-7b2d1e3439a1 None None] MFA Rules not processed for user `23cef81504f6407da73f487f08dd9dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:09.922634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b650a638-73f5-439e-8552-7b2d1e3439a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:10.014782 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1447/2891] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:39:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:10.032201 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d0bf6-ee1d-4760-8ce6-3c3c8cf14089 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:10.034900 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ec7d0bf6-ee1d-4760-8ce6-3c3c8cf14089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:10.155916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d0bf6-ee1d-4760-8ce6-3c3c8cf14089 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:10.180361 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfca14-9340-4629-8485-4f3b1f0e48e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:10.181123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfca14-9340-4629-8485-4f3b1f0e48e0 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:10.181472 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfca14-9340-4629-8485-4f3b1f0e48e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:10.183114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfca14-9340-4629-8485-4f3b1f0e48e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:10.250842 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:10.270038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfca14-9340-4629-8485-4f3b1f0e48e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:10.272008 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfca14-9340-4629-8485-4f3b1f0e48e0 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:10.283144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1445/2892] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:11.287609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633ade2-9fb6-4f14-b130-55ef43fd3aa5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:11.288088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633ade2-9fb6-4f14-b130-55ef43fd3aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:11.288176 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633ade2-9fb6-4f14-b130-55ef43fd3aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:11.309232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7633ade2-9fb6-4f14-b130-55ef43fd3aa5 None None] MFA Rules not processed for user `561e5a606c4545a9bebc15bbcb9de21a`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:11.310523 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7633ade2-9fb6-4f14-b130-55ef43fd3aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:11.317573 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1448/2893] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:39:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:11.698858 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfca14-9340-4629-8485-4f3b1f0e48e0 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:11.755837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfca14-9340-4629-8485-4f3b1f0e48e0 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:11.759423 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648a43b-e2eb-49cb-ab7d-d4b43bd1145d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:11.760020 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648a43b-e2eb-49cb-ab7d-d4b43bd1145d service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:11.760323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648a43b-e2eb-49cb-ab7d-d4b43bd1145d service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:11.760602 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648a43b-e2eb-49cb-ab7d-d4b43bd1145d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:11.762309 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6648a43b-e2eb-49cb-ab7d-d4b43bd1145d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:11.772495 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648a43b-e2eb-49cb-ab7d-d4b43bd1145d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:11.773925 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648a43b-e2eb-49cb-ab7d-d4b43bd1145d service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:11.782512 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1446/2894] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:21.302744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:21.778679 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=33 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:22.042052 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633ade2-9fb6-4f14-b130-55ef43fd3aa5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:22.043508 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7633ade2-9fb6-4f14-b130-55ef43fd3aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:22.057804 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633ade2-9fb6-4f14-b130-55ef43fd3aa5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:22.061825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7d3b4-0935-4225-bf7a-985b1f107d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:22.062418 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7d3b4-0935-4225-bf7a-985b1f107d5c service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:22.062697 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7d3b4-0935-4225-bf7a-985b1f107d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:22.063000 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7d3b4-0935-4225-bf7a-985b1f107d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:22.071902 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7d3b4-0935-4225-bf7a-985b1f107d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:22.073819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7d3b4-0935-4225-bf7a-985b1f107d5c service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:22.083380 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1449/2895] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:32.079146 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:13.174795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648a43b-e2eb-49cb-ab7d-d4b43bd1145d service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:13.186288 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648a43b-e2eb-49cb-ab7d-d4b43bd1145d service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:13.189798 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae171aef-156c-4b14-85db-dc51b08f2a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:13.190380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae171aef-156c-4b14-85db-dc51b08f2a8d service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:13.190658 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae171aef-156c-4b14-85db-dc51b08f2a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:13.190961 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae171aef-156c-4b14-85db-dc51b08f2a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:13.192625 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ae171aef-156c-4b14-85db-dc51b08f2a8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:13.203829 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae171aef-156c-4b14-85db-dc51b08f2a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:13.205347 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae171aef-156c-4b14-85db-dc51b08f2a8d service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:13.213603 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1447/2896] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:40:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:40:23.209891 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:23.627199 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7d3b4-0935-4225-bf7a-985b1f107d5c service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:23.635786 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7d3b4-0935-4225-bf7a-985b1f107d5c service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:23.640065 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269e1f5-df1e-4689-a755-e8d606afe427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:23.640654 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269e1f5-df1e-4689-a755-e8d606afe427 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:23.640934 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269e1f5-df1e-4689-a755-e8d606afe427 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:23.641201 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269e1f5-df1e-4689-a755-e8d606afe427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:23.642932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9269e1f5-df1e-4689-a755-e8d606afe427 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:23.656552 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269e1f5-df1e-4689-a755-e8d606afe427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:23.657952 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269e1f5-df1e-4689-a755-e8d606afe427 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:23.668674 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1450/2897] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:31.885251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae171aef-156c-4b14-85db-dc51b08f2a8d service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:31.893801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae171aef-156c-4b14-85db-dc51b08f2a8d service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:31.897313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8bd65-1a17-43fe-b577-c9f41b979c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:31.897895 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8bd65-1a17-43fe-b577-c9f41b979c7c service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:31.898166 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8bd65-1a17-43fe-b577-c9f41b979c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:31.898430 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8bd65-1a17-43fe-b577-c9f41b979c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:31.900134 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9ad8bd65-1a17-43fe-b577-c9f41b979c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:31.915924 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8bd65-1a17-43fe-b577-c9f41b979c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:31.917350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8bd65-1a17-43fe-b577-c9f41b979c7c service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:31.928905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1448/2898] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:33.028443 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3d142-0bba-4d6d-98f6-b2ec1a4dca2f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:33.028939 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3d142-0bba-4d6d-98f6-b2ec1a4dca2f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:33.029039 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3d142-0bba-4d6d-98f6-b2ec1a4dca2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:33.101808 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8db3d142-0bba-4d6d-98f6-b2ec1a4dca2f None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:33.103375 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8db3d142-0bba-4d6d-98f6-b2ec1a4dca2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:33.179169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1451/2899] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 01:41:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:33.232054 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8bd65-1a17-43fe-b577-c9f41b979c7c service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:33.234069 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9ad8bd65-1a17-43fe-b577-c9f41b979c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:33.330294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8bd65-1a17-43fe-b577-c9f41b979c7c service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:33.335249 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7dc48-d344-48bc-b83a-adea8ca9f63c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:33.335850 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7dc48-d344-48bc-b83a-adea8ca9f63c service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:33.336126 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7dc48-d344-48bc-b83a-adea8ca9f63c service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:33.336395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7dc48-d344-48bc-b83a-adea8ca9f63c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:33.344198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7dc48-d344-48bc-b83a-adea8ca9f63c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:33.345760 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7dc48-d344-48bc-b83a-adea8ca9f63c service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:33.353629 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1449/2900] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:41:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:41:34.928184 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3d142-0bba-4d6d-98f6-b2ec1a4dca2f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:34.954673 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3d142-0bba-4d6d-98f6-b2ec1a4dca2f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:34.966960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070333a-957d-4452-ac7d-a00d65eb395b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:34.968392 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070333a-957d-4452-ac7d-a00d65eb395b service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:34.969558 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070333a-957d-4452-ac7d-a00d65eb395b service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:34.969943 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070333a-957d-4452-ac7d-a00d65eb395b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:34.972362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9070333a-957d-4452-ac7d-a00d65eb395b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:34.990331 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070333a-957d-4452-ac7d-a00d65eb395b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:34.992468 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070333a-957d-4452-ac7d-a00d65eb395b service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:35.004923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1452/2901] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:41:43.350485 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=47 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:44.999655 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=56 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:45.229574 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7dc48-d344-48bc-b83a-adea8ca9f63c service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:45.239436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7dc48-d344-48bc-b83a-adea8ca9f63c service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:45.243028 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd1d14-c0bc-4faa-a61f-d71b85d7774a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:45.243611 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd1d14-c0bc-4faa-a61f-d71b85d7774a service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:45.243886 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd1d14-c0bc-4faa-a61f-d71b85d7774a service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:45.244154 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd1d14-c0bc-4faa-a61f-d71b85d7774a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:45.245837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-35dd1d14-c0bc-4faa-a61f-d71b85d7774a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:45.255795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd1d14-c0bc-4faa-a61f-d71b85d7774a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:45.257144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd1d14-c0bc-4faa-a61f-d71b85d7774a service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:45.264930 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1450/2902] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:45.376193 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe05b83-89c2-4c92-80d1-c1a8bd28f73c None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:45.376489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe05b83-89c2-4c92-80d1-c1a8bd28f73c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:45.376749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe05b83-89c2-4c92-80d1-c1a8bd28f73c None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:45.378254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1453/2903] 10.222.0.33 () {54 vars in 921 bytes} [Sun Sep 11 01:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:41:45.383191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77987284-bc89-47da-82c6-c5b113efc6a9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:45.383541 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77987284-bc89-47da-82c6-c5b113efc6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:45.383897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77987284-bc89-47da-82c6-c5b113efc6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:45.422594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-77987284-bc89-47da-82c6-c5b113efc6a9 None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:45.423935 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-77987284-bc89-47da-82c6-c5b113efc6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:45.434174 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1451/2904] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 01:41:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:41:45.446484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe05b83-89c2-4c92-80d1-c1a8bd28f73c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:45.448285 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2fe05b83-89c2-4c92-80d1-c1a8bd28f73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:45.507346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe05b83-89c2-4c92-80d1-c1a8bd28f73c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:45.511169 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a070149-54e9-4542-9967-d90ae1681401 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dfdb9054ac4fef97d8e30aa5a8bd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:45.511775 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a070149-54e9-4542-9967-d90ae1681401 service glance] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:45.512101 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a070149-54e9-4542-9967-d90ae1681401 service glance] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:45.512512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a070149-54e9-4542-9967-d90ae1681401 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:45.522455 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a070149-54e9-4542-9967-d90ae1681401 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:45.523938 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a070149-54e9-4542-9967-d90ae1681401 service glance] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:45.534764 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1454/2905] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:45.600848 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77987284-bc89-47da-82c6-c5b113efc6a9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:45.611112 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77987284-bc89-47da-82c6-c5b113efc6a9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:45.617707 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af6ed0-b455-4c0c-8c0e-a8ee8e5b689a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:45.618515 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af6ed0-b455-4c0c-8c0e-a8ee8e5b689a service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:45.618847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af6ed0-b455-4c0c-8c0e-a8ee8e5b689a service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:45.619114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af6ed0-b455-4c0c-8c0e-a8ee8e5b689a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:45.620892 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f3af6ed0-b455-4c0c-8c0e-a8ee8e5b689a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:45.632234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af6ed0-b455-4c0c-8c0e-a8ee8e5b689a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:45.633666 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af6ed0-b455-4c0c-8c0e-a8ee8e5b689a service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:45.641594 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1452/2906] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:45.714183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a070149-54e9-4542-9967-d90ae1681401 service glance] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:45.724020 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a070149-54e9-4542-9967-d90ae1681401 service glance] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:45.727569 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da75cd-5778-49cc-aa8b-c7325b4302b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:45.728150 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da75cd-5778-49cc-aa8b-c7325b4302b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:45.728446 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da75cd-5778-49cc-aa8b-c7325b4302b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:45.728712 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da75cd-5778-49cc-aa8b-c7325b4302b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:45.730381 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-40da75cd-5778-49cc-aa8b-c7325b4302b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:45.743750 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da75cd-5778-49cc-aa8b-c7325b4302b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:45.745138 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da75cd-5778-49cc-aa8b-c7325b4302b1 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:45.755514 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1455/2907] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:45.815624 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af6ed0-b455-4c0c-8c0e-a8ee8e5b689a service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:45.817015 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f3af6ed0-b455-4c0c-8c0e-a8ee8e5b689a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:45.884563 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af6ed0-b455-4c0c-8c0e-a8ee8e5b689a service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:45.889690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341f093-17b5-4c5e-b112-d5d176fc827b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:45.890294 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341f093-17b5-4c5e-b112-d5d176fc827b service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:45.890571 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341f093-17b5-4c5e-b112-d5d176fc827b service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:45.890872 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341f093-17b5-4c5e-b112-d5d176fc827b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:45.892581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a341f093-17b5-4c5e-b112-d5d176fc827b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:45.903946 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341f093-17b5-4c5e-b112-d5d176fc827b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:45.906030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341f093-17b5-4c5e-b112-d5d176fc827b service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:45.915844 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1453/2908] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:47.740691 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195952-a102-43f2-aaf6-70213d4e6049 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:47.741208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195952-a102-43f2-aaf6-70213d4e6049 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:47.741320 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195952-a102-43f2-aaf6-70213d4e6049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:47.760482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-de195952-a102-43f2-aaf6-70213d4e6049 None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:47.761667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-de195952-a102-43f2-aaf6-70213d4e6049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:47.769553 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1456/2909] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 01:41:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:47.782266 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341f093-17b5-4c5e-b112-d5d176fc827b service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:47.793591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341f093-17b5-4c5e-b112-d5d176fc827b service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:47.798531 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa9c63-b0fb-48b1-b0d0-18d8af1bf68f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:47.799146 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa9c63-b0fb-48b1-b0d0-18d8af1bf68f service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:47.799419 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa9c63-b0fb-48b1-b0d0-18d8af1bf68f service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:47.799682 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa9c63-b0fb-48b1-b0d0-18d8af1bf68f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:47.808277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa9c63-b0fb-48b1-b0d0-18d8af1bf68f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:47.809773 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa9c63-b0fb-48b1-b0d0-18d8af1bf68f service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:47.818718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1454/2910] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:41:57.755498 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=35 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:57.815026 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=59 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:02.304810 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dda4c-0179-4b07-b008-707e21043508 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:02.305309 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dda4c-0179-4b07-b008-707e21043508 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:02.305429 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dda4c-0179-4b07-b008-707e21043508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:02.323964 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-687dda4c-0179-4b07-b008-707e21043508 None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:02.325129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-687dda4c-0179-4b07-b008-707e21043508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:02.332104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1457/2911] 10.222.0.33 () {58 vars in 967 bytes} [Sun Sep 11 01:42:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:02.344898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa9c63-b0fb-48b1-b0d0-18d8af1bf68f service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:02.355437 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa9c63-b0fb-48b1-b0d0-18d8af1bf68f service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:02.361121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712565a-f15a-450c-b5b5-7a6f8f493193 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:02.361709 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712565a-f15a-450c-b5b5-7a6f8f493193 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:02.361987 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712565a-f15a-450c-b5b5-7a6f8f493193 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:02.362258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712565a-f15a-450c-b5b5-7a6f8f493193 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:02.370125 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712565a-f15a-450c-b5b5-7a6f8f493193 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:02.371706 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712565a-f15a-450c-b5b5-7a6f8f493193 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:02.379832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1455/2912] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:42:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:42:12.318893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:12.376569 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:09.453512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dda4c-0179-4b07-b008-707e21043508 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:09.454999 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-687dda4c-0179-4b07-b008-707e21043508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:09.541095 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dda4c-0179-4b07-b008-707e21043508 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:09.546062 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a324211-fa7a-4d85-941b-f6f282ff1aeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:09.546747 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324211-fa7a-4d85-941b-f6f282ff1aeb service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:09.547037 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324211-fa7a-4d85-941b-f6f282ff1aeb service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:09.547306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324211-fa7a-4d85-941b-f6f282ff1aeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:09.549031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7a324211-fa7a-4d85-941b-f6f282ff1aeb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:09.560998 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a324211-fa7a-4d85-941b-f6f282ff1aeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:09.563218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a324211-fa7a-4d85-941b-f6f282ff1aeb service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:09.573198 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1458/2913] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:43:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:43:13.647156 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712565a-f15a-450c-b5b5-7a6f8f493193 service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:13.696052 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712565a-f15a-450c-b5b5-7a6f8f493193 service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:13.701733 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46991166-45e8-4494-84ea-28757b5cf61e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:13.702937 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46991166-45e8-4494-84ea-28757b5cf61e service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:13.703340 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46991166-45e8-4494-84ea-28757b5cf61e service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:13.703720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46991166-45e8-4494-84ea-28757b5cf61e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:13.705677 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-46991166-45e8-4494-84ea-28757b5cf61e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:13.719938 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46991166-45e8-4494-84ea-28757b5cf61e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:13.721517 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46991166-45e8-4494-84ea-28757b5cf61e service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:13.734587 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1456/2914] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:43:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:43:15.576621 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a324211-fa7a-4d85-941b-f6f282ff1aeb service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:15.592836 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a324211-fa7a-4d85-941b-f6f282ff1aeb service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:15.598609 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c991f-fe61-4e0f-9cc7-dad0d8dd24f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:15.599315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c991f-fe61-4e0f-9cc7-dad0d8dd24f8 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:15.599661 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c991f-fe61-4e0f-9cc7-dad0d8dd24f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:15.600004 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c991f-fe61-4e0f-9cc7-dad0d8dd24f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:15.601717 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9c9c991f-fe61-4e0f-9cc7-dad0d8dd24f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:15.614099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c991f-fe61-4e0f-9cc7-dad0d8dd24f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:15.615695 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c991f-fe61-4e0f-9cc7-dad0d8dd24f8 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:15.626849 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1459/2915] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:43:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:43:17.365228 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6befc-5218-458d-adb5-7354b5092894 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:17.365744 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6befc-5218-458d-adb5-7354b5092894 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:17.365898 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6befc-5218-458d-adb5-7354b5092894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:17.385356 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-92f6befc-5218-458d-adb5-7354b5092894 None None] MFA Rules not processed for user `561e5a606c4545a9bebc15bbcb9de21a`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:17.386548 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-92f6befc-5218-458d-adb5-7354b5092894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:17.393923 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1457/2916] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:43:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:25.621706 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=43 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:27.380493 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=23 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:45:17.146040 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3068ae1-2ce2-48fd-9745-67eaa2c69d78 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:45:17.146666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3068ae1-2ce2-48fd-9745-67eaa2c69d78 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:45:17.146666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3068ae1-2ce2-48fd-9745-67eaa2c69d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:45:17.178330 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c3068ae1-2ce2-48fd-9745-67eaa2c69d78 None None] MFA Rules not processed for user `c45d8e2b0b674e9a814167db4d78749e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:45:17.179554 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c3068ae1-2ce2-48fd-9745-67eaa2c69d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:17.199490 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1460/2917] 10.222.0.33 () {58 vars in 1062 bytes} [Sun Sep 11 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:45:17.205400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6befc-5218-458d-adb5-7354b5092894 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:45:17.215395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6befc-5218-458d-adb5-7354b5092894 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:45:17.218863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546dcb3-2dd2-4f98-9dd3-c7188c2b5e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:45:17.219447 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546dcb3-2dd2-4f98-9dd3-c7188c2b5e0b service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:45:17.219718 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546dcb3-2dd2-4f98-9dd3-c7188c2b5e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:45:17.219982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546dcb3-2dd2-4f98-9dd3-c7188c2b5e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:45:17.227014 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546dcb3-2dd2-4f98-9dd3-c7188c2b5e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:45:17.228423 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546dcb3-2dd2-4f98-9dd3-c7188c2b5e0b service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:45:17.236215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1458/2918] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:45:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:45:27.195529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=12 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:45:27.232566 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:45:50.629338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3068ae1-2ce2-48fd-9745-67eaa2c69d78 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:45:50.630873 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c3068ae1-2ce2-48fd-9745-67eaa2c69d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:50.678221 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3068ae1-2ce2-48fd-9745-67eaa2c69d78 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:45:50.684365 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a48814-5cd6-4cd8-8d79-69d3f998f718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:45:50.684960 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a48814-5cd6-4cd8-8d79-69d3f998f718 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:45:50.685234 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a48814-5cd6-4cd8-8d79-69d3f998f718 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:45:50.685536 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a48814-5cd6-4cd8-8d79-69d3f998f718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:45:50.693415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a48814-5cd6-4cd8-8d79-69d3f998f718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:45:50.695010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a48814-5cd6-4cd8-8d79-69d3f998f718 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:45:50.704205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1461/2919] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:45:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:00.699853 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=18 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:05.212162 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546dcb3-2dd2-4f98-9dd3-c7188c2b5e0b service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:05.220868 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546dcb3-2dd2-4f98-9dd3-c7188c2b5e0b service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:05.225878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67729ce5-9b2f-4810-98b3-3b034c977526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:05.226628 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67729ce5-9b2f-4810-98b3-3b034c977526 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:05.226929 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67729ce5-9b2f-4810-98b3-3b034c977526 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:05.227192 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67729ce5-9b2f-4810-98b3-3b034c977526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:05.235334 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67729ce5-9b2f-4810-98b3-3b034c977526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:05.236741 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67729ce5-9b2f-4810-98b3-3b034c977526 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:05.244591 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1459/2920] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:05.492911 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace6730-58b6-45a0-8b49-40450a1d08cf None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:05.493411 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace6730-58b6-45a0-8b49-40450a1d08cf None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:05.493606 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace6730-58b6-45a0-8b49-40450a1d08cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:05.530923 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4ace6730-58b6-45a0-8b49-40450a1d08cf None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:05.532043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4ace6730-58b6-45a0-8b49-40450a1d08cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:05.540708 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1462/2921] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 01:46:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:05.552963 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67729ce5-9b2f-4810-98b3-3b034c977526 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:05.564928 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67729ce5-9b2f-4810-98b3-3b034c977526 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:05.570001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48874bb-5ac7-4857-b71d-b4277f3c782d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:05.570589 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48874bb-5ac7-4857-b71d-b4277f3c782d service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:05.570903 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48874bb-5ac7-4857-b71d-b4277f3c782d service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:05.571173 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48874bb-5ac7-4857-b71d-b4277f3c782d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:05.579426 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48874bb-5ac7-4857-b71d-b4277f3c782d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:05.580983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48874bb-5ac7-4857-b71d-b4277f3c782d service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:05.590343 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1460/2922] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:15.528088 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=9 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:15.586428 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=12 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:24.560689 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b567-bda0-44f8-9003-1ccdc2cfd842 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:24.561152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b567-bda0-44f8-9003-1ccdc2cfd842 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:24.561292 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b567-bda0-44f8-9003-1ccdc2cfd842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:24.597988 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5617b567-bda0-44f8-9003-1ccdc2cfd842 None None] MFA Rules not processed for user `c45d8e2b0b674e9a814167db4d78749e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:24.599205 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5617b567-bda0-44f8-9003-1ccdc2cfd842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:24.605572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1463/2923] 10.222.0.33 () {58 vars in 1062 bytes} [Sun Sep 11 01:46:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:24.611795 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48874bb-5ac7-4857-b71d-b4277f3c782d service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:24.620842 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48874bb-5ac7-4857-b71d-b4277f3c782d service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:24.624399 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80516849-8a09-48af-b0be-bd0268727d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:24.625553 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80516849-8a09-48af-b0be-bd0268727d25 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:24.625829 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80516849-8a09-48af-b0be-bd0268727d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:24.626098 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80516849-8a09-48af-b0be-bd0268727d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:24.636304 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80516849-8a09-48af-b0be-bd0268727d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:24.637722 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80516849-8a09-48af-b0be-bd0268727d25 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:24.649064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1461/2924] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:34.595854 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=9 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:34.643619 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:39.949179 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617b567-bda0-44f8-9003-1ccdc2cfd842 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:39.957687 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617b567-bda0-44f8-9003-1ccdc2cfd842 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:39.961419 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bc388-c4eb-40a0-85d9-244e24c8273c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:39.962751 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bc388-c4eb-40a0-85d9-244e24c8273c service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:39.963102 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bc388-c4eb-40a0-85d9-244e24c8273c service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:39.963441 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bc388-c4eb-40a0-85d9-244e24c8273c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:39.973897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bc388-c4eb-40a0-85d9-244e24c8273c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:39.975353 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bc388-c4eb-40a0-85d9-244e24c8273c service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:39.986434 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1464/2925] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:45.801904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80516849-8a09-48af-b0be-bd0268727d25 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:45.810757 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80516849-8a09-48af-b0be-bd0268727d25 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:45.814318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dfeef-07b0-401e-976d-975daed16480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:45.814952 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dfeef-07b0-401e-976d-975daed16480 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:45.815226 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dfeef-07b0-401e-976d-975daed16480 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:45.815492 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dfeef-07b0-401e-976d-975daed16480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:45.875897 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700dfeef-07b0-401e-976d-975daed16480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:45.877315 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700dfeef-07b0-401e-976d-975daed16480 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:45.887427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1462/2926] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:49.088825 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bc388-c4eb-40a0-85d9-244e24c8273c service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:49.107053 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bc388-c4eb-40a0-85d9-244e24c8273c service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:49.116080 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106eed01-6773-4a51-9876-f0c64e5e1546 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:49.118744 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eed01-6773-4a51-9876-f0c64e5e1546 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.119240 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eed01-6773-4a51-9876-f0c64e5e1546 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.125371 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eed01-6773-4a51-9876-f0c64e5e1546 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.128013 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-106eed01-6773-4a51-9876-f0c64e5e1546 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:49.146548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106eed01-6773-4a51-9876-f0c64e5e1546 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:49.148559 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106eed01-6773-4a51-9876-f0c64e5e1546 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:49.162614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1465/2927] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:52.269455 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dfeef-07b0-401e-976d-975daed16480 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:52.286573 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dfeef-07b0-401e-976d-975daed16480 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:52.291499 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc24278-6325-42bd-8051-175fe356ac82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:52.292094 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc24278-6325-42bd-8051-175fe356ac82 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:52.292367 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc24278-6325-42bd-8051-175fe356ac82 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:52.292631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc24278-6325-42bd-8051-175fe356ac82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:52.294351 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-edc24278-6325-42bd-8051-175fe356ac82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:52.307400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc24278-6325-42bd-8051-175fe356ac82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:52.309051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc24278-6325-42bd-8051-175fe356ac82 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:52.320238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1463/2928] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:52.327630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106eed01-6773-4a51-9876-f0c64e5e1546 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:52.338589 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106eed01-6773-4a51-9876-f0c64e5e1546 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:52.347502 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:52.348295 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:52.348638 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:52.348978 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] PATH_INFO: `/v3/users/561e5a606c4545a9bebc15bbcb9de21a` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:52.350254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=561e5a606c4545a9bebc15bbcb9de21a)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:52.352232 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:52.403281 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561e5a606c4545a9bebc15bbcb9de21a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.404424 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561e5a606c4545a9bebc15bbcb9de21a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.412471 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561e5a606c4545a9bebc15bbcb9de21a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.424476 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561e5a606c4545a9bebc15bbcb9de21a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.441575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561e5a606c4545a9bebc15bbcb9de21a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.448329 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1466/2929] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:52 2022] DELETE /identity/v3/users/561e5a606c4545a9bebc15bbcb9de21a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:52.618413 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc24278-6325-42bd-8051-175fe356ac82 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:52.629386 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc24278-6325-42bd-8051-175fe356ac82 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:52.686739 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:52.687380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:52.687659 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:52.687958 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] PATH_INFO: `/v3/projects/165e9d07cedb4c0ca27cd21b4852592e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:52.689064 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=165e9d07cedb4c0ca27cd21b4852592e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:52.690982 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:52.737592 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '165e9d07cedb4c0ca27cd21b4852592e', 'request_id': 'req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.745132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '165e9d07cedb4c0ca27cd21b4852592e', 'request_id': 'req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.751328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '165e9d07cedb4c0ca27cd21b4852592e', 'request_id': 'req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.761630 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] The token cache is being invalidate because project 165e9d07cedb4c0ca27cd21b4852592e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:52.761921 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.762552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.764032 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1464/2930] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:52 2022] DELETE /identity/v3/projects/165e9d07cedb4c0ca27cd21b4852592e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:52.767958 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:52.769397 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:52.782228 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74094d23-572a-4a1a-83b1-f284ad41a8b4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:52.837287 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78194afd-b4ce-4b78-8c14-53fc31b27de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:52.838008 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78194afd-b4ce-4b78-8c14-53fc31b27de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:52.838297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78194afd-b4ce-4b78-8c14-53fc31b27de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:52.838575 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78194afd-b4ce-4b78-8c14-53fc31b27de9 admin admin] PATH_INFO: `/v3/users/23cef81504f6407da73f487f08dd9dd5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:52.839737 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78194afd-b4ce-4b78-8c14-53fc31b27de9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23cef81504f6407da73f487f08dd9dd5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:52.841641 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78194afd-b4ce-4b78-8c14-53fc31b27de9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:52.887860 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-78194afd-b4ce-4b78-8c14-53fc31b27de9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23cef81504f6407da73f487f08dd9dd5'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.888426 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-78194afd-b4ce-4b78-8c14-53fc31b27de9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23cef81504f6407da73f487f08dd9dd5'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.889572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:52.898030 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-78194afd-b4ce-4b78-8c14-53fc31b27de9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23cef81504f6407da73f487f08dd9dd5'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.905493 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-78194afd-b4ce-4b78-8c14-53fc31b27de9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23cef81504f6407da73f487f08dd9dd5'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.917730 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-78194afd-b4ce-4b78-8c14-53fc31b27de9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23cef81504f6407da73f487f08dd9dd5'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:52.923570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1467/2931] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:52 2022] DELETE /identity/v3/users/23cef81504f6407da73f487f08dd9dd5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:53.094984 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:53.096987 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:53.111863 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd16a22-1771-4370-9e3d-b72eb55e6f8e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:53.120303 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:53.176870 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1e37e-285a-409b-9545-4e53a4a5c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:53.177408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1e37e-285a-409b-9545-4e53a4a5c0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:53.177680 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1e37e-285a-409b-9545-4e53a4a5c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:53.177943 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1e37e-285a-409b-9545-4e53a4a5c0ce admin admin] PATH_INFO: `/v3/projects/2595f038be0649d79912ef51fa8ae7e7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:53.179306 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1e37e-285a-409b-9545-4e53a4a5c0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2595f038be0649d79912ef51fa8ae7e7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:53.181218 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1e37e-285a-409b-9545-4e53a4a5c0ce admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:53.227585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-00c1e37e-285a-409b-9545-4e53a4a5c0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2595f038be0649d79912ef51fa8ae7e7', 'request_id': 'req-00c1e37e-285a-409b-9545-4e53a4a5c0ce'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:53.234979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-00c1e37e-285a-409b-9545-4e53a4a5c0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2595f038be0649d79912ef51fa8ae7e7', 'request_id': 'req-00c1e37e-285a-409b-9545-4e53a4a5c0ce'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:53.241360 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-00c1e37e-285a-409b-9545-4e53a4a5c0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2595f038be0649d79912ef51fa8ae7e7', 'request_id': 'req-00c1e37e-285a-409b-9545-4e53a4a5c0ce'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:53.251527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-00c1e37e-285a-409b-9545-4e53a4a5c0ce admin admin] The token cache is being invalidate because project 2595f038be0649d79912ef51fa8ae7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:53.251816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-00c1e37e-285a-409b-9545-4e53a4a5c0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:53.252448 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-00c1e37e-285a-409b-9545-4e53a4a5c0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:53.253905 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1465/2932] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:53 2022] DELETE /identity/v3/projects/2595f038be0649d79912ef51fa8ae7e7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:53.258896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1673d-53af-47ed-b7a0-51377d3f583f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:53.259214 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1673d-53af-47ed-b7a0-51377d3f583f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:53.259491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1673d-53af-47ed-b7a0-51377d3f583f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:53.279278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-92f1673d-53af-47ed-b7a0-51377d3f583f None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:53.280474 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-92f1673d-53af-47ed-b7a0-51377d3f583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:53.337948 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1468/2933] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:53.345740 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608747e-1ffc-4e7c-917b-0edf23aead6d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:53.346198 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608747e-1ffc-4e7c-917b-0edf23aead6d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:53.346312 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608747e-1ffc-4e7c-917b-0edf23aead6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:53.366347 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1608747e-1ffc-4e7c-917b-0edf23aead6d None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:53.367577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1608747e-1ffc-4e7c-917b-0edf23aead6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:53.375527 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1466/2934] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:53.379672 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1673d-53af-47ed-b7a0-51377d3f583f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:53.389772 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1673d-53af-47ed-b7a0-51377d3f583f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:53.394413 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b46e3d-31a3-406e-849d-c52c9562d85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:53.395034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b46e3d-31a3-406e-849d-c52c9562d85f admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:53.395315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b46e3d-31a3-406e-849d-c52c9562d85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:53.395585 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b46e3d-31a3-406e-849d-c52c9562d85f admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:53.396226 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b46e3d-31a3-406e-849d-c52c9562d85f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:47:53.396529 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b46e3d-31a3-406e-849d-c52c9562d85f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:53.398104 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b46e3d-31a3-406e-849d-c52c9562d85f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:53.410057 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1469/2935] 10.222.0.33 () {58 vars in 1153 bytes} [Sun Sep 11 01:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:47:53.414277 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608747e-1ffc-4e7c-917b-0edf23aead6d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:53.423496 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608747e-1ffc-4e7c-917b-0edf23aead6d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:53.428101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296476f3-b4b8-4900-845f-68df11a62100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:53.428894 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296476f3-b4b8-4900-845f-68df11a62100 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:53.429171 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296476f3-b4b8-4900-845f-68df11a62100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:53.429443 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296476f3-b4b8-4900-845f-68df11a62100 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:53.430117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296476f3-b4b8-4900-845f-68df11a62100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:53.432051 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296476f3-b4b8-4900-845f-68df11a62100 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:53.459150 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1467/2936] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:53 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:53.463872 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b46e3d-31a3-406e-849d-c52c9562d85f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:53.473884 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b46e3d-31a3-406e-849d-c52c9562d85f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:53.531031 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8570f-90bc-4f26-93e1-e03f61153e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:53.531736 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8570f-90bc-4f26-93e1-e03f61153e9e admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:53.532017 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8570f-90bc-4f26-93e1-e03f61153e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:53.532290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8570f-90bc-4f26-93e1-e03f61153e9e admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:53.532928 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8570f-90bc-4f26-93e1-e03f61153e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:53.534892 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8570f-90bc-4f26-93e1-e03f61153e9e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:53.555387 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1470/2937] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:53 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:47:53.559476 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296476f3-b4b8-4900-845f-68df11a62100 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:53.569660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296476f3-b4b8-4900-845f-68df11a62100 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:53.574835 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c282cc8-de8f-4956-a782-bb2514b30c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:53.575437 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c282cc8-de8f-4956-a782-bb2514b30c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:53.575714 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c282cc8-de8f-4956-a782-bb2514b30c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:53.575985 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c282cc8-de8f-4956-a782-bb2514b30c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:53.576623 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c282cc8-de8f-4956-a782-bb2514b30c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:53.578210 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c282cc8-de8f-4956-a782-bb2514b30c9b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:53.589155 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1468/2938] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:47:53.593048 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8570f-90bc-4f26-93e1-e03f61153e9e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:53.603042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8570f-90bc-4f26-93e1-e03f61153e9e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:53.608589 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6ea4f-f482-46f1-93c0-29cdcccafc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:53.609223 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6ea4f-f482-46f1-93c0-29cdcccafc19 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:53.609524 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6ea4f-f482-46f1-93c0-29cdcccafc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:53.609777 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6ea4f-f482-46f1-93c0-29cdcccafc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:53.610423 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6ea4f-f482-46f1-93c0-29cdcccafc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:53.612045 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6ea4f-f482-46f1-93c0-29cdcccafc19 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:53.623016 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1471/2939] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:47:53.627369 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c282cc8-de8f-4956-a782-bb2514b30c9b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:53.637858 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c282cc8-de8f-4956-a782-bb2514b30c9b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:53.642427 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895953e2-3030-438b-869c-7667441d373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:53.643101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895953e2-3030-438b-869c-7667441d373f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:53.643378 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895953e2-3030-438b-869c-7667441d373f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:53.643655 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895953e2-3030-438b-869c-7667441d373f admin admin] PATH_INFO: `/v3/projects/db62fffedd114c1c90b39a8bca092097/users/3b815f0dd3d6435eb8fdec65aac46418/roles/f5585030f686473c89e1de214b25b6ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:53.658931 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895953e2-3030-438b-869c-7667441d373f admin admin] RBAC: Authorizing `identity:create_grant(project_id=db62fffedd114c1c90b39a8bca092097, user_id=3b815f0dd3d6435eb8fdec65aac46418, role_id=f5585030f686473c89e1de214b25b6ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:53.661562 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895953e2-3030-438b-869c-7667441d373f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:53.674119 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1469/2940] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:53 2022] PUT /identity/v3/projects/db62fffedd114c1c90b39a8bca092097/users/3b815f0dd3d6435eb8fdec65aac46418/roles/f5585030f686473c89e1de214b25b6ff => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:53.679382 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97306b57-f478-41e2-9529-c7ddc0f488e0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:53.679611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97306b57-f478-41e2-9529-c7ddc0f488e0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:53.679883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97306b57-f478-41e2-9529-c7ddc0f488e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:53.698712 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-97306b57-f478-41e2-9529-c7ddc0f488e0 None None] MFA Rules not processed for user `c252561ac77c437ba347f9d9a260e990`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:53.699921 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-97306b57-f478-41e2-9529-c7ddc0f488e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:53.726160 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:53.761313 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1472/2941] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:47:53.771121 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895953e2-3030-438b-869c-7667441d373f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:53.772836 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-895953e2-3030-438b-869c-7667441d373f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:53.814081 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:53.830788 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895953e2-3030-438b-869c-7667441d373f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:53.834552 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b58a2-08d1-472d-9891-fafa7866d424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:53.835184 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b58a2-08d1-472d-9891-fafa7866d424 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:53.835462 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b58a2-08d1-472d-9891-fafa7866d424 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:53.835731 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b58a2-08d1-472d-9891-fafa7866d424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:53.844690 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b58a2-08d1-472d-9891-fafa7866d424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:53.846111 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b58a2-08d1-472d-9891-fafa7866d424 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:53.855969 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1470/2942] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:57.552029 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cefbae-1b3f-4065-8e74-1b8b34f14c4a None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:57.552547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cefbae-1b3f-4065-8e74-1b8b34f14c4a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:57.552547 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cefbae-1b3f-4065-8e74-1b8b34f14c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:57.584183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-76cefbae-1b3f-4065-8e74-1b8b34f14c4a None None] MFA Rules not processed for user `3b815f0dd3d6435eb8fdec65aac46418`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:57.585404 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-76cefbae-1b3f-4065-8e74-1b8b34f14c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:57.667049 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1473/2943] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:47:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:57.671532 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b58a2-08d1-472d-9891-fafa7866d424 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:57.686144 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b58a2-08d1-472d-9891-fafa7866d424 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:57.691009 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef789c9-22bb-43ea-942e-b51cae93dc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:57.691697 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef789c9-22bb-43ea-942e-b51cae93dc4d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:57.692070 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef789c9-22bb-43ea-942e-b51cae93dc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:57.692454 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef789c9-22bb-43ea-942e-b51cae93dc4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:57.693148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef789c9-22bb-43ea-942e-b51cae93dc4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:57.695110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef789c9-22bb-43ea-942e-b51cae93dc4d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:57.729813 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1471/2944] 10.222.0.33 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:57 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:57.730648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cefbae-1b3f-4065-8e74-1b8b34f14c4a None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:57.746819 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cefbae-1b3f-4065-8e74-1b8b34f14c4a None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:57.822087 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba3522-6e21-4da3-8f7e-0997053e5821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:57.822717 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba3522-6e21-4da3-8f7e-0997053e5821 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:57.823752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba3522-6e21-4da3-8f7e-0997053e5821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:57.823752 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba3522-6e21-4da3-8f7e-0997053e5821 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:57.824438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba3522-6e21-4da3-8f7e-0997053e5821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:57.826874 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba3522-6e21-4da3-8f7e-0997053e5821 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:57.850315 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1474/2945] 10.222.0.33 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:57 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:47:57.854721 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef789c9-22bb-43ea-942e-b51cae93dc4d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:57.865382 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef789c9-22bb-43ea-942e-b51cae93dc4d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:57.870359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c6e6e-a567-40f8-8006-923971641ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:57.871046 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c6e6e-a567-40f8-8006-923971641ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:57.871317 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c6e6e-a567-40f8-8006-923971641ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:57.871585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c6e6e-a567-40f8-8006-923971641ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:57.872258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c6e6e-a567-40f8-8006-923971641ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:57.873851 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c6e6e-a567-40f8-8006-923971641ad3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:57.885916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1472/2946] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:47:57.889996 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba3522-6e21-4da3-8f7e-0997053e5821 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:57.900787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba3522-6e21-4da3-8f7e-0997053e5821 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:57.910319 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5248939-7fc7-4d9e-90ad-f34c45b668c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:57.911058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5248939-7fc7-4d9e-90ad-f34c45b668c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:57.911461 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5248939-7fc7-4d9e-90ad-f34c45b668c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:57.911740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5248939-7fc7-4d9e-90ad-f34c45b668c1 admin admin] PATH_INFO: `/v3/projects/03f7f87e13d24857be15bd1d3a554c38/users/28620e20f8c74ae1b12895f91d7a26e8/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:57.928412 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5248939-7fc7-4d9e-90ad-f34c45b668c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f7f87e13d24857be15bd1d3a554c38, user_id=28620e20f8c74ae1b12895f91d7a26e8, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:57.931530 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5248939-7fc7-4d9e-90ad-f34c45b668c1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:57.946912 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1475/2947] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:57 2022] PUT /identity/v3/projects/03f7f87e13d24857be15bd1d3a554c38/users/28620e20f8c74ae1b12895f91d7a26e8/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:57.950580 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c6e6e-a567-40f8-8006-923971641ad3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:57.961956 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c6e6e-a567-40f8-8006-923971641ad3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:58.019610 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acfc32-8386-4b75-b8d5-97518e1f7913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:58.020271 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acfc32-8386-4b75-b8d5-97518e1f7913 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:58.020495 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acfc32-8386-4b75-b8d5-97518e1f7913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:58.020762 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acfc32-8386-4b75-b8d5-97518e1f7913 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:58.021400 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acfc32-8386-4b75-b8d5-97518e1f7913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:58.023029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acfc32-8386-4b75-b8d5-97518e1f7913 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:58.034213 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1473/2948] 10.222.0.33 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:58.038491 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5248939-7fc7-4d9e-90ad-f34c45b668c1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:58.049626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5248939-7fc7-4d9e-90ad-f34c45b668c1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:58.054615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998e8a5-7e8d-43a7-b9bd-ba856ebdfd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:58.055353 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e8a5-7e8d-43a7-b9bd-ba856ebdfd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:58.055630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e8a5-7e8d-43a7-b9bd-ba856ebdfd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:58.055916 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e8a5-7e8d-43a7-b9bd-ba856ebdfd1e admin admin] PATH_INFO: `/v3/projects/03f7f87e13d24857be15bd1d3a554c38/users/28620e20f8c74ae1b12895f91d7a26e8/roles/36c98abb38594a2f8c43a4ec8c919b20` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:58.059331 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998e8a5-7e8d-43a7-b9bd-ba856ebdfd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f7f87e13d24857be15bd1d3a554c38, user_id=28620e20f8c74ae1b12895f91d7a26e8, role_id=36c98abb38594a2f8c43a4ec8c919b20)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:58.062050 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998e8a5-7e8d-43a7-b9bd-ba856ebdfd1e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:58.074180 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1476/2949] 10.222.0.33 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:58 2022] PUT /identity/v3/projects/03f7f87e13d24857be15bd1d3a554c38/users/28620e20f8c74ae1b12895f91d7a26e8/roles/36c98abb38594a2f8c43a4ec8c919b20 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:48:02.623376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dfc2f-0a7d-4990-a32e-9085ec5ed17b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:02.623879 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dfc2f-0a7d-4990-a32e-9085ec5ed17b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:02.623983 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dfc2f-0a7d-4990-a32e-9085ec5ed17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:02.658092 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7c5dfc2f-0a7d-4990-a32e-9085ec5ed17b None None] MFA Rules not processed for user `28620e20f8c74ae1b12895f91d7a26e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:02.659408 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7c5dfc2f-0a7d-4990-a32e-9085ec5ed17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:02.772267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1474/2950] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:48:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:02.789093 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998e8a5-7e8d-43a7-b9bd-ba856ebdfd1e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:02.791470 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a998e8a5-7e8d-43a7-b9bd-ba856ebdfd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:02.810142 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:02.885940 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998e8a5-7e8d-43a7-b9bd-ba856ebdfd1e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:02.891489 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5cd96-b28b-4284-a515-546d5a68b3e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:02.892097 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5cd96-b28b-4284-a515-546d5a68b3e0 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:02.892370 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5cd96-b28b-4284-a515-546d5a68b3e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:02.892637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5cd96-b28b-4284-a515-546d5a68b3e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:02.953858 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5cd96-b28b-4284-a515-546d5a68b3e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:02.955548 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5cd96-b28b-4284-a515-546d5a68b3e0 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:02.965729 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1477/2951] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:03.968916 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe2b09-d691-4837-b4e9-5e573197d6ba None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:03.969436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe2b09-d691-4837-b4e9-5e573197d6ba None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:03.969436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe2b09-d691-4837-b4e9-5e573197d6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:03.989229 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-11fe2b09-d691-4837-b4e9-5e573197d6ba None None] MFA Rules not processed for user `3b815f0dd3d6435eb8fdec65aac46418`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:03.990418 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-11fe2b09-d691-4837-b4e9-5e573197d6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:03.999106 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1475/2952] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:48:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:04.313802 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5cd96-b28b-4284-a515-546d5a68b3e0 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:04.369602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5cd96-b28b-4284-a515-546d5a68b3e0 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:04.373254 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8c489-5899-4d2f-96f8-9a834900a1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:04.373848 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8c489-5899-4d2f-96f8-9a834900a1cb service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:04.374122 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8c489-5899-4d2f-96f8-9a834900a1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:04.374389 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8c489-5899-4d2f-96f8-9a834900a1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:04.376138 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bbc8c489-5899-4d2f-96f8-9a834900a1cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:04.386702 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8c489-5899-4d2f-96f8-9a834900a1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:04.388181 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8c489-5899-4d2f-96f8-9a834900a1cb service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:04.396290 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1478/2953] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:04.745116 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429e976-fffb-472c-9a96-cda1c99852fc None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:04.745597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429e976-fffb-472c-9a96-cda1c99852fc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:04.745939 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429e976-fffb-472c-9a96-cda1c99852fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:04.768318 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f429e976-fffb-472c-9a96-cda1c99852fc None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:04.769746 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f429e976-fffb-472c-9a96-cda1c99852fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:04.789742 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:04.840545 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1476/2954] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 01:48:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:04.852680 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8c489-5899-4d2f-96f8-9a834900a1cb service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:04.854041 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bbc8c489-5899-4d2f-96f8-9a834900a1cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:04.868951 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8c489-5899-4d2f-96f8-9a834900a1cb service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:04.874043 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022bd11-ef06-4ee4-8541-7e22df7e2d7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:04.874637 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bd11-ef06-4ee4-8541-7e22df7e2d7f service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:04.875537 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bd11-ef06-4ee4-8541-7e22df7e2d7f service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:04.875814 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bd11-ef06-4ee4-8541-7e22df7e2d7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:04.884630 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022bd11-ef06-4ee4-8541-7e22df7e2d7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:04.886429 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022bd11-ef06-4ee4-8541-7e22df7e2d7f service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:04.896749 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1479/2955] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:12.649705 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429e976-fffb-472c-9a96-cda1c99852fc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:12.662756 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429e976-fffb-472c-9a96-cda1c99852fc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:12.668217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02066730-46f8-45b4-bd40-ac2059e8bdba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:12.668960 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02066730-46f8-45b4-bd40-ac2059e8bdba service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:12.669238 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02066730-46f8-45b4-bd40-ac2059e8bdba service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:12.669505 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02066730-46f8-45b4-bd40-ac2059e8bdba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:12.671246 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-02066730-46f8-45b4-bd40-ac2059e8bdba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:12.684945 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02066730-46f8-45b4-bd40-ac2059e8bdba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:12.686606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02066730-46f8-45b4-bd40-ac2059e8bdba service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:12.698001 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1477/2956] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:14.450024 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022bd11-ef06-4ee4-8541-7e22df7e2d7f service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:14.459218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022bd11-ef06-4ee4-8541-7e22df7e2d7f service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:14.462832 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa51c8-45cc-4807-b8ee-465ddf9397c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:14.463421 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa51c8-45cc-4807-b8ee-465ddf9397c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:14.463699 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa51c8-45cc-4807-b8ee-465ddf9397c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:14.463970 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa51c8-45cc-4807-b8ee-465ddf9397c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:14.473084 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa51c8-45cc-4807-b8ee-465ddf9397c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:14.474481 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa51c8-45cc-4807-b8ee-465ddf9397c9 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:14.485694 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1480/2957] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:15.407278 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02066730-46f8-45b4-bd40-ac2059e8bdba service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:15.422944 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02066730-46f8-45b4-bd40-ac2059e8bdba service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:15.429078 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a887385-daad-42b4-a014-0c42ba156cb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:15.430004 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a887385-daad-42b4-a014-0c42ba156cb6 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:15.430597 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a887385-daad-42b4-a014-0c42ba156cb6 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:15.430987 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a887385-daad-42b4-a014-0c42ba156cb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:15.433359 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3a887385-daad-42b4-a014-0c42ba156cb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:15.446217 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a887385-daad-42b4-a014-0c42ba156cb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:15.447970 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a887385-daad-42b4-a014-0c42ba156cb6 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:15.459101 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1478/2958] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:16.345591 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa51c8-45cc-4807-b8ee-465ddf9397c9 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:16.359306 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa51c8-45cc-4807-b8ee-465ddf9397c9 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:16.364661 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fbd68-0841-47e9-8c15-5394a174a1a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:16.365248 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fbd68-0841-47e9-8c15-5394a174a1a9 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:16.365521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fbd68-0841-47e9-8c15-5394a174a1a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:16.365787 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fbd68-0841-47e9-8c15-5394a174a1a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:16.367495 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-654fbd68-0841-47e9-8c15-5394a174a1a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:16.379572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fbd68-0841-47e9-8c15-5394a174a1a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:16.381158 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fbd68-0841-47e9-8c15-5394a174a1a9 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:16.392099 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1481/2959] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:25.454203 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=31 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:26.387321 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=94 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:50:18.167847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee6cba-674c-4f18-8bc1-14f0cf1bb51d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:18.168372 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee6cba-674c-4f18-8bc1-14f0cf1bb51d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:18.168575 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee6cba-674c-4f18-8bc1-14f0cf1bb51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:18.188565 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-67ee6cba-674c-4f18-8bc1-14f0cf1bb51d None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:50:18.189769 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-67ee6cba-674c-4f18-8bc1-14f0cf1bb51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:18.243995 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1479/2960] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 01:50:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:50:18.291861 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e49ba6-ae06-427a-b382-de84fb1ab3f7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:18.292351 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e49ba6-ae06-427a-b382-de84fb1ab3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:18.292453 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e49ba6-ae06-427a-b382-de84fb1ab3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:18.340338 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d0e49ba6-ae06-427a-b382-de84fb1ab3f7 None None] MFA Rules not processed for user `e8baa8033f884cb6a7783f78c01a212e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:50:18.342019 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d0e49ba6-ae06-427a-b382-de84fb1ab3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:18.405614 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1482/2961] 10.222.0.33 () {58 vars in 1040 bytes} [Sun Sep 11 01:50:18 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:50:18.407869 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e92ff-6574-48d2-b77d-221bd5b2176a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:18.408049 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e92ff-6574-48d2-b77d-221bd5b2176a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:18.408376 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e92ff-6574-48d2-b77d-221bd5b2176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:18.411897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e49ba6-ae06-427a-b382-de84fb1ab3f7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:50:18.422040 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e49ba6-ae06-427a-b382-de84fb1ab3f7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:50:18.429310 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-116e92ff-6574-48d2-b77d-221bd5b2176a None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:50:18.429483 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28d743-f746-46af-a31c-fea11cae0701 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:50:18.430415 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28d743-f746-46af-a31c-fea11cae0701 service swift] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:18.430776 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28d743-f746-46af-a31c-fea11cae0701 service swift] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:18.430927 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-116e92ff-6574-48d2-b77d-221bd5b2176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:18.431162 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28d743-f746-46af-a31c-fea11cae0701 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:18.440285 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1480/2962] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Sep 11 01:50:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:50:18.440592 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28d743-f746-46af-a31c-fea11cae0701 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:50:18.442159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28d743-f746-46af-a31c-fea11cae0701 service swift] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:50:18.451337 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1483/2963] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:50:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:50:18.454429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e92ff-6574-48d2-b77d-221bd5b2176a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:50:18.464934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e92ff-6574-48d2-b77d-221bd5b2176a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:50:18.470110 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e37fad-0d1a-4ae6-b738-489f9d59d49d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:50:18.470700 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e37fad-0d1a-4ae6-b738-489f9d59d49d service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:18.471010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e37fad-0d1a-4ae6-b738-489f9d59d49d service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:18.471328 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e37fad-0d1a-4ae6-b738-489f9d59d49d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:18.489269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e37fad-0d1a-4ae6-b738-489f9d59d49d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:50:18.491650 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e37fad-0d1a-4ae6-b738-489f9d59d49d service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:50:18.503132 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1481/2964] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:50:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:50:26.222218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28d743-f746-46af-a31c-fea11cae0701 service swift] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:50:26.233188 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28d743-f746-46af-a31c-fea11cae0701 service swift] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:50:26.239215 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de888a-75d0-43ad-a2e3-d7827c4a37e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:50:26.239788 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de888a-75d0-43ad-a2e3-d7827c4a37e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:26.240077 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de888a-75d0-43ad-a2e3-d7827c4a37e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:26.240362 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de888a-75d0-43ad-a2e3-d7827c4a37e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:26.243196 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-50de888a-75d0-43ad-a2e3-d7827c4a37e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:26.258398 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de888a-75d0-43ad-a2e3-d7827c4a37e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:50:26.262745 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de888a-75d0-43ad-a2e3-d7827c4a37e1 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:50:26.282867 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1484/2965] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:50:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:50:27.731977 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435c642-e7ea-414b-9413-b5e61055ac60 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:27.732542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435c642-e7ea-414b-9413-b5e61055ac60 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:27.732542 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435c642-e7ea-414b-9413-b5e61055ac60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:27.751561 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a435c642-e7ea-414b-9413-b5e61055ac60 None None] MFA Rules not processed for user `3b815f0dd3d6435eb8fdec65aac46418`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:50:27.753433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a435c642-e7ea-414b-9413-b5e61055ac60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:27.762114 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1482/2966] 10.222.0.33 () {58 vars in 958 bytes} [Sun Sep 11 01:50:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:50:29.613174 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428eb0f7-21ab-4ad2-bcd2-58d29cac287e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:29.613690 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428eb0f7-21ab-4ad2-bcd2-58d29cac287e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:29.613791 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428eb0f7-21ab-4ad2-bcd2-58d29cac287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:29.633227 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-428eb0f7-21ab-4ad2-bcd2-58d29cac287e None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:50:29.634544 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-428eb0f7-21ab-4ad2-bcd2-58d29cac287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:29.642384 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1485/2967] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 01:50:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:50:29.655267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435c642-e7ea-414b-9413-b5e61055ac60 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:50:29.666884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435c642-e7ea-414b-9413-b5e61055ac60 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:50:29.671878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729979e-dbdc-4035-8bdd-b5f5e80036c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:50:29.672415 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729979e-dbdc-4035-8bdd-b5f5e80036c5 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:29.672694 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729979e-dbdc-4035-8bdd-b5f5e80036c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:29.672967 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729979e-dbdc-4035-8bdd-b5f5e80036c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:29.681422 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729979e-dbdc-4035-8bdd-b5f5e80036c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:50:29.683038 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729979e-dbdc-4035-8bdd-b5f5e80036c5 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:50:29.691822 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1483/2968] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:50:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:50:39.628278 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=54 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:50:39.688540 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=43 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:50:46.821349 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428eb0f7-21ab-4ad2-bcd2-58d29cac287e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:50:46.822893 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-428eb0f7-21ab-4ad2-bcd2-58d29cac287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:46.838032 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428eb0f7-21ab-4ad2-bcd2-58d29cac287e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:50:46.843452 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56cb3f-a7b0-4e31-b540-5965fbfb8daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:50:46.844073 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56cb3f-a7b0-4e31-b540-5965fbfb8daa service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:46.844342 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56cb3f-a7b0-4e31-b540-5965fbfb8daa service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:46.844602 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56cb3f-a7b0-4e31-b540-5965fbfb8daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:46.846252 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3a56cb3f-a7b0-4e31-b540-5965fbfb8daa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:46.858600 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56cb3f-a7b0-4e31-b540-5965fbfb8daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:50:46.860183 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56cb3f-a7b0-4e31-b540-5965fbfb8daa service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:50:46.870564 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1486/2969] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:50:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:50:56.866058 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:52:14.183215 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955f1a-19b1-4617-bba0-f83a5c129bc8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:14.183847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955f1a-19b1-4617-bba0-f83a5c129bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:14.183847 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955f1a-19b1-4617-bba0-f83a5c129bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:14.229942 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-be955f1a-19b1-4617-bba0-f83a5c129bc8 None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:14.231191 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-be955f1a-19b1-4617-bba0-f83a5c129bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:14.240738 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1484/2970] 10.222.0.33 () {58 vars in 1059 bytes} [Sun Sep 11 01:52:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:14.246684 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f5979-b553-4b3a-896c-787213883f68 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:14.247236 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f5979-b553-4b3a-896c-787213883f68 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:14.247369 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f5979-b553-4b3a-896c-787213883f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:14.267164 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-916f5979-b553-4b3a-896c-787213883f68 None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:14.268631 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-916f5979-b553-4b3a-896c-787213883f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:14.277659 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1487/2971] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 01:52:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:14.288779 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6a44e-b478-4896-ac5c-456cd7cee40a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:14.289080 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6a44e-b478-4896-ac5c-456cd7cee40a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:14.289338 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6a44e-b478-4896-ac5c-456cd7cee40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:14.338148 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d2a6a44e-b478-4896-ac5c-456cd7cee40a None None] MFA Rules not processed for user `f0dfdb9054ac4fef97d8e30aa5a8bd66`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:14.339358 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d2a6a44e-b478-4896-ac5c-456cd7cee40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:14.398117 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1485/2972] 10.222.0.33 () {58 vars in 1063 bytes} [Sun Sep 11 01:52:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:14.404897 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f5979-b553-4b3a-896c-787213883f68 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:14.414422 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f5979-b553-4b3a-896c-787213883f68 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:14.417980 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bda17c-a2d4-4e59-8215-4c9434b31f80 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dfdb9054ac4fef97d8e30aa5a8bd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:14.418572 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bda17c-a2d4-4e59-8215-4c9434b31f80 service glance] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:14.418896 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bda17c-a2d4-4e59-8215-4c9434b31f80 service glance] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:14.419172 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bda17c-a2d4-4e59-8215-4c9434b31f80 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:14.429516 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bda17c-a2d4-4e59-8215-4c9434b31f80 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:14.430992 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bda17c-a2d4-4e59-8215-4c9434b31f80 service glance] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:14.442178 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1488/2973] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:52:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:52:17.856308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77873d90-81b2-4d52-9901-d796a9259fc7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:17.856816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77873d90-81b2-4d52-9901-d796a9259fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:17.856934 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77873d90-81b2-4d52-9901-d796a9259fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:17.908073 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-77873d90-81b2-4d52-9901-d796a9259fc7 None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:17.909302 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-77873d90-81b2-4d52-9901-d796a9259fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:17.926041 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1486/2974] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 01:52:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:52:17.969883 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bda17c-a2d4-4e59-8215-4c9434b31f80 service glance] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:17.994613 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bda17c-a2d4-4e59-8215-4c9434b31f80 service glance] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:18.000152 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4334-0a14-4a63-9b4d-489460ad17c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:18.000963 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4334-0a14-4a63-9b4d-489460ad17c0 service swift] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:18.001246 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4334-0a14-4a63-9b4d-489460ad17c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:18.001745 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4334-0a14-4a63-9b4d-489460ad17c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:18.010328 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c4334-0a14-4a63-9b4d-489460ad17c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:18.011948 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c4334-0a14-4a63-9b4d-489460ad17c0 service swift] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:18.020723 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1489/2975] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:52:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:52:19.940759 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c348ca3-b173-4ae6-9ea1-4552588349cc None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:19.941395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c348ca3-b173-4ae6-9ea1-4552588349cc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:19.941395 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c348ca3-b173-4ae6-9ea1-4552588349cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:19.979588 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9c348ca3-b173-4ae6-9ea1-4552588349cc None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:19.984990 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9c348ca3-b173-4ae6-9ea1-4552588349cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:20.003056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1487/2976] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 01:52:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:20.056505 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb8c2a-fb68-45a3-a54d-d2eff406737a None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:20.058843 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb8c2a-fb68-45a3-a54d-d2eff406737a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:20.059297 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb8c2a-fb68-45a3-a54d-d2eff406737a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:20.095683 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-22cb8c2a-fb68-45a3-a54d-d2eff406737a None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:20.098112 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-22cb8c2a-fb68-45a3-a54d-d2eff406737a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:20.107028 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1490/2977] 10.222.0.33 () {58 vars in 1059 bytes} [Sun Sep 11 01:52:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:20.116150 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c348ca3-b173-4ae6-9ea1-4552588349cc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:20.127073 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c348ca3-b173-4ae6-9ea1-4552588349cc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:20.134235 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab54b5-600e-40de-8f05-1ca0cf444c8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:20.134992 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab54b5-600e-40de-8f05-1ca0cf444c8a service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:20.135354 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab54b5-600e-40de-8f05-1ca0cf444c8a service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:20.135662 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab54b5-600e-40de-8f05-1ca0cf444c8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:20.146489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab54b5-600e-40de-8f05-1ca0cf444c8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:20.150137 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab54b5-600e-40de-8f05-1ca0cf444c8a service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:20.170489 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1488/2978] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:52:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:52:27.038869 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa08a9-d83c-4811-ac4f-fafe5afd69bd None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:27.039764 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa08a9-d83c-4811-ac4f-fafe5afd69bd None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:27.040042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa08a9-d83c-4811-ac4f-fafe5afd69bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:27.065549 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-aafa08a9-d83c-4811-ac4f-fafe5afd69bd None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:27.066891 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-aafa08a9-d83c-4811-ac4f-fafe5afd69bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:27.074941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1491/2979] 10.222.0.33 () {58 vars in 967 bytes} [Sun Sep 11 01:52:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:27.087581 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab54b5-600e-40de-8f05-1ca0cf444c8a service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:27.102010 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab54b5-600e-40de-8f05-1ca0cf444c8a service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:27.106978 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a0549-cef8-4e03-b1cf-224dce8f1321 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:27.107577 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a0549-cef8-4e03-b1cf-224dce8f1321 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:27.107859 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a0549-cef8-4e03-b1cf-224dce8f1321 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:27.108124 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a0549-cef8-4e03-b1cf-224dce8f1321 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:27.116831 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a0549-cef8-4e03-b1cf-224dce8f1321 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:27.118393 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a0549-cef8-4e03-b1cf-224dce8f1321 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:27.127292 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1489/2980] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:52:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:52:28.534647 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8635eb-852c-4143-8a3b-31bcc3053ba0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:28.535367 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8635eb-852c-4143-8a3b-31bcc3053ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:28.535485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8635eb-852c-4143-8a3b-31bcc3053ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:28.556431 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2b8635eb-852c-4143-8a3b-31bcc3053ba0 None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:28.558042 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2b8635eb-852c-4143-8a3b-31bcc3053ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:28.567740 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1492/2981] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 01:52:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:28.580843 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a0549-cef8-4e03-b1cf-224dce8f1321 service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:28.594511 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a0549-cef8-4e03-b1cf-224dce8f1321 service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:28.600149 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6f297-0c28-41a9-89a4-a9f3d15b35ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:28.600814 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f297-0c28-41a9-89a4-a9f3d15b35ce service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:28.601152 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f297-0c28-41a9-89a4-a9f3d15b35ce service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:28.601482 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f297-0c28-41a9-89a4-a9f3d15b35ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:28.611033 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6f297-0c28-41a9-89a4-a9f3d15b35ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:28.613043 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6f297-0c28-41a9-89a4-a9f3d15b35ce service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:28.634380 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1490/2982] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:52:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:52:28.743177 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78af8-a884-497e-a715-a1a613c14bf9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:28.743478 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78af8-a884-497e-a715-a1a613c14bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:28.743725 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78af8-a884-497e-a715-a1a613c14bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:28.764059 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9fa78af8-a884-497e-a715-a1a613c14bf9 None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:28.765372 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9fa78af8-a884-497e-a715-a1a613c14bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:28.774587 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1493/2983] 10.222.0.33 () {58 vars in 1009 bytes} [Sun Sep 11 01:52:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:28.786440 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6f297-0c28-41a9-89a4-a9f3d15b35ce service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:28.795281 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6f297-0c28-41a9-89a4-a9f3d15b35ce service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:28.799323 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfa7ef-7890-4d7c-8962-5802703ca616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:28.799904 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfa7ef-7890-4d7c-8962-5802703ca616 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:28.800175 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfa7ef-7890-4d7c-8962-5802703ca616 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:28.800436 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfa7ef-7890-4d7c-8962-5802703ca616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:28.812082 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfa7ef-7890-4d7c-8962-5802703ca616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:28.814128 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfa7ef-7890-4d7c-8962-5802703ca616 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:28.825047 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1491/2984] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:52:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:52:29.923140 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c766d2c-b9e0-4a16-9fab-0723b6238638 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:29.923711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c766d2c-b9e0-4a16-9fab-0723b6238638 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:29.923711 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c766d2c-b9e0-4a16-9fab-0723b6238638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:29.943634 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6c766d2c-b9e0-4a16-9fab-0723b6238638 None None] MFA Rules not processed for user `c45d8e2b0b674e9a814167db4d78749e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:29.944828 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6c766d2c-b9e0-4a16-9fab-0723b6238638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:29.951159 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1494/2985] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Sep 11 01:52:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:29.964272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfa7ef-7890-4d7c-8962-5802703ca616 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:29.973200 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfa7ef-7890-4d7c-8962-5802703ca616 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:29.976794 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300494fb-a6b8-4589-9a82-4bed2827c004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c45d8e2b0b674e9a814167db4d78749e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:29.977387 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300494fb-a6b8-4589-9a82-4bed2827c004 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:29.977660 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300494fb-a6b8-4589-9a82-4bed2827c004 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:29.977926 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300494fb-a6b8-4589-9a82-4bed2827c004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:29.983180 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:52:29.985350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300494fb-a6b8-4589-9a82-4bed2827c004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:29.987322 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300494fb-a6b8-4589-9a82-4bed2827c004 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:29.995720 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1492/2986] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:52:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:52:32.332458 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031f80-6b2c-4a96-992b-b63c24523bc8 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:32.332908 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031f80-6b2c-4a96-992b-b63c24523bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:32.333027 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031f80-6b2c-4a96-992b-b63c24523bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:32.353438 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8e031f80-6b2c-4a96-992b-b63c24523bc8 None None] MFA Rules not processed for user `f2c9025c666340aaaf2a664c88650942`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:32.354618 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8e031f80-6b2c-4a96-992b-b63c24523bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:32.362139 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1495/2987] 10.222.0.33 () {58 vars in 967 bytes} [Sun Sep 11 01:52:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:32.375433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300494fb-a6b8-4589-9a82-4bed2827c004 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:32.386878 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300494fb-a6b8-4589-9a82-4bed2827c004 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:32.391732 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf4a2b-29bf-4fef-89ed-2664365795d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8baa8033f884cb6a7783f78c01a212e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:32.392313 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf4a2b-29bf-4fef-89ed-2664365795d8 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:32.392585 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf4a2b-29bf-4fef-89ed-2664365795d8 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:32.392849 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf4a2b-29bf-4fef-89ed-2664365795d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:32.400816 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf4a2b-29bf-4fef-89ed-2664365795d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:32.402384 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf4a2b-29bf-4fef-89ed-2664365795d8 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:32.410267 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1493/2988] 10.222.0.33 () {60 vars in 1384 bytes} [Sun Sep 11 01:52:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:52:33.636567 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469430d-21b2-42f8-8158-db0ee657ed9d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:33.637086 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469430d-21b2-42f8-8158-db0ee657ed9d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:33.637086 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469430d-21b2-42f8-8158-db0ee657ed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:33.670710 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d469430d-21b2-42f8-8158-db0ee657ed9d None None] MFA Rules not processed for user `ab5f197fb09e422997434a1b2feb4567`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:33.672485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d469430d-21b2-42f8-8158-db0ee657ed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:33.682161 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1496/2989] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 01:52:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:33.696056 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf4a2b-29bf-4fef-89ed-2664365795d8 service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:33.707980 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf4a2b-29bf-4fef-89ed-2664365795d8 service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:33.718837 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1f79e-35db-419d-959c-ccdf28a65fdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5f197fb09e422997434a1b2feb4567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:33.719702 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f79e-35db-419d-959c-ccdf28a65fdd service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:33.719964 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f79e-35db-419d-959c-ccdf28a65fdd service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:33.720297 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f79e-35db-419d-959c-ccdf28a65fdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:33.731404 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1f79e-35db-419d-959c-ccdf28a65fdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:33.733619 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1f79e-35db-419d-959c-ccdf28a65fdd service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:33.745452 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1494/2990] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:52:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:52:40.304488 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0b18d-c388-4b38-b088-eb7d6f7c9e0b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:40.304969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0b18d-c388-4b38-b088-eb7d6f7c9e0b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:40.305208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0b18d-c388-4b38-b088-eb7d6f7c9e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:40.315361 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=41 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:52:40.328010 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2ac0b18d-c388-4b38-b088-eb7d6f7c9e0b None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:40.329652 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2ac0b18d-c388-4b38-b088-eb7d6f7c9e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:40.339484 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1497/2991] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 01:52:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:40.352030 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc561a65-74ae-48f5-ae83-9bbaf99e8d05 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:40.352896 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc561a65-74ae-48f5-ae83-9bbaf99e8d05 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:40.353234 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc561a65-74ae-48f5-ae83-9bbaf99e8d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:40.384856 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cc561a65-74ae-48f5-ae83-9bbaf99e8d05 None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:40.386077 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cc561a65-74ae-48f5-ae83-9bbaf99e8d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:40.403019 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1495/2992] 10.222.0.33 () {58 vars in 1058 bytes} [Sun Sep 11 01:52:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:40.409924 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0b18d-c388-4b38-b088-eb7d6f7c9e0b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:40.425499 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0b18d-c388-4b38-b088-eb7d6f7c9e0b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:40.429218 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e44baf-d084-4e97-b621-82c54fc86fc3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:40.429969 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e44baf-d084-4e97-b621-82c54fc86fc3 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:40.430485 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e44baf-d084-4e97-b621-82c54fc86fc3 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:40.431139 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e44baf-d084-4e97-b621-82c54fc86fc3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:40.442482 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e44baf-d084-4e97-b621-82c54fc86fc3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:40.444190 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e44baf-d084-4e97-b621-82c54fc86fc3 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:40.454704 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1498/2993] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:52:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:52:43.518414 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f815a6-f865-4d7b-ad47-b9580d3426a4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:43.518884 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f815a6-f865-4d7b-ad47-b9580d3426a4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:43.518974 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f815a6-f865-4d7b-ad47-b9580d3426a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:43.540308 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c3f815a6-f865-4d7b-ad47-b9580d3426a4 None None] MFA Rules not processed for user `1f9f521aa8ce46c982d7ed178e86bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:52:43.541447 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c3f815a6-f865-4d7b-ad47-b9580d3426a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:43.551095 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1496/2994] 10.222.0.33 () {58 vars in 1018 bytes} [Sun Sep 11 01:52:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:52:43.569192 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e44baf-d084-4e97-b621-82c54fc86fc3 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:43.581716 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f815a6-f865-4d7b-ad47-b9580d3426a4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:43.585200 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e44baf-d084-4e97-b621-82c54fc86fc3 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:43.590346 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b2f29-a8a5-4a2e-9ad8-8eb9641539eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:43.590989 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b2f29-a8a5-4a2e-9ad8-8eb9641539eb service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:43.591299 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b2f29-a8a5-4a2e-9ad8-8eb9641539eb service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:43.591570 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b2f29-a8a5-4a2e-9ad8-8eb9641539eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:43.601512 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b2f29-a8a5-4a2e-9ad8-8eb9641539eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:43.603129 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b2f29-a8a5-4a2e-9ad8-8eb9641539eb service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:43.613310 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1499/2995] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:52:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:52:43.668804 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f815a6-f865-4d7b-ad47-b9580d3426a4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:43.674076 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:43.674818 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:43.675165 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:43.675445 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] PATH_INFO: `/v3/users/3b815f0dd3d6435eb8fdec65aac46418` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:43.676593 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b815f0dd3d6435eb8fdec65aac46418)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:43.678570 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:43.728034 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b815f0dd3d6435eb8fdec65aac46418'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:43.741537 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b815f0dd3d6435eb8fdec65aac46418'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:43.748524 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b815f0dd3d6435eb8fdec65aac46418'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:43.757272 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b815f0dd3d6435eb8fdec65aac46418'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:43.757986 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b815f0dd3d6435eb8fdec65aac46418'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:43.764254 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1497/2996] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:52:43 2022] DELETE /identity/v3/users/3b815f0dd3d6435eb8fdec65aac46418 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:52:44.236069 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b2f29-a8a5-4a2e-9ad8-8eb9641539eb service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:44.247611 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b2f29-a8a5-4a2e-9ad8-8eb9641539eb service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:44.308046 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:44.308666 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:44.308941 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:44.309208 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] PATH_INFO: `/v3/projects/db62fffedd114c1c90b39a8bca092097` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:44.310302 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db62fffedd114c1c90b39a8bca092097)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:44.312250 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:44.357626 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db62fffedd114c1c90b39a8bca092097', 'request_id': 'req-47df6645-5dc9-45b8-8677-d87981165db2'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.363800 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db62fffedd114c1c90b39a8bca092097', 'request_id': 'req-47df6645-5dc9-45b8-8677-d87981165db2'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.369179 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db62fffedd114c1c90b39a8bca092097', 'request_id': 'req-47df6645-5dc9-45b8-8677-d87981165db2'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.394721 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] The token cache is being invalidate because project db62fffedd114c1c90b39a8bca092097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:52:44.395034 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.395648 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.397103 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1500/2997] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:52:44 2022] DELETE /identity/v3/projects/db62fffedd114c1c90b39a8bca092097 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:52:44.401104 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:44.402568 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:44.416258 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59147b7-a9ed-4c87-a87b-c0e3ae7fe1bd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:44.429433 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:52:44.476350 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:44.476979 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:44.477251 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:44.477519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] PATH_INFO: `/v3/users/28620e20f8c74ae1b12895f91d7a26e8` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:44.478631 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28620e20f8c74ae1b12895f91d7a26e8)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:44.480606 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:44.525717 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28620e20f8c74ae1b12895f91d7a26e8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.537362 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28620e20f8c74ae1b12895f91d7a26e8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.544071 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28620e20f8c74ae1b12895f91d7a26e8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.551519 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28620e20f8c74ae1b12895f91d7a26e8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28620e20f8c74ae1b12895f91d7a26e8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.558021 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1498/2998] 10.222.0.33 () {58 vars in 1224 bytes} [Sun Sep 11 01:52:44 2022] DELETE /identity/v3/users/28620e20f8c74ae1b12895f91d7a26e8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:52:44.725307 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:52:44.726998 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:52:44.740669 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df6645-5dc9-45b8-8677-d87981165db2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:52:44.787185 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:52:44.801263 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825ce55-7c2a-4974-8a63-68429967e681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c252561ac77c437ba347f9d9a260e990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a604dda8f82546e29f08510ef905d15b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:52:44.801895 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825ce55-7c2a-4974-8a63-68429967e681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:52:44.802166 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825ce55-7c2a-4974-8a63-68429967e681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:52:44.802437 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825ce55-7c2a-4974-8a63-68429967e681 admin admin] PATH_INFO: `/v3/projects/03f7f87e13d24857be15bd1d3a554c38` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:52:44.803703 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825ce55-7c2a-4974-8a63-68429967e681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f7f87e13d24857be15bd1d3a554c38)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:52:44.805584 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825ce55-7c2a-4974-8a63-68429967e681 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:52:44.851932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c825ce55-7c2a-4974-8a63-68429967e681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f7f87e13d24857be15bd1d3a554c38', 'request_id': 'req-c825ce55-7c2a-4974-8a63-68429967e681'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.857932 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c825ce55-7c2a-4974-8a63-68429967e681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f7f87e13d24857be15bd1d3a554c38', 'request_id': 'req-c825ce55-7c2a-4974-8a63-68429967e681'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.863521 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c825ce55-7c2a-4974-8a63-68429967e681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f7f87e13d24857be15bd1d3a554c38', 'request_id': 'req-c825ce55-7c2a-4974-8a63-68429967e681'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.876324 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c825ce55-7c2a-4974-8a63-68429967e681 admin admin] The token cache is being invalidate because project 03f7f87e13d24857be15bd1d3a554c38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:52:44.876615 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c825ce55-7c2a-4974-8a63-68429967e681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.877237 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c825ce55-7c2a-4974-8a63-68429967e681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:52:44.878809 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1501/2999] 10.222.0.33 () {58 vars in 1233 bytes} [Sun Sep 11 01:52:44 2022] DELETE /identity/v3/projects/03f7f87e13d24857be15bd1d3a554c38 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:52:54.554429 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:52:54.872667 dv-neutron-master-2-hyperv devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:55:22.416855 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:55:22.418269 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:55:22.553084 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7423463-cae0-4b52-8728-019a8fe89e30 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:55:22.611143 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865306f3-fccf-4a64-96c0-b19d018e9e19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9f521aa8ce46c982d7ed178e86bcec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5275375bc1421cb3fe6e27d5f685fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:55:22.611753 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865306f3-fccf-4a64-96c0-b19d018e9e19 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:55:22.612029 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865306f3-fccf-4a64-96c0-b19d018e9e19 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:55:22.612296 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865306f3-fccf-4a64-96c0-b19d018e9e19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:55:22.614043 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-865306f3-fccf-4a64-96c0-b19d018e9e19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:55:22.624832 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865306f3-fccf-4a64-96c0-b19d018e9e19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:55:22.626397 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865306f3-fccf-4a64-96c0-b19d018e9e19 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:55:22.635801 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1499/3000] 10.222.0.33 () {60 vars in 1365 bytes} [Sun Sep 11 01:55:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:55:32.631906 dv-neutron-master-2-hyperv devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}